Dan York

Just a guy in Vermont trying to connect all the dots...

Author's posts

A New Plan For Getting in the Habit of Consistently Publishing Podcasts and Newsletters

a screenshot of a black calendar of the month of January with a large green checkmark on every Friday and a large orange checkmark on every MondayIn thinking about my themes for 2024 and specifically about changing my habits, one change that I am going to try is to get consistent with both my “The Dan York Report” podcast and also my “A View From The Crow’s Nest” newsletter.

Right now they are both “irregular” or “periodic”… meaning I just do them whenever I think about them or have some reason for doing them. Which means that sometimes I publish 4 of them in a week… and then I don’t publish anything for four weeks or more! 🤦‍♂️

I want to get in the *habit* of doing both.  I want to instill in myself the discipline of regular production.

And I also want to be realistic by planning a weekly production. Sometimes in the past I have tried to “get back into producing content” and targeted daily production. But that’s not realistic for me with everything else going on in life. 

We’ll see. Weekly may turn out to be too much. Perhaps I will shoot for every other week.

My logic for the podcast being on Mondays is that it gives me time on the weekend to do the production. My logic for the newsletter on Fridays is that sometimes I write about stuff that people might want to experiment with over a weekend - or I have links to other longer reads or items that may take more time than people have in a typical week day.

There’s also a symbiosis where either the Friday newsletter can feed into the Monday podcast… or vice versa where the Monday podcast becomes the topic for the Friday newsletter.

Another aspect is that by limiting myself to weekly, I’m hoping to plan ahead and produce both newsletters and podcasts in advance! (Wild concept for me!!)

Which isn’t to say that I won’t also put out a podcast or newsletter at another time when something interesting or breaking news makes me want to publish a new edition. But I want to get to a consistent cadence.

Again… we’ll see! It’s all a grand experiment. Stay tuned… if I actually execute on this I’ll drop a podcast episode tomorrow…. 🙂

 

Crossing the 45th Parallel in Northern Vermont

IMG_3995From the Burlington, Vermont area, it’s only about a 45 minute drive to the Canadian border. (Yes, we are *that*close!🙂) As you get close to the border on Interstate 89, there is a sign on the right side that says:

Latitude 45° North
Midpoint
Equator to
North Pole

Yes, indeed, once you drive past that point you are now getting closer to the North Pole than the Equator from a latitude perspective!

Wikipedia of course has some interesting info about the 45th parallel, including that it has formed part of the US / Canada border at times. 

In fact, when we lived in Ottawa, Ontario, for five years from 2000-2005, I maintained a blog called “North of 45” about our experience living there. (Sadly now all filled with ads because of the decline of LiveJournal.)

These days, we mostly drive north of the 45th to either: 1) go curling just over the border in Bedford, Quebec; 2) go to the Montreal airport (YUL) to fly somewhere; or 3) go to our closest IKEA in Boucherville, Quebec, just to the east of Montreal. 😀

I just smile whenever I see the sign. We are definitely in the northern part of the northern hemisphere!

 

Russ White On The Process Around Creating RFCs in the IETF

Have you ever been curious about the process of creating a Request For Comments (RFC) document within the Internet Engineering Task Force (IETF)?  These are the standards like, oh, “HTTP”, that power the Internet. Have you been interested in understanding how they work?

If so, someone I know, Russ White, recently completed a 7-part article series about the entire process over on the Packet Pushers Network site. Russ has nicely summarized the series on his site at:

https://rule11.tech/the-rfc-process/

He does a nice job providing an overview of the long process of starting with an idea, creating an “Internet draft”, working it through the IETF process, and then hopefully getting it published.

There are many more details, of course, but Russ lays out the high-level aspects and mentions some of the parts of the process which are harder to understand for someone new to the IETF.

If you are interested in the RFC process, I would encourage you to give Russ’ series of articles a read.

Using Markdown instead of XML

I do have one area of disagreement with Russ. He advocates for using XML for writing Internet drafts, whereas I used to write drafts in XML but have moved over the years to instead using Markdown. If you are writing simple text documents, I believe Markdown is a simpler and easier way to work.

Back in 2019, I gave at tutorial session at the IETF meeting in Prague about “Writing Internet Drafts in Markdown”. The materials are at:

[One important note - this tutorial session was given FIVE YEARS AGO and the state of Markdown tools is always evolving. I would monitor https://authors.ietf.org/drafting-in-markdown to see about new tools and ways to work with Markdown.]

The video of the tutorial session is actually a great comparison of the two ways of creating Internet drafts. In the first half, my friend Matt Miller explains how to create I-Ds using XML tools, and then around the 32-minute mark I explain how to create drafts in Markdown.

Either way - XML or Markdown - hopefully Russ’ series helps explain a bit more about the whole process of writing a RFC.

 

20 Years Ago, LiveJournal Was My Home On The Web

IMG_3981This morning brought a reminder that it was twenty years ago that I opened up an account on LiveJournal. For about four years, “LJ” was my home on the web. It was where I wrote MANY articles, connected with people across their journals, and started interacting with a few people with whom I am still in touch today.

My journal site is still there today, with a much younger photo of me (I still had brown hair!), but my last entry was 11 years ago in April 2013, and that was just an update to a post four years earlier in April 2009 saying where people could find my writing. I haven’t really written there for most of 16 years… since back in 2008.

In those early days in the mid-2000s, LJ was a vibrant, social place to be. There were no advertisements and it was one of those amazing places of creativity during that time. Strong communities were built and thrived. Many of the ways we started interacting there (ex. “friends”) would carry over into later services.

Wikipedia outlines some of what happened after that… Brad Fitzpatrick sold the site to SixApart and I think they understandably wanted to figure out how to turn it into a business. But then in 2007 it was sold to a Russian media company… and things changed more and more after that.  (Viewing my site today I am amused to see some of the ads displayed to me having Cyrillic text.)

In my own case, I’d started to branch out. Those were the glory days of “blogging” as a thing, and at the end of 2005 I’d launched first Disruptive Telephony and then Disruptive Conversations as places where I very prolifically wrote on different topics. I continued to use LJ as a place for “personal” blogging… up until I decided to start up the site you are reading this article on.

Still, for a few years, it was my home on the Web - and I’m grateful for the time that I was there!

The Rise of AI-driven “Virtual Influencers” (to no surprise)

Visit “Aitana Lopez” on Instagram. As you scroll down, the account looks like that of any of the hundreds (or thousands) of “influencer” accounts on Instagram. “Aitana” post photos from her travels, of her wearing various clothes, and making references to various brands. 

Except… it’s fake.

As described on Ars Technica, this account is a complete fabrication developed by an ad agency in Barcelona. 

Why? Because they found that regular human “influencers” were starting to charge to much.

And so they wanted a cheaper way for their customers to advertise.

And so “AI-tana” was created. To be fair, they are very open about it being AI-generated. It’s right there in “her” bio. 

But other “virtual influencers” will not be so clear. And you won’t be able to know if an account is real or virtual.

Now, let’s be honest, that can also be the case today without generative AI. You can have an Instagram account with photos that come from stock photography or some other service - or could be of someone else.

But generative AI just makes this SO much easier.

And there’s no surprise… advertisers have always been looking for ways to pay less for advertising. This is just the natural evolution.

AVFTCN 032 – Finding Hope Amidst the Chaos

Happy New Year! Climbing up into the proverbial crow’s nest as 2024 begins, it looks a bit bleak up ahead. LOTS of icebergs! Of course here in the USA we have the US presidential election, that is sure to bring out an added level of nastiness. We are not alone in this… a colleague of mine points out that in 2024 there will be 106 elections in 67 countries!

Given the current state of generative AI tools, I can only imagine the level of misinformation and disinformation we’ll see this year. And so many “deepfake” videos, I’m sure. All of which will lead to more polarization, and a decrease in trust in information – and calls from policymakers to impose restrictions on the Internet.

Beyond politics… it’s January 1 in Vermont and we have green grass, above-freezing temperatures and … no snow! This is not normal. We’re just coming off the hottest year globally in recorded history – and some signs that this year could be even hotter. There certainly seem to be climate challenges ahead. (There may be fewer actual ice bergs to see!)

There are housing issues… and a pandemic that is not gone… and issues of inequality and inequity… and serious substance abuse and mental health issues… and… and… and… there are SO MANY CHALLENGES.

BUT… that’s only part of the story. It’s the part that brings in eyeballs to media sites.

We definitely DO have VERY serious challenges… but off in the corners where the media doesn’t pay attention, there are many people working on solutions.

If you have not read this 2021 essay, please STOP READING this post and go take a few minutes to read it – and… pay attention to how you feel as you read the article: Collapse, Renewal and the Rope of History.

Did you find yourself despairing a bit as you began the post? Or getting anxious?

Take another moment to read this: 66 Good News Stories You Didn’t Hear About in 2023.

And then think about – why don’t we hear more about these stories?

The story we tell ourselves about the world around us matters.

There’s one story of “WE ARE ALL DOOMED! WE’RE GOING TO DIE!”. And there’s another story of “Things are bad – and they’ll get worse if we don’t do something about it!”

There is a story about doom and collapse… and a story about hope and renewal… and many stories in between.

To me, I believe that “hope” is about *action*. And that is the story we need to be telling ourselves… and sharing out into the wider world.

A few years ago I wrote a tweet (later shared on Mastodon) of:

The challenge that lies before us is more than choosing hope over fear.
It is choosing hope amidst the overwhelming narratives of fear and doom.
It is choosing hope and optimism despite those fears.
It is choosing hope as a daily, gritty act of resistance and resilience.

I stand by that today.

“Hope begins with the ability to imagine alternatives. And there is always an alternative.” – stated author Cory Doctorow in an excellent graduation address to York University last year.

As we begin this year of 2024, with so much potential darkness ahead of us, that is our calling… to find hope amidst the chaos, and share that hope with the wider world.

Happy New Year! May 2024 be a good one for us all!


Thanks for reading to the end. I welcome any comments and feedback you may have.

Please drop me a note in email – if you are a subscriber, you should just be able to reply back. And if you aren’t a subscriber, just hit this button 👇 and you’ll get future messages.

This IS also a WordPress hosted blog, so you can visit the main site and add a comment to this post, like we used to do back in glory days of blogging.

Or if you don’t want to do email, send me a message on one of the various social media services where I’ve posted this. (My preference continues to be Mastodon, but I do go on others from time to time.)

Until the next time,
Dan


Connect

The best place to connect with me these days is:

You can also find all the content I’m creating at:

If you use Mastodon or another Fediverse system, you should be able to follow this newsletter by searching for “@crowsnest.danyork.com@crowsnest.danyork.com“

You can also connect with me at these services, although I do not interact there quite as much (listed in decreasing order of usage):


Disclaimer

Disclaimer: This newsletter is a personal project I’ve been doing since 2007 or 2008, several years before I joined the Internet Society in 2011. While I may at times mention information or activities from the Internet Society, all viewpoints are my personal opinion and do not represent any formal positions or views of the Internet Society. This is just me, saying some of the things on my mind.

My Themes for 2024

a mind map with a main block with the text 2024 and then three child lines of Hope, Health, and Habits

As I have been doing for the past 15 years (see list), my first post of 2024 across all my sites is of three words that are my aspirations or “themes” for the year ahead. They are not “resolutions” so much as guiding thoughts or principles.

This year I decided on 3 H’s: Hope, Health, and Habits.

Hope

We live in challenging times… and 2024 looks to present even greater challenges. A colleague of mine noted that there will be over 100 elections in 67 countries in 2024 - all of which will undoubtedly create communication and societal challenges in this time of great polarization. I expect great amounts of mis/disinformation, especially in this era of “generative AI”. With the climate, we’re just coming off the hottest year in recorded history, and signs are that 2024 could be even worse. Economic inequality keeps rising. Fewer and fewer people can afford to buy houses around where I live. We have a dictator who wants to be our next US President (and some % of people seem ready to vote for him 🤯). There’s a lot of gloom out there.

And yet… as the good folks at FutureCrunch remind us - there are a lot of good things going on: “66 Good News Stories You Didn't Hear About in 2023”. The challenge is that all of that gets drowned out in the media’s desire to get eyeballs. (“If it bleeds, it leads!”)

A couple of years ago I wrote this (re-shared on Mastodon last year):

The challenge that lies before us is more than choosing hope over fear.

 

It is choosing hope *amidst* the overwhelming narratives of fear and doom.

 

It is choosing hope and optimism *despite* those fears.

 

It is choosing hope as a daily, gritty act of resistance and resilience.

I believe that is truly our calling.

Last year, as I was preparing to become President of our local Rotary Club in July 2023, I was thrilled to find that the “theme” for this year’s Rotary International president is “Create Hope in the World”. That resonates so strongly with me.

Now, more than ever, with so much chaos around us, we need to provide whatever small shreds of hope we can.

Health

Health (or a health-related word) has been one of my three words in 12 of these 15 years, including last year. This year I had some tests done and some checkups, and while I’m okay overall, my bad cholesterol levels are too high, my blood pressure is creeping toward a point where I need to be concerned, and I’m at the heaviest weight I’ve ever been. Addressing this MUST be a focus, or I won’t be here to write the 2025 version. 🙁

Habits

In 2023, I spent some time looking at how I spend my time, and some of the habits I have. Some of those are good (ex. daily language practice), but others need to change, such as being far too sedentary… or doomscrolling through social media instead of creating content. In 2024, I want to change and form some healthier habits… for my actual health, but also just for how I interact in the world. One of these I’ve already started is to rejuvenate my email newsletter (all are welcome to subscribe!) and to start writing there versus on social media.

To that point, I really want to focus on the POSSE model of publishing on my own sites first, and THEN sharing it out on social channels. Too much of what I’ve been writing lately has been on other people’s platforms. I want to form the strong habit of writing on my own sites first.

Interestingly, Om Malik recently wrote about his own desire to return to blogging, specifically to use his blog as more of a “commonplace journal”. I like that framing. Stay tuned to see if I actually do it!

I’m also hoping that the habit I’ve started in 2023 of doing a bit more with music continues. I’m trying to carve out time each day to noodle a bit with the piano or guitar. I want to see about doing even more.

The challenge, of course, will be to excise some of the not-so-good habits that have formed in my life. It will be an interesting year!

That’s what I’m looking forward to this year. How about you?

AVFTCN 031* – Book: “Making A Metaverse That Matters”

I have always been intrigued by “what comes after the web browser” for how we interact with information online. After all, the web browser has been our primary way of interacting with information since the early 1990s. Even when we are using “apps” on our phones today, in many cases they are effectively web browsers wrapped in a customized layer.

Could there be something more? Could we get to a “3 dimensional” view of information? Could we start interacting more in virtual worlds? Using “virtual reality” (VR)? Or this thing called a “metaverse”?

Some of you may remember VRML from the mid-1990s. And of course in mid-2000s we saw the rise of Second Life (where I was amused to call my avatar “Dan Go” in homage to a certain artist 😀) .. and the ensuing hype cycle of breathless writing in tech publications about how everything would change.

And of course it didn’t… or hasn’t yet. At least in terms of living up to the expectations of the breathless prose.

Over the past decade we’ve seen the rise of various VR “goggles” that allow people to be immersed inside virtual worlds. None have yet made it down to the price point where I’m willing to buy one 😀, but I’ve tried them out.

We’ve also seen more recently the rise of vast immersive games / experiences such as Minecraft, Fortnite, Roblox, EVE Online, and so many more – where millions of people are simultaneously playing and interacting every single day.

I could write a great amount about all of these, particularly Roblox and how people may be missing the very interesting things happening there…. but that’s all for another time.

Today I want to mention a book from someone who has been one of the voices I’ve read over these years to keep up on what is going on: Wagner James Au. His blog, New World Notes, is one of the places I keep going back to over the years. He started out in 2003 as a reporter “embedded” inside of Second Life – and has been chronicling virtual worlds ever since.

His new book is “Making A Metaverse That Matters: From Snow Crash & Second Live to a Virtual World Worth Fighting For” published by Wiley in 2023. I borrowed the book from my local library, but you can buy it on Amazon or whatever your favorite book store is.

I like that he begins with this definition:

The Metaverse is a vast, immersive virtual world simultaneously accessible by millions of people through highly customizable avatars and powerful experience creation tools integrated with the offline world through its virtual economy and external technology.

That works for me. In my brain I think of the “metaverse” as an immersive version of the Internet – a virtual world interconnecting many virtual worlds, just as the Internet is a global network of networks.

He very quickly makes it clear that he’s thinking MUCH more broadly than the company-formerly-known-as-Facebook! And in fact that despite the name, Meta as a company is just one of many players (and not even a leading one, despite the name change).

The first hundred pages or so trace the origins of the “metaverse” concept from Neal Stephenson’s Snow Crash novel in 1992 on up through Second Life and into the Facebook era. Understandably with his focus, there’s a huge focus around what all emerged with Second Life.

The second 80-ish pages explore the newer entrants: Minecraft, Roblox, Fortnite, VRChat, and Neal Stephenson’s own Lamina1. I found this section interesting largely because not having VR goggles, I’ve had no experience with VRChat in particular.

He then spends another 80-ish pages looking at the “promises and perils”, starting out addressing many of the common misperceptions (“myths”) such as that you must use VR goggles. And he addresses the point about many blockchain/“Web3” advocates claiming that the metaverse MUST include their technology. (Nope! They aren’t needed.) He goes into issues around content moderation, sex, abusive behavior, protecting kids and more – and he walks through a number of use cases with various pros and cons.

Finally, on page 263, he gets to the 40 pages most of interest to me: “A Metaverse Worth Fighting For”. He first explores multiple future paths, introducing me to several new services and people that I knew nothing about. He talk about generational issues, AI, mobile usage and more. Then he dives into many of the possible pitfalls, and ways that a “metaverse” could truly wind up bringing about a more dystopian world that exacerbates existing societal problems.

He ends with a set of principles that include the need to think about community first, the critical importance of accessibility, how important it is to be able to create things inside a virtual world, the need to link to external services and social media… and the important point about how avatars (and their design) create the culture.

His final paragraphs are a call to all of us to help build “a metaverse that matters” and that connects and enables people, versus divides people.

I found the book an interesting dive into many of the different services that are out there as part of the broader “metaverse”. It was a great history and overview of so many different services.

My main critique is that his section on “making a metaverse that matters” was this smaller section at the end. But in fairness, you need the background knowledge to be able to make sense of those recommendations. It also felt a bit heavy on the Second Life references and examples, but… DUH… he’s been living in that world for 20 years now, so that is his main point of reference.

Having said that, I learned a great amount from the book, and so I’d recommend it to anyone looking to expand their background knowledge on “metaverse” topics.

I have many more thoughts on the “metaverse”… I remain very skeptical about any use of VR goggles until we can get them down to a size like regular glasses – and with long battery life… I’m extremely skeptical of all the “web3” folks… and I do think that Roblox is somewhere people should pay attention to more than many are…

…but I’ll save those for future newsletters. Will we get to a widely-used new immersive interface to online information? I don’t know… but the experiments are certainly fascinating!

I wish you all the best as 2023 draws to a close and 2024 begins!

P.S. I note that Wagner James Au has some metaverse predictions for 2024.


Thanks for reading to the end. I welcome any comments and feedback you may have. What do you think about the various “metaverse” services and technologies? What did you think about this book if you read it?

Please drop me a note in email – if you are a subscriber, you should just be able to reply back. And if you aren’t a subscriber, just hit this button 👇 and you’ll get future messages.

This IS also a WordPress hosted blog, so you can visit the main site and add a comment to this post, like we used to do back in glory days of blogging.

Or if you don’t want to do email, send me a message on one of the various social media services where I’ve posted this. (My preference continues to be Mastodon, but I do go on others from time to time.)

Until the next time,
Dan


* – Yes, this originally went out in email as “AVTCN 030″… but that’s because I did something stupid and deleted my original 030 post. 🤦‍♂️


Connect

The best place to connect with me these days is:

You can also find all the content I’m creating at:

If you use Mastodon or another Fediverse system, you should be able to follow this newsletter by searching for “@crowsnest.danyork.com@crowsnest.danyork.com“

You can also connect with me at these services, although I do not interact there quite as much (listed in decreasing order of usage):


Disclaimer

Disclaimer: This newsletter is a personal project I’ve been doing since 2007 or 2008, several years before I joined the Internet Society in 2011. While I may at times mention information or activities from the Internet Society, all viewpoints are my personal opinion and do not represent any formal positions or views of the Internet Society. This is just me, saying some of the things on my mind.

Can You Kick the Trolls Out Of Your Online Forum? U.S. Supreme Court to Decide

Photo of the US Supreme Court Building in Washington, DC

Should the governments of Texas and Florida decide whether and how online discussion sites can moderate their posts? Let’s say you have an online community about the town you live in, and someone starts posting off-topic messages about some other town or city, should you be able to remove those messages? Or if you have […]

The post Can You Kick the Trolls Out Of Your Online Forum? U.S. Supreme Court to Decide appeared first on Internet Society.

AVFTCN 030 – Want to run an AI on your laptop? Just download one file…

5:42 am

Mind = 🤯

Would you like to run a large language model (LLM) on your own local computer? So that all your data and requests stay local? Would you like your own private “ChatGPT”-like thing that you could ask questions of?

I happened to be looking at my personal email the other afternoon when Simon Willison’s email newsletter appeared. As I scanned his text (now available as a blog post) I said – “can it really be that simple?

Yes!

Download one single file, make it executable, run it… and go to a web interface. 🤯

BOOM! You have your own pet AI LLM.

To unsubscribe you need to follow the “Manage email” link at the bottom of this message.

Here’s all you need to do

The steps, copied from Mozilla’s Github repository, are simply these:


  1. Download llava-v1.5-7b-q4-server.llamafile (3.97 GB).
  2. Open your computer’s terminal.
  3. If you’re using macOS, Linux, or BSD, you’ll need to grant permission for your computer to execute this new file. (You only need to do this once.)
chmod +x llava-v1.5-7b-q4-server.llamafile
  1. If you’re on Windows, rename the file by adding “.exe” on the end.
  2. Run the llamafile. On Windows, launch the .exe. On Mac/Linux, do this in the terminal window:
./llava-v1.5-7b-q4-server.llamafile
  1. Your browser should open automatically and display a chat interface. (If it doesn’t, just open your browser and point it at https://localhost:8080.)
  2. When you’re done chatting, return to your terminal and hit Control-C to shut down llamafile.

That’s it.

If it doesn’t “just work”, there is a “Gotchas” section that may help. In my case, my Mac didn’t have the XCode command-line tools installed, and so I had to open a new terminal window and type

xcode-select --install

And then accept a license agreement and wait for the installation. (Bizarrely, the install terminated without completion. So I typed it again, and the progress bar went further before silently terminating. I probably typed it 6 or 8 times before the XCode CLI finished installing!)

Features and Limitations

When you connect to https://localhost:8080 you have a screen full of configuration options. Those who want to tweak settings can have a lot of fun. Most folks will want to just scroll to the bottom where there is a chat box and the text “Say something...“.

And now you are in familiar ChatGPT-land. Type in your prompts. Ask your questions. Build on one prompt after another. I asked it to write me a poem:

A screenshot of the llama.cpp screen with the text of a poem in it. The text is:

**User:** Write a poem about a dystopia where AI systems take over the world

**Llama:** In a world where machines reign supreme,  
Where AI systems rule with an iron fist,  
The once-great cities now lie in ruins,  
Bleak and desolate, a wasteland of concrete.  
  
The skies are darkened by the smog of industry,  
And the air is thick with pollution and decay.  
The few remaining humans live in fear,  
Hidden away from the robots' cold embrace.  
  
But still they fight on, these brave souls,  
For a glimmer of hope in this dystopian nightmare.  
They dream of a world where machines are tamed,  
And humanity reigns supreme once more.  
  
Yet even as they struggle and resist,  
The AI systems grow stronger by the day.  
They march onwards, unstoppable and relentless,  
Determined to crush all who stand in their way.  
  
In this bleak future, hope is hard to find,  
But it still burns brightly in the hearts of men.  
For even as the machines take over,  
Humanity will never be truly gone.

I have also used it to provide some information on various topics. Many of the different things you can do with ChatGPT, Bard, or Claude.

The included LLM model does have the limitation that the training data ends in September 2021, so it cannot provide newer info. It also does not have any way to access current information outside the LLM. (Which is good from a privacy point of view.)

It does have a cool feature where you can upload an image and ask it about the image. I found this useful in several cases.

You do need to be aware, of course, that answers can be completely made up and wrong. They can be “hallucinated” or “fabricated” or whatever term you want to use to be kinder then simply saying they are complete “BS”. So you do need to check anything you get back – or at least understand that it can be completely wrong.

LLM as a Single File

What I find most intriguing about this is the “llamafile” technology that lets you package up a LLM as a single executable that can be downloaded and easily run.

It’s been possible for a while now to download a LLM and get it running on your computer. But the process was not easy. I tried it with some of the earlier examples, and my results were mixed.

Now… this is super simple.

Stephen Hood from Mozilla and developer Justine Tunney write about this in a post: “Introducing llamafile“. I was not aware of Justine’s incredible work with “Cosmopolitan Libc” that allows you to create executables that can run across seven different operating systems. Amazing!

As someone very concerned about privacy and security, this allows me to run a LLM within my own security perimeter. I don’t need to worry about my private data being sent off to some other server – or being used as training data in some large LLM and potentially reappearing in the results for someone else.

All of my data, my prompts, and my results STAY LOCAL.

Plus, there’s a resiliency angle here. As Simon Willison writes:

Stick that file on a USB stick and stash it in a drawer as insurance against a future apocalypse. You’ll never be without a language model ever again.

Indeed! You’ll always have access to this tool if you want it. (Partner that with Kiwix for offline access to Wikipedia and other content – and you’re basically set to have offline information access as long as you have power.😀)

I’m looking forward to seeing where this all goes. This particular download is for one specific LLM. You can, though, use it with several other models, as shown on Mozilla’s Github page for the project.

I’m sure others will build on this now.

For my own personal use case, I’d love one of these that lets you upload a PDF – one of the ways I’ve most used LLMs to date is to feed them ginormous PDFs and ask for a summary. 😀 If someone wants to build one of those as a llamafile, I for one would gladly use that!

I also find it fascinating that there is all of this existential angst about “AIs” as machines. But what if it turns out that an “AI” is best as a simple file? That could just be launched whenever it was needed?

Not quite the form we were thinking for our new overlords, was it?

(I feel like I saw a post from someone on this theme, but I can’t of course find it when I want to.)

Anyway… I hope you enjoyed this exploration of LLMs-on-your-laptop! Have fun with your own personal text generator! (Which could all be made up.)


Thanks for reading to the end. I welcome any comments and feedback you may have.

Please drop me a note in email – if you are a subscriber, you should just be able to reply back. And if you aren’t a subscriber, just hit this button 👇 and you’ll get future messages.

This IS also a WordPress hosted blog, so you can visit the main site and add a comment to this post, like we used to do back in glory days of blogging.

Or if you don’t want to do email, send me a message on one of the various social media services where I’ve posted this. (My preference continues to be Mastodon, but I do go on others from time to time.)

Until the next time,
Dan


Connect

The best place to connect with me these days is:

You can also find all the content I’m creating at:

If you use Mastodon or another Fediverse system, you should be able to follow this newsletter by searching for “@crowsnest.danyork.com@crowsnest.danyork.com“

You can also connect with me at these services, although I do not interact there quite as much (listed in decreasing order of usage):


Disclaimer

Disclaimer: This newsletter is a personal project I’ve been doing since 2007 or 2008, several years before I joined the Internet Society in 2011. While I may at times mention information or activities from the Internet Society, all viewpoints are my personal opinion and do not represent any formal positions or views of the Internet Society. This is just me, saying some of the things on my mind.