Trying a local LLM is easier than you think

See demo1:00 min.

Bored on a plane? Miss chatting with LLMs? Well, with iPhone (15 Pro and up) you can actually do that offline. It's really easy to do. 1 min setup.

It is amazing to see how incredibly smart the model is compared to its tiny size. And how incredibly stupid it is (compared to frontier LLMs).

In words of Simon Willison: if you want to learn how language models work, the best way to do that is to work with the really bad ones. Spending time with a crap local model that hallucinates constantly is such a good way of getting your sort of mental model of what these things are and how they work.