These are the smallest local LLMs you can get away with

Running AI locally is the kind of project that starts with a graphics card upgrade and ends with an empty wallet. But modern models are far superior to early local LLMs, and you don’t necessarily need a powerful workstation to get something useful. The trick is to choose the model that suits your hardware and know what jobs to give it.