Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

This local AI quickly replaced Ollama on my Mac - here's why ...

Attila covers software, apps and services, with a focus on virtual private networks. He's an advocate for digital privacy and has been quoted in online publications like Computer Weekly, The Guardian, ...