Thanks to Charlotte Lin
https://www.nature.com/articles/d41586-026-03227-4 How to use private, offline AI systems https://www.nature.com/articles/d41586-026-03227-4
Scientists are turning to a growing suite of tools, such as Ollama and LM Studio, that enable researchers to download large language models to their computer and chat with them offline. “I do not want Claude to start telling people my research results,” says neuroscientist Ian Gaudet. Among other things, these tools allow researchers to privately query their PDF libraries. Reproducibility is another benefit: cloud-based AI providers update their models without notice, so a query that works today might return different results next month. But local models also have limitations — they can ‘hallucinate’, for example — and computers powerful enough to run them are expensive.