This is an automated archive made by the Lemmit Bot.
The original was posted on /r/microsoft by /u/emreckartal on 2025-01-09 04:00:23+00:00.
Microsoft just released Phi-4, a new open-source large language model you can run completely offline on Windows.
Context: This is an open-source model that you can run locally and fully offline. So you don’t need internet access in order to chat with AI and no one can see your messages.
Microsoft says Phi-4 excels at STEM-related questions, outperforming its teacher model thanks to improved training techniques:
phi-4 substantially surpasses its teacher model on STEM-focused QA capabilities, giving evidence that our data-generation and post-training techniques go beyond distillation
Source: Phi-4 paper
How to run this model locally:
- If you’re comfortable with terminal tools, use Ollama or Cortex
- For non technical users, go with Jan, an alternative to ChatGPT for open-source models like Phi-4
How to set it up for non-technical users
- Copy the Phi-4’s GGUF link:
- Paste it into Jan Hub, and let it download
- Open a new chat and select Phi-4