Published: May 19, 2025
14
126
992
Mac owners don't miss this: MLX LM is now integrated directly within Hugging Face 🤯 ⬇️ Run 4,400+ LLMs locally on Apple Silicon at max speed, no cloud, no wait.
You need to toggle MLX LM in your local apps settings: https://huggingface.co/setting...
Then browse compatible models here: https://huggingface.co/models?...
Bonus: snippet to launch an OpenAI SDK-compatible server is here too.
Huge thanks to the (super active) mlx-lm contributors 🚀https://github.com/ml-explore/... - Hope this feature helps this awesome library grow even more: