Run local LLMs on Apple Silicon via [mlx-lm](https://github.com/ml-explore/mlx-examples/tree/main/llms/mlx_lm). Menubar app + CLI with an OpenAI-compatible API on `localhost:11434`.
-
Updated
May 20, 2026 - Swift
#
ollama-compatible
Here are 3 public repositories matching this topic...
Lightweight evaluation framework for Retrieval Augmented Generation systems, focused on simplicity and long-term consistency.
evaluation-framework vector-embeddings retrieval-augmented-generation llm-evaluation openai-compatible ollama-compatible
-
Updated
Apr 29, 2026 - Python
CLI + API server to download, manage, and run 500K+ HuggingFace models locally with Ollama & OpenAI compatibility
privacy ai transformers inference self-hosted mlx model-serving huggingface openai-api llm llama-cpp vllm local-llm gguf ollama-compatible
-
Updated
May 25, 2026 - Python
Improve this page
Add a description, image, and links to the ollama-compatible topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ollama-compatible topic, visit your repo's landing page and select "manage topics."