Ollama
Run language models locally on CPU or GPU with one command.
MITPermissive
SaaS: YesClosed product: Yes
- GitHub stars
- 182k
- Deployment
- Binary, Docker
Open-source alternatives to OpenAI API
OpenAI API in the AI category. These are the open alternatives we recommend looking at.
llama.cpp
C/C++ engine for running language models locally, even without a GPU.
MITPermissive
SaaS: YesClosed product: Yes
- GitHub stars
- 130k
- Deployment
- Library
LocalAI
Self-hosted drop-in for the OpenAI API that runs language, image and voice models on your own hardware.
MITPermissive
SaaS: YesClosed product: Yes
- GitHub stars
- 49.4k
- Deployment
- Docker
vLLM
High-throughput serving of language models in production.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- GitHub stars
- 93k
- Deployment
- Docker (GPU)
SGLang
Fast framework for serving large language models and multimodal models in production.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- GitHub stars
- 36.7k
- Deployment
- Library
Xinference
Platform for running open language, speech and multimodal models behind one API, locally or in the cloud.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- GitHub stars
- 9.6k
- Deployment
- Docker
LMDeploy
Toolkit for compressing, deploying and serving language models efficiently.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- GitHub stars
- 8.1k
- Deployment
- Library
LM Studio MLX engine
The engine LM Studio uses to run models with Apple MLX on Mac.
MITPermissive
SaaS: YesClosed product: Yes
- GitHub stars
- 1.2k
- Deployment
- Library
This is guidance, not legal advice (inte juridisk rådgivning). Check with a lawyer before deciding.
Sign in for more
- Full licence analysis per use case (self-hosting, modifying, hosted service, AI use)
- Save products to your own lists
- Systemkarta: map the tools you already use (coming soon)
- Personal help and AI advice (coming soon)