vLLM
High-throughput serving of language models in production.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- GitHub stars
- 93k
- Deployment
- Docker (GPU)
Open-source alternatives to Azure OpenAI
Azure OpenAI in the AI category. These are the open alternatives we recommend looking at.
SGLang
Fast framework for serving large language models and multimodal models in production.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- GitHub stars
- 36.7k
- Deployment
- Library
Xinference
Platform for running open language, speech and multimodal models behind one API, locally or in the cloud.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- GitHub stars
- 9.6k
- Deployment
- Docker
LMDeploy
Toolkit for compressing, deploying and serving language models efficiently.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- GitHub stars
- 8.1k
- Deployment
- Library
LM Studio MLX engine
The engine LM Studio uses to run models with Apple MLX on Mac.
MITPermissive
SaaS: YesClosed product: Yes
- GitHub stars
- 1.2k
- Deployment
- Library
DeepSeek-R1
Large language model from DeepSeek trained for multi-step reasoning such as maths and code.
MITPermissive
SaaS: YesClosed product: Yes
- Deployment
- transformers
gpt-oss (20B / 120B)
Open-weight language models from OpenAI under Apache-2.0.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- Deployment
- Ollama, vLLM
Mistral-7B-Instruct-v0.3
Instruction-tuned language model from Mistral AI with 7 billion parameters and function calling. Based on mistralai/Mistral-7B-v0.3.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- Deployment
- vllm
Qwen2.5-7B-Instruct
Instruction-tuned language model from Qwen with 7 billion parameters for chat, code and multilingual tasks. Based on Qwen/Qwen2.5-7B.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- Deployment
- transformers
phi-4
Smaller language model from Microsoft with 14 billion parameters, focused on reasoning.
MITPermissive
SaaS: YesClosed product: Yes
- Deployment
- transformers
This is guidance, not legal advice (inte juridisk rådgivning). Check with a lawyer before deciding.
Sign in for more
- Full licence analysis per use case (self-hosting, modifying, hosted service, AI use)
- Save products to your own lists
- Systemkarta: map the tools you already use (coming soon)
- Personal help and AI advice (coming soon)