vLLM
High-throughput serving of language models in production.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- GitHub stars
- 93k
- Deployment
- Docker (GPU)
Open-source alternatives to Amazon Bedrock
Amazon Bedrock in the AI category. These are the open alternatives we recommend looking at.
SGLang
Fast framework for serving large language models and multimodal models in production.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- GitHub stars
- 36.7k
- Deployment
- Library
Xinference
Platform for running open language, speech and multimodal models behind one API, locally or in the cloud.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- GitHub stars
- 9.6k
- Deployment
- Docker
LMDeploy
Toolkit for compressing, deploying and serving language models efficiently.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- GitHub stars
- 8.1k
- Deployment
- Library
LM Studio MLX engine
The engine LM Studio uses to run models with Apple MLX on Mac.
MITPermissive
SaaS: YesClosed product: Yes
- GitHub stars
- 1.2k
- Deployment
- Library
This is guidance, not legal advice (inte juridisk rådgivning). Check with a lawyer before deciding.
Sign in for more
- Full licence analysis per use case (self-hosting, modifying, hosted service, AI use)
- Save products to your own lists
- Systemkarta: map the tools you already use (coming soon)
- Personal help and AI advice (coming soon)