promptfoo
Command-line tool for testing prompts, agents and RAG setups and for security testing AI apps.
MITPermissive
SaaS: YesClosed product: Yes
- GitHub stars
- 25.7k
- Deployment
- CLI
Open-source alternatives to LangSmith Evaluations
LangSmith Evaluations in the AI category. These are the open alternatives we recommend looking at.
DeepEval
Python framework for evaluating language model output with metrics, much like unit tests.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- GitHub stars
- 18.6k
- Deployment
- Library
Strands Evals
Framework for evaluating AI agents and LLM apps with test cases and graders.
Apache-2.0Permissive
SaaS: YesClosed product: Yes
- GitHub stars
- 222
- Deployment
- Library
This is guidance, not legal advice (inte juridisk rådgivning). Check with a lawyer before deciding.
Sign in for more
- Full licence analysis per use case (self-hosting, modifying, hosted service, AI use)
- Save products to your own lists
- Systemkarta: map the tools you already use (coming soon)
- Personal help and AI advice (coming soon)