Open source
Portkey
An AI gateway with logging, routing and guardrails.
What it is
It sits between your application and the model providers to add retries, semantic caching, failover between providers, budgets and validation of inputs and outputs.
Best for
Adding reliability and control to LLM calls in production.
What the free plan includes
- Monthly quota of gateway requests
- Limited log retention
- Inference is paid to the end provider
Free plans change often. Confirm the limits on the official page before deciding.
Hugging Face
PickCommunity models, datasets and runnable demos.
Free for public models, datasets and Spaces
Google AI Studio
PickPrototype with the Gemini models from your browser.
Free studio access and a free API tier
NVIDIA NIM
Hosted APIs for AI models optimised by NVIDIA.
Free API credits for prototyping