BentoML

Open Source Free Trial

BentoML is the platform for software engineers to build AI products.

BentoCloud provides fully managed infrastructures for deploying BentoML, OpenLLM, or any model, optimized for performance, scalability, and cost-efficiency. Supporting models like Llama 2, Stable Diffusion, Flan-T5, Segment Anything, and CLIP.

Pricing: Pay-as-you-go

HQ 🇺🇸 United States

Visit website →

Pricing

Posts

Resources

BentoML Tutorial: Build Production Grade AI Applicat...

How to Deploy ML Models in Production with BentoML

BentoML Alternatives

Explore 61 products in the Inference APIs category. View all BentoML alternatives.

Vast.ai

GPU marketplace for renting compute at market-driven prices with per-second billing

From ~$0.06/GPU/hr

Tensorix

EU-sovereign inference API with 50+ open-source models and zero data retention

evroc

European-sovereign cloud and inference APIs running open-source models on NVIDIA Blackwell GPUs in EU data centers

EUrouter

European AI gateway that routes to 100+ models with EU data residency

From Free (1K req/mo), 39 EUR/mo (Plus)

AKI.IO

European AI API for open-source models on EU infrastructure

Free Trial From Free (10 EUR credits)

Jina AI

Search APIs for embeddings, reranking, and web-to-markdown conversion

Free Trial From Free (10M tokens)

View all Inference APIs tools ≫

Is your product missing?

Add it here →