BentoML

Open Source Free Trial

BentoML is the platform for software engineers to build AI products.

BentoCloud provides fully managed infrastructures for deploying BentoML, OpenLLM, or any model, optimized for performance, scalability, and cost-efficiency. Supporting models like Llama 2, Stable Diffusion, Flan-T5, Segment Anything, and CLIP.

Pricing: Pay-as-you-go

HQ 🇺🇸 United States

Visit website →

Pricing

Posts

Suggest changes

Resources

BentoML Tutorial: Build Production Grade AI Applicat...

How to Deploy ML Models in Production with BentoML

BentoML Alternatives

Explore 50 products in the Inference APIs category. View all BentoML alternatives.

novita.ai

APIs, Serverless and GPU Instance In One AI Cloud

Free Trial From $0.03/M tokens

Taiga Cloud

European GPU cloud for AI training and inference by Northern Data Group

From ~€2.70/GPU-hr

Nebius

Full-stack AI cloud with GPU infrastructure for training and inference

Free Trial From $2.00/hr (H100)

IonRouter

High-throughput inference API with OpenAI-compatible access to open-source models at half market rate

Free Trial From $0.02/M tokens

Cortecs AI

European AI inference gateway with smart routing across EU providers

Free Trial From Pay-per-use + 5% gateway fee

DeepSeek

Cost-effective inference API with OpenAI-compatible endpoints and open-weight models

Open Source Free Trial From $0.028/1M tokens (cache hit)

View all Inference APIs tools ≫

Is your product missing? 👀 Add it here →