Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

331

Base only

Active filters: sagemaker

nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4

Text Generation • 18B • Updated 1 day ago • 44.9k • 226

nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

Text Generation • 32B • Updated 1 day ago • 22.3k • • 129

Qwen/Qwen3.6-27B

Image-Text-to-Text • 28B • Updated Apr 24 • 6.83M • • 2.25k

google/gemma-4-31B-it

Image-Text-to-Text • 31B • Updated 24 days ago • 9.92M • • 3.54k

Qwen/Qwen3.6-35B-A3B

Image-Text-to-Text • 36B • Updated Apr 24 • 5.61M • • 2.68k

nvidia/LocateAnything-3B

Image-Text-to-Text • 4B • Updated Jun 12 • 327k • 2.91k

openai/whisper-large-v3

Automatic Speech Recognition • 2B • Updated Aug 12, 2024 • 4.95M • • 6.14k

Qwen/Qwen3-ASR-1.7B

Automatic Speech Recognition • 2B • Updated Jan 30 • 3.86M • • 1.01k

google/gemma-4-12B-it

Any-to-Any • 12B • Updated 24 days ago • 3.21M • 1.44k

meta-llama/Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Sep 25, 2024 • 7.55M • • 6.59k

google/gemma-4-26B-A4B-it

Image-Text-to-Text • 27B • Updated 24 days ago • 10.1M • • 1.39k

openbmb/MiniCPM5-1B

Text Generation • 1B • Updated May 26 • 1.09M • 1.06k

openai/gpt-oss-20b

Text Generation • 22B • Updated Aug 26, 2025 • 8.1M • • 4.91k

Qwen/Qwen3-Coder-Next

Text Generation • 80B • Updated Feb 3 • 523k • • 1.59k

google/gemma-4-E4B-it

Any-to-Any • 8B • Updated 24 days ago • 5.12M • 1.47k

meta-llama/Llama-3.2-3B-Instruct

Text Generation • 3B • Updated Oct 24, 2024 • 1.18M • • 2.42k

openai/gpt-oss-120b

Text Generation • 117B • Updated Aug 26, 2025 • 4.22M • • 5.1k

deepseek-ai/DeepSeek-R1

Text Generation • 685B • Updated Mar 27, 2025 • 8.32M • • 13.6k

Qwen/Qwen3-0.6B

Text Generation • 0.8B • Updated Jul 26, 2025 • 28.9M • • 1.51k

sentence-transformers/all-MiniLM-L6-v2

Sentence Similarity • 22.7M • Updated Jun 1 • 250M • • 5.21k

BAAI/bge-m3

Sentence Similarity • Updated Jul 3, 2024 • 34.1M • • 3.39k

black-forest-labs/FLUX.1-schnell

Text-to-Image • 12B • Updated Aug 16, 2024 • 213k • • 5.53k

Qwen/Qwen3.5-9B

Image-Text-to-Text • 10B • Updated Mar 2 • 13.6M • • 1.81k

Qwen/Qwen3.5-4B

Image-Text-to-Text • 5B • Updated Mar 2 • 7.33M • • 810

Qwen/Qwen-AgentWorld-35B-A3B

Text Generation • 35B • Updated Jun 25 • 75.8k • 677

Qwen/Qwen3-8B

Text Generation • 8B • Updated Jul 26, 2025 • 16.1M • • 1.29k

openai/whisper-large-v3-turbo

Automatic Speech Recognition • 0.8B • Updated Oct 4, 2024 • 7.79M • • 3.24k

Qwen/Qwen3-TTS-12Hz-1.7B-Base

2B • Updated Jan 23 • 2.9M • 483

Qwen/Qwen3.5-2B

Image-Text-to-Text • 2B • Updated Mar 2 • 2.87M • • 359

google/gemma-4-E2B-it

Any-to-Any • 5B • Updated 24 days ago • 3.88M • 889