Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,023

Base only

Active filters: ggml

unsloth/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Apr 20 • 303k • 574

unsloth/FLUX.2-klein-9B-GGUF

Image-to-Image • 9B • Updated Jan 16 • 244k • 351

unsloth/FLUX.2-klein-4B-GGUF

Image-to-Image • 4B • Updated Jan 16 • 275k • 219

HoppouAI/Breeze-TTS-2.cpp

Text-to-Speech • 3B • Updated 23 days ago • 8.78k • 18

unsloth/Z-Image-Turbo-GGUF

Text-to-Image • 6B • Updated Jan 8 • 334k • 263

mudler/moss-transcribe.cpp-gguf

Automatic Speech Recognition • 0.9B • Updated Jul 9 • 1.86k • 13

microsoft/VibeVoice-ASR-BitNet

Automatic Speech Recognition • 0.3B • Updated Jul 24 • 37.7k • 198

Serveurperso/YuE2-GGUF

0.7B • Updated 6 days ago • 2.61k • 4

unsloth/FLUX.2-dev-GGUF

Image-to-Image • 32B • Updated Dec 10, 2025 • 42.8k • 92

unsloth/Qwen-Image-GGUF

Text-to-Image • 20B • Updated Dec 22, 2025 • 32.4k • 33

Serveurperso/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated 10 days ago • 37.1k • 64

Serveurperso/Qwen3-TTS-GGUF

Text-to-Speech • 0.9B • Updated 10 days ago • 336k • 46

RemySkye/Qwen3.8-Flash-Next-REAM-60Pct-GGUF

Text Generation • 129B • Updated 12 days ago • 16.1k • 5

unsloth/Z-Image-GGUF

Text-to-Image • 6B • Updated Jan 28 • 60.7k • 195

Serveurperso/ACE-Step-1.5-GGUF

0.7B • Updated 7 days ago • 115k • 94

CelesteImperia/Whisper-Large-v3-Turbo-GGML

Automatic Speech Recognition • Updated Mar 26 • 1

unsloth/ERNIE-Image-GGUF

Text-to-Image • 8B • Updated Apr 14 • 2.56k • 71

cstr/all-MiniLM-L6-v2-GGUF

Feature Extraction • 22.7M • Updated Aug 2 • 382 • 1

cstr/chatterbox-GGUF

Text-to-Speech • 0.3B • Updated Aug 13 • 5.31k • 3

cstr/sensevoice-small-GGUF

Automatic Speech Recognition • 0.2B • Updated Aug 2 • 1.88k • 2

cstr/siglip-so400m-patch14-384-GGUF

Image Feature Extraction • 0.4B • Updated Aug 2 • 34 • 1

gariwat/swiss-german-whisper-ggml

Automatic Speech Recognition • Updated Jul 8 • 1

Zyphra/ZONOS1-GGUF

Text-to-Speech • 63.5M • Updated Jul 15 • 174 • 3

LocalAI-io/TRELLIS.2-4B-GGUF

Image-to-3D • 0.5B • Updated Jul 16 • 13.2k • 11

simonfxr/kokoro.cpp-GGUF

Text-to-Speech • 81.7M • Updated Jul 21 • 1.43k • 1

remixerdec/Inflect-Nano-v2-GGUF

Text-to-Speech • 3.96M • Updated Jul 28 • 39 • 6

ckadirt/LeVo2-GGUF

0.7B • Updated Aug 13 • 553 • 1

Auguments/Qwen-Gemma-LFM-etc-fixed-jinja-templates

Updated Aug 13 • 1

mousebar01/Pixal3D.cpp-GGUF

Image-to-3D • 5B • Updated 7 days ago • 447 • 1

JoaoZaokk/whisper-large-v3-turbo-korean-ggml

Automatic Speech Recognition • Updated 7 days ago • 1