Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

139

Base only

Active filters: w8a16

lued/Qwen3.8-27B-INT8-W8A16-MTP

Image-Text-to-Text • 28B • Updated Aug 15 • 64.2k • 92

lued/Qwen3.8-27B-INT8-W8A16-DFlash2

Image-Text-to-Text • 27B • Updated Aug 21 • 4.24k • 29

Tech2wild/GLM-5.3-Int4-Int8Mix

Text Generation • 779B • Updated Aug 29 • 1.66k • 16

Blackfrost-AI/GLM-5.3-DERISKED-Int4-Int8Mix

Text Generation • 779B • Updated 28 days ago • 1.03k • 4

88plug/MiniCPM-o-4.5-W8A16

Image-Text-to-Text • 9B • Updated 29 days ago • 263 • 2

QuaduxIT/Qwen3.8-27B-Whitehat-W8A16

Image-Text-to-Text • 9B • Updated Aug 28 • 91 • 1

GotoAI-Inc/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-W8A16

Text Generation • 33B • Updated Aug 28 • 28 • 1

Goghor/Swift-1.5-Qwen3.8-27B-INT8-W8A16-MTP

Image-Text-to-Text • 28B • Updated 11 days ago • 56 • 1

JRamirez-UAB/Qwen3.8-27B-DFlash2-W4A16

Text Generation • 2B • Updated 7 days ago • 296 • 1

numsu/AREX-2-27B-INT8-W8A16-MTP

Image-Text-to-Text • 28B • Updated 4 days ago • 584 • 1

TheHouseOfTheDude/Behemoth-ReduX-123B-v1_Compressed-Tensors

Text Generation • Updated Sep 17, 2025 • 31

TheHouseOfTheDude/Qwen3-Next-80B-A3B-Instruct_Compressed-Tensors

Text Generation • Updated Sep 19, 2025

TheHouseOfTheDude/KansenSakura-Erosion-RP-12b_Compressed-Tensors

Text Generation • Updated Nov 11, 2025 • 1 • 1

avtc/GLM-4.5-Air-GPTQMODEL-W8A16

Text Generation • 116B • Updated Dec 1, 2025 • 22 • 2

TheHouseOfTheDude/Llama_3.x_70b_Hexagon_Purple_V3_Compressed-Tensors

Text Generation • Updated Dec 19, 2025 • 1

TheHouseOfTheDude/Broken-Tutu-24B_Compressed-Tensors

Text Generation • Updated Dec 23, 2025 • 12

Tacoin/openpi-pi0.5-libero-onnx

Robotics • Updated Jan 19 • 2

TheHouseOfTheDude/GLM-4.7-Flash_AWQ

Text Generation • Updated Jan 29 • 23 • 3

TheHouseOfTheDude/Qwen3.5-27B-Writer_PTQ

Text Generation • Updated Mar 18

TheHouseOfTheDude/Qwen3.5-27B-Animus-V13.0_PTQ

Text Generation • Updated Mar 18

TheHouseOfTheDude/Qwen3.5-27B_PTQ

Image-Text-to-Text • Updated Mar 19

TheHouseOfTheDude/gemma-4-31B_PTQ

Image-Text-to-Text • Updated Apr 3

groxaxo/gemma4-31b-abliterated-multimodal-awq8

Image-Text-to-Text • 33B • Updated Aug 22 • 53 • 4

TheHouseOfTheDude/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled_PTQ

Image-Text-to-Text • Updated Apr 13

TheHouseOfTheDude/Qwen3.6-35B-A3B_INT8

Image-Text-to-Text • Updated Apr 16

TheHouseOfTheDude/Qwen3.6-27B-INT8

Image-Text-to-Text • 28B • Updated Jun 1 • 348 • 10

QuaduxIT/Qwen3-Embedding-8B-W8A16

Feature Extraction • 8B • Updated May 1 • 433

QuaduxIT/Qwen3-Embedding-4B-W8A16

Feature Extraction • 4B • Updated May 1 • 946

QuaduxIT/Qwen3-VL-Embedding-8B-W8A16

Feature Extraction • 4B • Updated May 1 • 1.61k

sona-forge/sd15-controlnet-canny-qnn-8gen3

Text-to-Image • Updated May 4