Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

396

Base only

Active filters: quark

amd/Qwen3.8-27B-Quark-AWQ-MXFP4

Image-Text-to-Text • 16B • Updated Aug 26 • 45.5k • 34

ukisai/Swift-1.5-Qwen3.8-27b-Quark-FP8-dynamic-AMD

Image-Text-to-Text • 28B • Updated 16 days ago • 568 • 4

amd/Step-3.5-Flash-MXFP4

Text Generation • 102B • Updated Apr 28 • 61 • 2

nameistoken/Qwen3.6-35B-A3B-Quark-W8A8-INT8

Image-Text-to-Text • 35B • Updated May 13 • 318 • 7

amd/Qwen3.8-2.4T-A95B-Quark-MXFP4

Text Generation • 1.2T • Updated Aug 14 • 25.3k • 6

amd/Qwen3.8-27B-Quark-AWQ-INT4-W4A16

Image-Text-to-Text • 6B • Updated Aug 28 • 44.7k • 22

amd/Qwen3.8-Flash-Next-Quark-MXFP4

Image-Text-to-Text • 119B • Updated Sep 3 • 11.7k • 4

amd/GLM-5.3-Quark-MXFP4-AttnFP8

Text Generation • 384B • Updated Sep 2 • 14k • 4

magiccodingman/Qwen3.8-Flash-Next-Quark-MXFP4-fp8

Image-Text-to-Text • 119B • Updated 27 days ago • 186 • 4

amd/granite-4.1-8b_rai_1.8.0_medusa_1.0_npu

Text Generation • Updated 10 days ago • 4 • 1

EliovpAI/clef-MXFP4

Image-Text-to-Text • 15B • Updated 8 days ago • 79 • 1

AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-MXFP4-MXFP6-ROCm

Text Generation • 18B • Updated 5 days ago • 10 • 1

kitaniai/GLM-5.3-UNCENSORED-MXFP4

Text Generation • 385B • Updated 3 days ago • 325 • 1

fxmarty/llama-tiny-testing-quark-indev

1.03M • Updated Oct 3, 2024 • 9

fxmarty/llama-tiny-int4-per-group-sym

1.03M • Updated Oct 25, 2024 • 20

fxmarty/llama-tiny-w-fp8-a-fp8

1.03M • Updated Oct 22, 2024 • 13

fxmarty/llama-tiny-w-fp8-a-fp8-o-fp8

1.03M • Updated Oct 22, 2024 • 16

fxmarty/llama-tiny-w-int8-per-tensor

1.03M • Updated Oct 22, 2024 • 22

fxmarty/llama-small-int4-per-group-sym-awq

16.7M • Updated Oct 29, 2024 • 7

fxmarty/quark-legacy-int8

1.03M • Updated Oct 10, 2024 • 7

fxmarty/llama-tiny-w-int8-b-int8-per-tensor

1.03M • Updated Oct 22, 2024 • 11

fxmarty/llama-small-int4-per-group-sym-awq-old

16.7M • Updated Oct 25, 2024 • 5

amd-quark/llama-tiny-w-int8-per-tensor

1.03M • Updated Dec 18, 2024 • 25

amd-quark/llama-tiny-w-int8-b-int8-per-tensor

1.03M • Updated Dec 18, 2024 • 17

amd-quark/llama-tiny-w-fp8-a-fp8

1.03M • Updated Dec 18, 2024 • 23

amd-quark/llama-tiny-w-fp8-a-fp8-o-fp8

1.03M • Updated Dec 18, 2024 • 25

amd-quark/llama-tiny-int4-per-group-sym

1.03M • Updated Dec 18, 2024 • 23

amd-quark/llama-small-int4-per-group-sym-awq

16.7M • Updated Dec 18, 2024 • 27

amd-quark/quark-legacy-int8

1.03M • Updated Dec 18, 2024 • 15

amd/Llama-3.1-8B-Instruct-FP8-KV-Quark-test

8B • Updated Jun 18 • 546