Inference Providers
Active filters: kv-cache
p1atdev/MOSS-Image-SFT-KV-Cache-LoRA
Text-to-Image
• Updated • 676
• 7
tfwnotops/Ternary-Bonsai-2-27B-ConstantKV
Text Generation
• 27B • Updated • 1.04k
• 10
Text Generation
• 27B • Updated • 1.16k
• 21
prithivMLmods/flint-MXFP4-MoE-40B-A2.5B-GGUF
Text Generation
• 40B • Updated • 1.83k
• 5
shisa-ai/Nanbeige4.3-33B-DMS-2x
fromthesky/PLDR-LLM-v51-104M
Text Generation
• 0.1B • Updated • 33
fromthesky/PLDR-LLM-v51-110M-1
Text Generation
• 0.1B • Updated • 24
fromthesky/PLDR-LLM-v51-110M-2
Text Generation
• 0.1B • Updated • 17
fromthesky/PLDR-LLM-v51-110M-3
Text Generation
• 0.1B • Updated • 107
fromthesky/PLDR-LLM-v51-110M-4
Text Generation
• 0.1B • Updated • 18
fromthesky/PLDR-LLM-v51-110M-5
Text Generation
• 0.1B • Updated • 21
fromthesky/PLDR-LLM-v51-DAG-110M
Text Generation
• 0.1B • Updated • 24
fromthesky/PLDR-LLM-v51G-106M-1
Text Generation
• 0.1B • Updated • 19
fromthesky/PLDR-LLM-v51G-106M-2
Text Generation
• 0.1B • Updated • 23
fromthesky/PLDR-LLM-v51G-106M-3
Text Generation
• 0.1B • Updated • 111
fromthesky/PLDR-LLM-v51G-106M-test
Text Generation
• 0.1B • Updated • 16
fromthesky/PLDR-LLM-v52-81M-FT-SC-1
Text Classification
• 81M • Updated • 20
fromthesky/PLDR-LLM-v52-81M-FT-QA-1
Question Answering
• 81M • Updated • 39
fromthesky/PLDR-LLM-v52-81M-FT-TC-1
Token Classification
• 81M • Updated • 13
fromthesky/PLDR-LLM-v52-110M-1
Text Generation
• 0.1B • Updated • 22
nm-testing/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Qwen3-32B-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Qwen3-32B-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Llama-3.3-70B-Instruct-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Llama-3.3-70B-Instruct-QKV-Cache-FP8-Per-Head
Updated