MoE models for local inference on two 5060ti 16gb cards + 64 gb ram workstation
-
unsloth/Qwen3.6-35B-A3B-GGUF
Image-Text-to-Text • 35B • Updated • 1.8M • 1.82k -
huihui-ai/Huihui-Qwen3.6-35B-A3B-abliterated-MTP-GGUF
Image-Text-to-Text • 36B • Updated • 5.16M • 125 -
ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-GGUF
Image-Text-to-Text • 177B • Updated • 7.44M • 1.32k -
openbmb/MiniCPM-V-4.7-35B-A3B-gguf
Image-Text-to-Text • 35B • Updated • 428k • 469