GGUF models by mudler
92 GGUF models quantized by mudler on Hugging Face. Sizes run from 30M to 397B parameters. The longest trained context is 1024K tokens.
MI
timestral cpp
Mistral · mudler
Params123M
Context32K
Smallest0.0 GB
RF
rfdetr cpp nano
Rfdetr · mudler
Params30M
Context—
Smallest0.0 GB
RF
rfdetr cpp seg nano
Rfdetr · mudler
Params33M
Context—
Smallest0.0 GB
RF
rfdetr cpp small
Rfdetr · mudler
Params31M
Context—
Smallest0.0 GB
RF
rfdetr cpp seg xlarge
Rfdetr · mudler
Params37M
Context—
Smallest0.0 GB
RF
rfdetr cpp seg 2xlarge
Rfdetr · mudler
Params38M
Context—
Smallest0.0 GB
RF
rfdetr cpp seg large
Rfdetr · mudler
Params35M
Context—
Smallest0.0 GB
QW
Qwen AgentWorld 35B A3B APEX
Qwen · mudler
Params34.7B
Context256K
Smallest13.5 GB
RF
rfdetr cpp seg small
Rfdetr · mudler
Params34M
Context—
Smallest0.0 GB
RF
rfdetr cpp medium
Rfdetr · mudler
Params33M
Context—
Smallest0.0 GB
RF
rfdetr cpp seg medium
Rfdetr · mudler
Params35M
Context—
Smallest0.0 GB
QW
Qwen3.6 35B A3B NVFP4
Qwen · mudler
Params35.5B
Context256K
Smallest23.9 GB
RF
rfdetr cpp large
Rfdetr · mudler
Params33M
Context—
Smallest0.0 GB
RF
rfdetr cpp base
Rfdetr · mudler
Params31M
Context—
Smallest0.0 GB
LL
Llama3.1 8B Fireplace2
Llama · mudler
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
Nemotron 3 Diarization
Nemotron · mudler
Params99M
Context—
Smallest0.1 GB
MI
Minerva 3B Instruct v1.0 Q4 K M
Minerva · mudler
Params2.89B
Context16K
Q4_K_M1.8 GB
QW
Qwen3.6 27B NVFP4
Qwen · mudler
Params27.3B
Context256K
Smallest25.5 GB
LL
Llama-3-8b-ita-ties2
Llama · mudler
Params8.03B
Context8K
Q4_K_M4.9 GB
PR
prem-1B-chat
Prem · mudler
Params1.1B
Context8K
Smallest0.8 GB
MI
Minerva 1B base v1.0 Q5 K M
Minerva · mudler
Params1.01B
Context16K
Smallest0.7 GB
PR
prem-1B-chat
Prem · mudler
Params1.1B
Context8K
Smallest0.9 GB
MI
Minerva 1B base v1.0 Q4 0
Minerva · mudler
Params1.01B
Context16K
Smallest0.6 GB
LL
Aura-Llama-Abliterated
Llama · mudler
Params10.6B
Context8K
Q4_K_M6.5 GB
MI
Minerva 350M base v1.0 Q5 0
Minerva · mudler
Params352M
Context16K
Smallest0.3 GB
PH
Phi 3 medium 4k instruct Q4 K M
Phi · mudler
Params14B
Context4K
Q4_K_M8.6 GB
MI
Minerva 3B Instruct v1.0 Q6 K
Minerva · mudler
Params2.89B
Context16K
Smallest2.4 GB
MI
Minerva 350M base v1.0 Q4 0
Minerva · mudler
Params352M
Context16K
Smallest0.2 GB
MI
Minerva 3B Instruct v1.0 Q4 0
Minerva · mudler
Params2.89B
Context16K
Smallest1.7 GB
MI
Minerva 350M base v1.0 Q8 0
Minerva · mudler
Params352M
Context16K
Smallest0.4 GB