GGUF models by mudler

92 GGUF models quantized by mudler on Hugging Face. Sizes run from 30M to 397B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
timestral cpp
Mistral · mudler
Params123M
Context32K
Smallest0.0 GB
GGUF
RF
rfdetr cpp nano
Rfdetr · mudler
Params30M
Context—
Smallest0.0 GB
GGUF
RF
rfdetr cpp seg nano
Rfdetr · mudler
Params33M
Context—
Smallest0.0 GB
GGUF
RF
rfdetr cpp small
Rfdetr · mudler
Params31M
Context—
Smallest0.0 GB
GGUF
RF
rfdetr cpp seg xlarge
Rfdetr · mudler
Params37M
Context—
Smallest0.0 GB
GGUF
RF
rfdetr cpp seg 2xlarge
Rfdetr · mudler
Params38M
Context—
Smallest0.0 GB
GGUF
RF
rfdetr cpp seg large
Rfdetr · mudler
Params35M
Context—
Smallest0.0 GB
GGUF
QW
Qwen AgentWorld 35B A3B APEX
Qwen · mudler
Params34.7B
Context256K
Smallest13.5 GB
ReasoningTool use
RF
rfdetr cpp seg small
Rfdetr · mudler
Params34M
Context—
Smallest0.0 GB
GGUF
RF
rfdetr cpp medium
Rfdetr · mudler
Params33M
Context—
Smallest0.0 GB
GGUF
RF
rfdetr cpp seg medium
Rfdetr · mudler
Params35M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.6 35B A3B NVFP4
Qwen · mudler
Params35.5B
Context256K
Smallest23.9 GB
ReasoningTool use
RF
rfdetr cpp large
Rfdetr · mudler
Params33M
Context—
Smallest0.0 GB
GGUF
RF
rfdetr cpp base
Rfdetr · mudler
Params31M
Context—
Smallest0.0 GB
GGUF
LL
Llama3.1 8B Fireplace2
Llama · mudler
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
NE
Nemotron 3 Diarization
Nemotron · mudler
Params99M
Context—
Smallest0.1 GB
GGUF
MI
Minerva 3B Instruct v1.0 Q4 K M
Minerva · mudler
Params2.89B
Context16K
Q4_K_M1.8 GB
GGUF
QW
Qwen3.6 27B NVFP4
Qwen · mudler
Params27.3B
Context256K
Smallest25.5 GB
ReasoningTool use
LL
Llama-3-8b-ita-ties2
Llama · mudler
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PR
prem-1B-chat
Prem · mudler
Params1.1B
Context8K
Smallest0.8 GB
GGUF
MI
Minerva 1B base v1.0 Q5 K M
Minerva · mudler
Params1.01B
Context16K
Smallest0.7 GB
GGUF
PR
prem-1B-chat
Prem · mudler
Params1.1B
Context8K
Smallest0.9 GB
GGUF
MI
Minerva 1B base v1.0 Q4 0
Minerva · mudler
Params1.01B
Context16K
Smallest0.6 GB
GGUF
LL
Aura-Llama-Abliterated
Llama · mudler
Params10.6B
Context8K
Q4_K_M6.5 GB
GGUF
MI
Minerva 350M base v1.0 Q5 0
Minerva · mudler
Params352M
Context16K
Smallest0.3 GB
GGUF
PH
Phi 3 medium 4k instruct Q4 K M
Phi · mudler
Params14B
Context4K
Q4_K_M8.6 GB
Coding
MI
Minerva 3B Instruct v1.0 Q6 K
Minerva · mudler
Params2.89B
Context16K
Smallest2.4 GB
GGUF
MI
Minerva 350M base v1.0 Q4 0
Minerva · mudler
Params352M
Context16K
Smallest0.2 GB
GGUF
MI
Minerva 3B Instruct v1.0 Q4 0
Minerva · mudler
Params2.89B
Context16K
Smallest1.7 GB
GGUF
MI
Minerva 350M base v1.0 Q8 0
Minerva · mudler
Params352M
Context16K
Smallest0.4 GB
GGUF

Keep browsing