GGUF models by Felladrin

267 GGUF models quantized by Felladrin on Hugging Face. Sizes run from 23M to 229B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
FO
Fox 1 1.6B Instruct v0.1
Fox · Felladrin
Params1.67B
Context8K
Smallest1.2 GB
GGUF
OL
gguf sharded zephyr 1b olmo sft qlora
OLMo · Felladrin
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
TI
gguf Q5 K M TinyJensen 1.1B Chat
Tinyjensen · Felladrin
Params1.1B
Context2K
Smallest0.8 GB
GGUF
VI
gguf vicuna 68m
Vicuna · Felladrin
Params68M
Context2K
Q4_K_M0.0 GB
GGUF
ST
stablelm-2-1_6b-chat
Stablelm · Felladrin
Params1.64B
Context4K
Smallest1.8 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct Abliterated
Qwen · Felladrin
Params32.8B
Context32K
Smallest18.6 GB
CodingTool use
DA
gguf sharded h2o danube2 1.8b chat
Danube · Felladrin
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
TI
gguf TinyMistral 248M Chat v1
Tinymistral · Felladrin
Params248M
Context2K
Q4_K_M0.2 GB
GGUF
AL
gguf Q8 0 all MiniLM L6 v2
All · Felladrin
Params23M
Context512
Smallest0.0 GB
CodingEmbedding
QW
Qwen3.5 2B
Qwen · Felladrin
Params1.88B
Context256K
Smallest1.2 GB
ReasoningTool use
AR
gguf q5 k l imat arcee lite
Arcee · Felladrin
Params1.78B
Context32K
Smallest1.4 GB
GGUF
LF
LFM2.5 1.2B Instruct
Lfm · Felladrin
Params1.17B
Context125K
Smallest0.7 GB
Tool use
OL
gguf openhermes 1b olmo sft qlora
OLMo · Felladrin
Params1.18B
Context2K
Q4_K_M0.7 GB
Tool use
WA
gguf sharded wavecoder ultra 6.7b
Wavecoder · Felladrin
Params6.74B
Context16K
Smallest3.6 GB
Coding
QW
Qwen3-0.6B
Qwen · Felladrin
Params596M
Context40K
Smallest0.4 GB
ReasoningTool use
YI
Yi-1.5-6B-Chat
Yi · Felladrin
Params6.06B
Context4K
Smallest3.2 GB
GGUF
NA
NanoLM 1B Instruct v2
Nanolm · Felladrin
Params1.08B
Context4K
Smallest1.6 GB
GGUF
QW
gguf f16 Qwen3.6 35B A3B AntiLoop
Qwen · Felladrin
Params35.5B
Context256K
Smallest71.1 GB
ReasoningTool useVision
SU
gguf f16 Supra2 100M Instruct
Supra · Felladrin
Params101M
Context2K
Smallest0.2 GB
GGUF
MI
MiniMax-M2.1
Minimax · Felladrin
Params229B
Context192K
Smallest76.8 GB
ReasoningTool use
LF
Lfm2.5-230M
Lfm · Felladrin
Params230M
Context125K
Smallest0.2 GB
ReasoningTool use
SM
gguf sharded Q4 K S SmolLM2 1.7B Instruct
SmolLM · Felladrin
Params1.71B
Context8K
Smallest1.0 GB
GGUF
PY
gguf Pythia 31M Chat v1
Pythia · Felladrin
Params31M
Context2K
Q4_K_M0.0 GB
GGUF
MI
gguf Mixnueza 6x32M MoE
Mixnueza · Felladrin
Params84M
Context2K
Smallest0.2 GB
GGUF
GR
Granite 4.0 1b
Granite · Felladrin
Params1.63B
Context128K
Smallest1.0 GB
Tool use
QW
QwenMix 3.7
Qwen · Felladrin
Params27.3B
Context256K
Smallest29.0 GB
ReasoningTool use
LL
gguf Qwen2 0.5B Instruct llamafy
Llama · Felladrin
Params494M
Context4K
Q4_K_M0.4 GB
GGUF
GG
gguf sharded pythia 3b deduped sft
Gguf · Felladrin
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
MI
gguf Minueza 32Mx2 Chat
Minueza · Felladrin
Params43M
Context2K
Smallest0.1 GB
GGUF
SU
Supra2
Supra · Felladrin
Params101M
Context2K
Smallest0.2 GB
GGUF

Keep browsing