GGUF models by Felladrin
267 GGUF models quantized by Felladrin on Hugging Face. Sizes run from 23M to 229B parameters. The longest trained context is 1024K tokens.
FO
Fox 1 1.6B Instruct v0.1
Fox · Felladrin
Params1.67B
Context8K
Smallest1.2 GB
OL
gguf sharded zephyr 1b olmo sft qlora
OLMo · Felladrin
Params1.18B
Context2K
Q4_K_M0.7 GB
TI
gguf Q5 K M TinyJensen 1.1B Chat
Tinyjensen · Felladrin
Params1.1B
Context2K
Smallest0.8 GB
VI
gguf vicuna 68m
Vicuna · Felladrin
Params68M
Context2K
Q4_K_M0.0 GB
ST
stablelm-2-1_6b-chat
Stablelm · Felladrin
Params1.64B
Context4K
Smallest1.8 GB
QW
Qwen2.5 Coder 32B Instruct Abliterated
Qwen · Felladrin
Params32.8B
Context32K
Smallest18.6 GB
DA
gguf sharded h2o danube2 1.8b chat
Danube · Felladrin
Params1.83B
Context8K
Q4_K_M1.1 GB
TI
gguf TinyMistral 248M Chat v1
Tinymistral · Felladrin
Params248M
Context2K
Q4_K_M0.2 GB
AL
gguf Q8 0 all MiniLM L6 v2
All · Felladrin
Params23M
Context512
Smallest0.0 GB
QW
Qwen3.5 2B
Qwen · Felladrin
Params1.88B
Context256K
Smallest1.2 GB
AR
gguf q5 k l imat arcee lite
Arcee · Felladrin
Params1.78B
Context32K
Smallest1.4 GB
LF
LFM2.5 1.2B Instruct
Lfm · Felladrin
Params1.17B
Context125K
Smallest0.7 GB
OL
gguf openhermes 1b olmo sft qlora
OLMo · Felladrin
Params1.18B
Context2K
Q4_K_M0.7 GB
WA
gguf sharded wavecoder ultra 6.7b
Wavecoder · Felladrin
Params6.74B
Context16K
Smallest3.6 GB
QW
Qwen3-0.6B
Qwen · Felladrin
Params596M
Context40K
Smallest0.4 GB
YI
Yi-1.5-6B-Chat
Yi · Felladrin
Params6.06B
Context4K
Smallest3.2 GB
NA
NanoLM 1B Instruct v2
Nanolm · Felladrin
Params1.08B
Context4K
Smallest1.6 GB
QW
gguf f16 Qwen3.6 35B A3B AntiLoop
Qwen · Felladrin
Params35.5B
Context256K
Smallest71.1 GB
SU
gguf f16 Supra2 100M Instruct
Supra · Felladrin
Params101M
Context2K
Smallest0.2 GB
MI
MiniMax-M2.1
Minimax · Felladrin
Params229B
Context192K
Smallest76.8 GB
LF
Lfm2.5-230M
Lfm · Felladrin
Params230M
Context125K
Smallest0.2 GB
SM
gguf sharded Q4 K S SmolLM2 1.7B Instruct
SmolLM · Felladrin
Params1.71B
Context8K
Smallest1.0 GB
PY
gguf Pythia 31M Chat v1
Pythia · Felladrin
Params31M
Context2K
Q4_K_M0.0 GB
MI
gguf Mixnueza 6x32M MoE
Mixnueza · Felladrin
Params84M
Context2K
Smallest0.2 GB
GR
Granite 4.0 1b
Granite · Felladrin
Params1.63B
Context128K
Smallest1.0 GB
QW
QwenMix 3.7
Qwen · Felladrin
Params27.3B
Context256K
Smallest29.0 GB
LL
gguf Qwen2 0.5B Instruct llamafy
Llama · Felladrin
Params494M
Context4K
Q4_K_M0.4 GB
GG
gguf sharded pythia 3b deduped sft
Gguf · Felladrin
Params2.78B
Context2K
Q4_K_M1.8 GB
MI
gguf Minueza 32Mx2 Chat
Minueza · Felladrin
Params43M
Context2K
Smallest0.1 GB
SU
Supra2
Supra · Felladrin
Params101M
Context2K
Smallest0.2 GB