GGUF models by Felladrin

267 GGUF models quantized by Felladrin on Hugging Face. Sizes run from 23M to 229B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM 360M
SmolLM · Felladrin
Params362M
Context2K
Smallest0.2 GB
GGUF
GG
gguf pythia 1.4b sft full
Gguf · Felladrin
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
SM
gguf SmolLM 135M Instruct
SmolLM · Felladrin
Params135M
Context2K
Smallest0.1 GB
GGUF
ZE
gguf zephyr 220m dpo full
Zephyr · Felladrin
Params218M
Context2K
Q4_K_M0.2 GB
GGUF
GP
gguf MXFP4 gpt oss 20b Derestricted
gpt-oss · Felladrin
Params20.9B
Context128K
Smallest12.1 GB
Tool use
QW
Qwen2.5 0.5B Instruct
Qwen · Felladrin
Params494M
Context32K
Smallest0.4 GB
Tool use
LL
gguf sharded Llama 160M Chat v1
Llama · Felladrin
Params162M
Context2K
Q4_K_M0.3 GB
GGUF
TI
gguf TinySolar 248m 4k code instruct
Tinysolar · Felladrin
Params248M
Context32K
Q4_K_M0.2 GB
Coding
PH
gguf Phi 3 mini 4k instruct
Phi · Felladrin
Params3.82B
Context4K
Q4_K_M2.7 GB
GGUF
MA
gguf mamba 130m hf
Mamba · Felladrin
Params129M
Context1024K
Q4_K_M0.1 GB
GGUF
LL
gguf smol llama 220M openhermes
Llama · Felladrin
Params218M
Context2K
Q4_K_M0.2 GB
Tool use
OL
OLMo 7B 0424 Instruct Hf
OLMo · Felladrin
Params6.89B
Context2K
Smallest5.3 GB
GGUF
FL
gguf flan t5 small
Flan · Felladrin
Params77M
Context512
Q4_K_M0.1 GB
GGUF
LL
gguf Llama 160M Chat v1
Llama · Felladrin
Params162M
Context2K
Smallest0.1 GB
GGUF
GG
gguf openhermes tinyllama sft qlora
Gguf · Felladrin
Params1.1B
Context2K
Q4_K_M0.7 GB
Tool use
OL
OLMo 7B 0424 Instruct Hf
OLMo · Felladrin
Params6.89B
Context2K
Smallest7.9 GB
GGUF
FA
gguf falcon mamba 7b instruct
Falcon · Felladrin
Params7.27B
Context1024K
Smallest2.8 GB
GGUF
MI
gguf MicroLlama
Microllama · Felladrin
Params305M
Context2K
Q4_K_M0.2 GB
GGUF
PH
gguf sharded Phi 3 mini 4k instruct
Phi · Felladrin
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
TI
gguf TinyMistral 248M Chat v2
Tinymistral · Felladrin
Params248M
Context2K
Q4_K_M0.2 GB
GGUF
MA
gguf MaxMini Instruct 248M
Maxmini · Felladrin
Params248M
Context512
Q4_K_M0.2 GB
GGUF
SM
gguf Q8 0 SmolLM2 135M Instruct
SmolLM · Felladrin
Params135M
Context8K
Smallest0.1 GB
GGUF
GG
gguf jina reranker v1 tiny en
Gguf · Felladrin
Params33M
Context8K
Q4_K_M0.0 GB
CodingEmbedding
TI
TinyDolphin 2.8.2 1.1b Laser
Tinydolphin · Felladrin
Params1.1B
Context4K
Smallest0.8 GB
CodingTool use
QW
gguf sharded Qwen1.5 0.5B Chat
Qwen · Felladrin
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
PY
gguf Pythia Chat Base 7B
Pythia · Felladrin
Params6.86B
Context2K
Q4_K_M4.4 GB
GGUF
MA
gguf Q5 K M MagpieLM 4B Chat v0.1
Magpielm · Felladrin
Params4.51B
Context128K
Smallest3.2 GB
GGUF
QW
gguf Qwen2 1.5B Instruct
Qwen · Felladrin
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LI
gguf Lite Oute 1 300M Instruct
Lite · Felladrin
Params300M
Context4K
Smallest0.2 GB
GGUF
DA
gguf h2o danube2 1.8b chat
Danube · Felladrin
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF

About Felladrin on Hugging Face

Felladrin has published 267 GGUF models that ggufmodels.com tracks, across families such as Qwen, Llama and OLMo. The most downloaded are SmolLM 360M, gguf pythia 1.4b sft full and gguf SmolLM 135M Instruct.

The quants Felladrin publishes most often are Q8_0 (122), Q5_K_M (107), Q6_K (98) and Q4_K_S (85). Their Q4_K_M files range from 0.0 to 129.4 GB. Parameter counts run from 23M to 229B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has Felladrin published?

267 models are listed here, mainly from the Qwen, Llama and OLMo families. The most downloaded is SmolLM 360M.

Which quants does Felladrin publish?

The most common are Q8_0 (122 models), Q5_K_M (107 models), Q6_K (98 models) and Q4_K_S (85 models).

Keep browsing