GGUF models by Felladrin
267 GGUF models quantized by Felladrin on Hugging Face. Sizes run from 23M to 229B parameters. The longest trained context is 1024K tokens.
PR
gguf sharded prem 1B chat
Prem · Felladrin
Params1.1B
Context8K
Q4_K_M0.7 GB
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · Felladrin
Params1.1B
Context2K
Smallest0.8 GB
GR
Granite 4.0 350m
Granite · Felladrin
Params352M
Context32K
Smallest0.2 GB
TI
TinyLlama-1.1B-Chat-v1.0
Tinyllama · Felladrin
Params1.1B
Context2K
Smallest1.2 GB
MI
MiniMA 2 1B
Minima · Felladrin
Params1.37B
Context4K
Smallest0.9 GB
GR
Granite 4.0 H 1b
Granite · Felladrin
Params1.46B
Context1024K
Smallest0.9 GB
TI
gguf sharded TinySolar 248m 4k code instruct
Tinysolar · Felladrin
Params248M
Context32K
Q4_K_M0.2 GB
NA
NanoLM 70M Instruct v1
Nanolm · Felladrin
Params71M
Context2K
Smallest0.1 GB
IN
InternLM2
InternLM · Felladrin
Params1.89B
Context32K
Q4_K_M1.2 GB
QW
Qwen3 4B Merge Variant 01
Qwen · Felladrin
Params4.02B
Context40K
Smallest2.9 GB
QW
Qwen2.5 0.5B Instruct
Qwen · Felladrin
Params494M
Context32K
Smallest0.5 GB
CA
candle quantized LaMini Flan T5 248M
Candle · Felladrin
Params248M
Context—
Smallest0.1 GB
SM
SmolLM 135M
SmolLM · Felladrin
Params135M
Context2K
Smallest0.1 GB
OL
Olmo-2-0425-1B-Instruct
OLMo · Felladrin
Params1.48B
Context4K
Smallest1.0 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · Felladrin
Params32.8B
Context32K
Smallest18.6 GB
LL
Llama 3.1 SuperNova Lite
Llama · Felladrin
Params8.03B
Context128K
Smallest3.7 GB
QW
Qwen3.5 0.8B
Qwen · Felladrin
Params752M
Context256K
Smallest0.5 GB
AI
gguf Aira 2 124M DPO
Aira · Felladrin
Params163M
Context1K
Q4_K_M0.1 GB
MA
Madlad400 3b Mt
Madlad · Felladrin
Params2.94B
Context512
Smallest2.1 GB
LL
Cogito v1 Preview Llama 3B
Llama · Felladrin
Params3.61B
Context128K
Smallest2.1 GB
MI
MiniCPM4 0.5B QAT Int4 Unquantized
MiniCPM · Felladrin
Params434M
Context32K
Smallest0.3 GB
IN
internlm2_5-1_8b-chat
InternLM · Felladrin
Params1.89B
Context32K
Smallest1.4 GB
TI
gguf TinyMistral 248M v2.5 Instruct orpo
Tinymistral · Felladrin
Params248M
Context32K
Q4_K_M0.2 GB
OL
gguf sharded openhermes 1b olmo sft qlora
OLMo · Felladrin
Params1.18B
Context2K
Q4_K_M0.7 GB
MA
Madlad400 3b Mt
Madlad · Felladrin
Params2.94B
Context512
Smallest3.1 GB
OL
gguf Q5 K M OLMo 1B SFT hf
OLMo · Felladrin
Params1.18B
Context2K
Smallest0.8 GB
AR
AFM 4.5B
Arcee · Felladrin
Params4.62B
Context64K
Smallest2.7 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · Felladrin
Params1.78B
Context128K
Smallest1.1 GB
OL
AMD OLMo 1B SFT DPO
OLMo · Felladrin
Params1.18B
Context2K
Smallest0.9 GB
GG
gguf sharded spin gpt2 medium alpaca e2
Gguf · Felladrin
Params406M
Context1K
Q4_K_M0.3 GB