GGUF models by Felladrin

267 GGUF models quantized by Felladrin on Hugging Face. Sizes run from 23M to 229B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
PR
gguf sharded prem 1B chat
Prem · Felladrin
Params1.1B
Context8K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · Felladrin
Params1.1B
Context2K
Smallest0.8 GB
Coding
GR
Granite 4.0 350m
Granite · Felladrin
Params352M
Context32K
Smallest0.2 GB
Tool use
TI
TinyLlama-1.1B-Chat-v1.0
Tinyllama · Felladrin
Params1.1B
Context2K
Smallest1.2 GB
Coding
MI
MiniMA 2 1B
Minima · Felladrin
Params1.37B
Context4K
Smallest0.9 GB
GGUF
GR
Granite 4.0 H 1b
Granite · Felladrin
Params1.46B
Context1024K
Smallest0.9 GB
Tool use
TI
gguf sharded TinySolar 248m 4k code instruct
Tinysolar · Felladrin
Params248M
Context32K
Q4_K_M0.2 GB
Coding
NA
NanoLM 70M Instruct v1
Nanolm · Felladrin
Params71M
Context2K
Smallest0.1 GB
GGUF
IN
InternLM2
InternLM · Felladrin
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
QW
Qwen3 4B Merge Variant 01
Qwen · Felladrin
Params4.02B
Context40K
Smallest2.9 GB
ReasoningTool use
QW
Qwen2.5 0.5B Instruct
Qwen · Felladrin
Params494M
Context32K
Smallest0.5 GB
Tool use
CA
candle quantized LaMini Flan T5 248M
Candle · Felladrin
Params248M
Context—
Smallest0.1 GB
GGUF
SM
SmolLM 135M
SmolLM · Felladrin
Params135M
Context2K
Smallest0.1 GB
Tool use
OL
Olmo-2-0425-1B-Instruct
OLMo · Felladrin
Params1.48B
Context4K
Smallest1.0 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct
Qwen · Felladrin
Params32.8B
Context32K
Smallest18.6 GB
CodingTool use
LL
Llama 3.1 SuperNova Lite
Llama · Felladrin
Params8.03B
Context128K
Smallest3.7 GB
GGUF
QW
Qwen3.5 0.8B
Qwen · Felladrin
Params752M
Context256K
Smallest0.5 GB
ReasoningTool use
AI
gguf Aira 2 124M DPO
Aira · Felladrin
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
MA
Madlad400 3b Mt
Madlad · Felladrin
Params2.94B
Context512
Smallest2.1 GB
GGUF
LL
Cogito v1 Preview Llama 3B
Llama · Felladrin
Params3.61B
Context128K
Smallest2.1 GB
ReasoningTool use
MI
MiniCPM4 0.5B QAT Int4 Unquantized
MiniCPM · Felladrin
Params434M
Context32K
Smallest0.3 GB
GGUF
IN
internlm2_5-1_8b-chat
InternLM · Felladrin
Params1.89B
Context32K
Smallest1.4 GB
GGUF
TI
gguf TinyMistral 248M v2.5 Instruct orpo
Tinymistral · Felladrin
Params248M
Context32K
Q4_K_M0.2 GB
GGUF
OL
gguf sharded openhermes 1b olmo sft qlora
OLMo · Felladrin
Params1.18B
Context2K
Q4_K_M0.7 GB
Tool use
MA
Madlad400 3b Mt
Madlad · Felladrin
Params2.94B
Context512
Smallest3.1 GB
GGUF
OL
gguf Q5 K M OLMo 1B SFT hf
OLMo · Felladrin
Params1.18B
Context2K
Smallest0.8 GB
GGUF
AR
AFM 4.5B
Arcee · Felladrin
Params4.62B
Context64K
Smallest2.7 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · Felladrin
Params1.78B
Context128K
Smallest1.1 GB
ReasoningTool use
OL
AMD OLMo 1B SFT DPO
OLMo · Felladrin
Params1.18B
Context2K
Smallest0.9 GB
GGUF
GG
gguf sharded spin gpt2 medium alpaca e2
Gguf · Felladrin
Params406M
Context1K
Q4_K_M0.3 GB
GGUF

Keep browsing