GGUF models by Felladrin

267 GGUF models quantized by Felladrin on Hugging Face. Sizes run from 23M to 229B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 2b It
Gemma · Felladrin
Params2.61B
Context8K
Smallest1.6 GB
GGUF
PH
gguf sharded Phi 3 mini 4k instruct iMat
Phi · Felladrin
Params3.82B
Context4K
Smallest2.8 GB
GGUF
GG
gguf spin gpt2 medium alpaca e2
Gguf · Felladrin
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
MI
gguf Minueza 32M Chat
Minueza · Felladrin
Params33M
Context2K
Smallest0.1 GB
GGUF
ST
stablelm-2-zephyr-1_6b
Stablelm · Felladrin
Params1.64B
Context4K
Smallest1.0 GB
GGUF
LF
Lfm2-700M
Lfm · Felladrin
Params742M
Context32K
Smallest0.4 GB
GGUF
EX
EXAONE 3.5 2.4B Instruct
Exaone · Felladrin
Params2.67B
Context32K
Smallest1.6 GB
GGUF
TI
gguf sharded TinyMistral 248M v2.5 Instruct orpo
Tinymistral · Felladrin
Params248M
Context32K
Q4_K_M0.2 GB
GGUF
DA
H2O Danube3 500m Chat
Danube · Felladrin
Params514M
Context8K
Smallest0.5 GB
GGUF
DA
H2O Danube3.1 4b Chat
Danube · Felladrin
Params3.96B
Context8K
Smallest2.3 GB
GGUF
TA
gguf sharded Q4 K S TAID LLM 1.5B
Taid · Felladrin
Params1.54B
Context32K
Smallest0.9 GB
GGUF
FL
Flan T5 Small
Flan · Felladrin
Params77M
Context512
Smallest0.1 GB
GGUF
GR
Granite 3.3 2b Instruct
Granite · Felladrin
Params2.53B
Context128K
Smallest1.5 GB
ReasoningTool use
GE
Gemma 3n E2B It
Gemma · Felladrin
Params4.46B
Context32K
Smallest2.7 GB
GGUF
MI
gguf sharded Q4 K S MiniCPM4 0.5B QAT
MiniCPM · Felladrin
Params434M
Context32K
Smallest0.3 GB
GGUF
MI
MiniMax-M2.5
Minimax · Felladrin
Params229B
Context192K
Q4_K_M129.4 GB
ReasoningTool use
TI
gguf sharded TinyLlama 1.1B 1T OpenOrca
Tinyllama · Felladrin
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · Felladrin
Params1.24B
Context128K
Smallest0.8 GB
Tool use
QW
Replete LLM V2.5 Qwen 0.5b
Qwen · Felladrin
Params630M
Context32K
Smallest0.6 GB
Tool use
YO
Youtu LLM 2B
Youtu · Felladrin
Params1.96B
Context128K
Smallest1.2 GB
ReasoningTool use
SH
gguf Sheared Pythia 160m Platypus
Sheared · Felladrin
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
ST
stablelm-2-1_6b-chat
Stablelm · Felladrin
Params1.64B
Context4K
Smallest1.8 GB
GGUF
PH
Phi-4-Mini-Reasoning
Phi · Felladrin
Params3.84B
Context128K
Smallest2.5 GB
ReasoningTool use
LL
gguf sharded Qwen1.5 0.5B Chat llamafy
Llama · Felladrin
Params620M
Context4K
Q4_K_M0.4 GB
GGUF
GR
Granite 3.1 2b Instruct
Granite · Felladrin
Params2.53B
Context128K
Smallest1.5 GB
Tool use
ME
Megrez 3B Instruct
Megrez · Felladrin
Params2.92B
Context32K
Smallest1.7 GB
GGUF
SM
SmolLM3 3B
SmolLM · Felladrin
Params3.08B
Context64K
Smallest1.8 GB
ReasoningTool use
SM
SmolLM2 360M Instruct
SmolLM · Felladrin
Params362M
Context8K
Smallest0.2 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · Felladrin
Params3.21B
Context128K
Smallest1.9 GB
Tool use
NV
AceInstruct 1.5B
Nvidia · Felladrin
Params1.78B
Context128K
Smallest1.1 GB
GGUF

Keep browsing