GGUF models by Felladrin
267 GGUF models quantized by Felladrin on Hugging Face. Sizes run from 23M to 229B parameters. The longest trained context is 1024K tokens.
GE
Gemma 2 2b It
Gemma · Felladrin
Params2.61B
Context8K
Smallest1.6 GB
PH
gguf sharded Phi 3 mini 4k instruct iMat
Phi · Felladrin
Params3.82B
Context4K
Smallest2.8 GB
GG
gguf spin gpt2 medium alpaca e2
Gguf · Felladrin
Params406M
Context1K
Q4_K_M0.3 GB
MI
gguf Minueza 32M Chat
Minueza · Felladrin
Params33M
Context2K
Smallest0.1 GB
ST
stablelm-2-zephyr-1_6b
Stablelm · Felladrin
Params1.64B
Context4K
Smallest1.0 GB
LF
Lfm2-700M
Lfm · Felladrin
Params742M
Context32K
Smallest0.4 GB
EX
EXAONE 3.5 2.4B Instruct
Exaone · Felladrin
Params2.67B
Context32K
Smallest1.6 GB
TI
gguf sharded TinyMistral 248M v2.5 Instruct orpo
Tinymistral · Felladrin
Params248M
Context32K
Q4_K_M0.2 GB
DA
H2O Danube3 500m Chat
Danube · Felladrin
Params514M
Context8K
Smallest0.5 GB
DA
H2O Danube3.1 4b Chat
Danube · Felladrin
Params3.96B
Context8K
Smallest2.3 GB
TA
gguf sharded Q4 K S TAID LLM 1.5B
Taid · Felladrin
Params1.54B
Context32K
Smallest0.9 GB
FL
Flan T5 Small
Flan · Felladrin
Params77M
Context512
Smallest0.1 GB
GR
Granite 3.3 2b Instruct
Granite · Felladrin
Params2.53B
Context128K
Smallest1.5 GB
GE
Gemma 3n E2B It
Gemma · Felladrin
Params4.46B
Context32K
Smallest2.7 GB
MI
gguf sharded Q4 K S MiniCPM4 0.5B QAT
MiniCPM · Felladrin
Params434M
Context32K
Smallest0.3 GB
MI
MiniMax-M2.5
Minimax · Felladrin
Params229B
Context192K
Q4_K_M129.4 GB
TI
gguf sharded TinyLlama 1.1B 1T OpenOrca
Tinyllama · Felladrin
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Llama 3.2 1B Instruct
Llama · Felladrin
Params1.24B
Context128K
Smallest0.8 GB
QW
Replete LLM V2.5 Qwen 0.5b
Qwen · Felladrin
Params630M
Context32K
Smallest0.6 GB
YO
Youtu LLM 2B
Youtu · Felladrin
Params1.96B
Context128K
Smallest1.2 GB
SH
gguf Sheared Pythia 160m Platypus
Sheared · Felladrin
Params162M
Context2K
Q4_K_M0.1 GB
ST
stablelm-2-1_6b-chat
Stablelm · Felladrin
Params1.64B
Context4K
Smallest1.8 GB
PH
Phi-4-Mini-Reasoning
Phi · Felladrin
Params3.84B
Context128K
Smallest2.5 GB
LL
gguf sharded Qwen1.5 0.5B Chat llamafy
Llama · Felladrin
Params620M
Context4K
Q4_K_M0.4 GB
GR
Granite 3.1 2b Instruct
Granite · Felladrin
Params2.53B
Context128K
Smallest1.5 GB
ME
Megrez 3B Instruct
Megrez · Felladrin
Params2.92B
Context32K
Smallest1.7 GB
SM
SmolLM3 3B
SmolLM · Felladrin
Params3.08B
Context64K
Smallest1.8 GB
SM
SmolLM2 360M Instruct
SmolLM · Felladrin
Params362M
Context8K
Smallest0.2 GB
LL
Llama 3.2 3B Instruct
Llama · Felladrin
Params3.21B
Context128K
Smallest1.9 GB
NV
AceInstruct 1.5B
Nvidia · Felladrin
Params1.78B
Context128K
Smallest1.1 GB