GGUF models by Felladrin
267 GGUF models quantized by Felladrin on Hugging Face. Sizes run from 23M to 229B parameters. The longest trained context is 1024K tokens.
LA
gguf sharded LaMini Flan T5 248M
Lamini · Felladrin
Params248M
Context512
Smallest0.3 GB
LA
gguf LaMini Flan T5 77M
Lamini · Felladrin
Params77M
Context512
Q4_K_M0.1 GB
LI
LittleLamb-293M-RP
Littlelamb · Felladrin
Params293M
Context40K
Smallest0.2 GB
FL
gguf flan t5 base
Flan · Felladrin
Params248M
Context512
Q4_K_M0.2 GB
LL
gguf Smol Llama 101M Chat v1
Llama · Felladrin
Params101M
Context1K
Smallest0.1 GB
DA
H2O Danube3 500m Chat
Danube · Felladrin
Params514M
Context8K
Smallest0.2 GB
LL
gguf llama 160m
Llama · Felladrin
Params162M
Context2K
Q4_K_M0.1 GB
QW
gguf sharded Qwen2 0.5B Instruct
Qwen · Felladrin
Params494M
Context32K
Q4_K_M0.4 GB
MI
Minueza-3-95M-Base
Minueza · Felladrin
Params95M
Context8K
Smallest0.1 GB
QW
gguf sharded Q4 K M Qwen3.5 0.8B MoE A0.6B
Qwen · Felladrin
Params755M
Context256K
Q4_K_M0.5 GB
LL
Sheared LLaMA 1.3B ShareGPT
Llama · Felladrin
Params1.35B
Context4K
Smallest1.0 GB
WI
gguf sharded WizardVicuna pythia 410m deduped
Wizardvicuna · Felladrin
Params405M
Context2K
Q4_K_M0.7 GB
GG
gguf sharded pythia 1.4b sft full
Gguf · Felladrin
Params1.41B
Context2K
Q4_K_M0.9 GB
PH
gguf Q5 K M Phi 1 5 Instruct v0.1
Phi · Felladrin
Params1.41B
Context2K
Smallest1.0 GB
IP
gguf sharded IPythia 410m
Ipythia · Felladrin
Params405M
Context2K
Q4_K_M0.3 GB
LI
LittleLamb
Littlelamb · Felladrin
Params293M
Context40K
Smallest0.2 GB
NU
gguf NuExtract tiny
Nuextract · Felladrin
Params464M
Context32K
Smallest0.3 GB
QW
Qwen2 1.5B Instruct
Qwen · Felladrin
Params1.54B
Context32K
Smallest1.1 GB
FL
gguf flan t5 base instruct dolly hhrlhf
Flan · Felladrin
Params248M
Context512
Q4_K_M0.2 GB
TI
gguf sharded TinyMistral 248M Chat v2
Tinymistral · Felladrin
Params248M
Context2K
Q4_K_M0.4 GB
SP
gguf sharded Q4 K M Spark X2.6 1.7B
Spark · Felladrin
Params1.98B
Context1024K
Q4_K_M1.8 GB
QW
Qwen3.5-4B
Qwen · Felladrin
Params4.21B
Context256K
Smallest2.4 GB
QW
Qwen3.5-0.8B
Qwen · Felladrin
Params752M
Context256K
Q4_K_M0.5 GB
MI
gguf Minueza 32M UltraChat
Minueza · Felladrin
Params33M
Context2K
Smallest0.1 GB
PR
gguf prem 1B chat
Prem · Felladrin
Params1.1B
Context8K
Q4_K_M0.7 GB
BA
T5 Base
Base · Felladrin
Params248M
Context512
Smallest0.2 GB
AI
gguf Aira 2 124M
Aira · Felladrin
Params163M
Context1K
Q4_K_M0.1 GB
SP
gguf sharded Q4 K M Spark X2.6 4B
Spark · Felladrin
Params4.45B
Context1024K
Q4_K_M3.5 GB
LA
gguf LaMini Flan T5 783M
Lamini · Felladrin
Params783M
Context512
Q4_K_M0.6 GB
FA
gguf Q3 K XL falcon mamba 7b
Falcon · Felladrin
Params7.27B
Context1024K
Smallest3.5 GB