GGUF models by Felladrin

267 GGUF models quantized by Felladrin on Hugging Face. Sizes run from 23M to 229B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LA
gguf sharded LaMini Flan T5 248M
Lamini · Felladrin
Params248M
Context512
Smallest0.3 GB
GGUF
LA
gguf LaMini Flan T5 77M
Lamini · Felladrin
Params77M
Context512
Q4_K_M0.1 GB
GGUF
LI
LittleLamb-293M-RP
Littlelamb · Felladrin
Params293M
Context40K
Smallest0.2 GB
GGUF
FL
gguf flan t5 base
Flan · Felladrin
Params248M
Context512
Q4_K_M0.2 GB
GGUF
LL
gguf Smol Llama 101M Chat v1
Llama · Felladrin
Params101M
Context1K
Smallest0.1 GB
GGUF
DA
H2O Danube3 500m Chat
Danube · Felladrin
Params514M
Context8K
Smallest0.2 GB
GGUF
LL
gguf llama 160m
Llama · Felladrin
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
QW
gguf sharded Qwen2 0.5B Instruct
Qwen · Felladrin
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
MI
Minueza-3-95M-Base
Minueza · Felladrin
Params95M
Context8K
Smallest0.1 GB
Coding
QW
gguf sharded Q4 K M Qwen3.5 0.8B MoE A0.6B
Qwen · Felladrin
Params755M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
LL
Sheared LLaMA 1.3B ShareGPT
Llama · Felladrin
Params1.35B
Context4K
Smallest1.0 GB
GGUF
WI
gguf sharded WizardVicuna pythia 410m deduped
Wizardvicuna · Felladrin
Params405M
Context2K
Q4_K_M0.7 GB
GGUF
GG
gguf sharded pythia 1.4b sft full
Gguf · Felladrin
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
PH
gguf Q5 K M Phi 1 5 Instruct v0.1
Phi · Felladrin
Params1.41B
Context2K
Smallest1.0 GB
Tool use
IP
gguf sharded IPythia 410m
Ipythia · Felladrin
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
LI
LittleLamb
Littlelamb · Felladrin
Params293M
Context40K
Smallest0.2 GB
ReasoningTool use
NU
gguf NuExtract tiny
Nuextract · Felladrin
Params464M
Context32K
Smallest0.3 GB
GGUF
QW
Qwen2 1.5B Instruct
Qwen · Felladrin
Params1.54B
Context32K
Smallest1.1 GB
GGUF
FL
gguf flan t5 base instruct dolly hhrlhf
Flan · Felladrin
Params248M
Context512
Q4_K_M0.2 GB
GGUF
TI
gguf sharded TinyMistral 248M Chat v2
Tinymistral · Felladrin
Params248M
Context2K
Q4_K_M0.4 GB
GGUF
SP
gguf sharded Q4 K M Spark X2.6 1.7B
Spark · Felladrin
Params1.98B
Context1024K
Q4_K_M1.8 GB
ReasoningTool use
QW
Qwen3.5-4B
Qwen · Felladrin
Params4.21B
Context256K
Smallest2.4 GB
ReasoningTool use
QW
Qwen3.5-0.8B
Qwen · Felladrin
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
MI
gguf Minueza 32M UltraChat
Minueza · Felladrin
Params33M
Context2K
Smallest0.1 GB
GGUF
PR
gguf prem 1B chat
Prem · Felladrin
Params1.1B
Context8K
Q4_K_M0.7 GB
GGUF
BA
T5 Base
Base · Felladrin
Params248M
Context512
Smallest0.2 GB
GGUF
AI
gguf Aira 2 124M
Aira · Felladrin
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
SP
gguf sharded Q4 K M Spark X2.6 4B
Spark · Felladrin
Params4.45B
Context1024K
Q4_K_M3.5 GB
ReasoningTool use
LA
gguf LaMini Flan T5 783M
Lamini · Felladrin
Params783M
Context512
Q4_K_M0.6 GB
GGUF
FA
gguf Q3 K XL falcon mamba 7b
Falcon · Felladrin
Params7.27B
Context1024K
Smallest3.5 GB
GGUF

Keep browsing