GGUF models by Felladrin
267 GGUF models quantized by Felladrin on Hugging Face. Sizes run from 23M to 229B parameters. The longest trained context is 1024K tokens.
FL
gguf flan alpaca base
Flan · Felladrin
Params248M
Context512
Q4_K_M0.2 GB
PI
1.5 Pints 2K v0.1
Pints · Felladrin
Params1.57B
Context16K
Smallest3.1 GB
ZE
gguf sharded zephyr 220m dpo full
Zephyr · Felladrin
Params218M
Context2K
Smallest0.2 GB
SM
gguf sharded Q4 K S SmolLM2 360M Instruct
SmolLM · Felladrin
Params362M
Context8K
Smallest0.3 GB
NE
gguf sharded Q4 K S Nemotron Mini 4B Instruct
Nemotron · Felladrin
Params4.19B
Context4K
Smallest2.6 GB
PI
1.5 Pints 16K v0.1
Pints · Felladrin
Params1.57B
Context16K
Smallest0.9 GB
AI
gguf Aira 2 355M
Aira · Felladrin
Params406M
Context1K
Q4_K_M0.3 GB
GG
gguf Q5 K M fastchat t5 3b v1.0
Gguf · Felladrin
Params2.85B
Context512
Smallest2.0 GB
GE
Gemma 3 1b It
Gemma · Felladrin
Params1B
Context32K
Smallest0.8 GB
IN
Internlm2_5 1_8b Chat
InternLM · Felladrin
Params1.89B
Context32K
Smallest1.1 GB
LF
Lfm2-1.2B
Lfm · Felladrin
Params1.17B
Context32K
Smallest0.7 GB
VI
gguf sharded vicuna 160m
Vicuna · Felladrin
Params162M
Context2K
Smallest0.2 GB
OL
gguf sharded Q3 K M OLMoE 1B 7B 0125 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest3.3 GB
LA
gguf Q8 0 LaMini Flan T5 248M
Lamini · Felladrin
Params248M
Context512
Smallest0.3 GB
VI
gguf vicuna 160m
Vicuna · Felladrin
Params162M
Context2K
Q4_K_M0.1 GB
LF
Lfm2-350M
Lfm · Felladrin
Params354M
Context32K
Smallest0.2 GB
FA
Falcon H1 0.5B Instruct
Falcon · Felladrin
Params521M
Context16K
Smallest0.3 GB
NE
gguf Q5 K L Nemotron Mini 4B Instruct
Nemotron · Felladrin
Params4.19B
Context4K
Smallest3.5 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest3.7 GB
PO
Polaris 4B Preview
Polaris · Felladrin
Params4.02B
Context128K
Smallest2.4 GB
MI
Mistral-7B-OpenOrca
Mistral · Felladrin
Params7.24B
Context32K
Smallest3.5 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest3.6 GB
EX
gguf sharded Q5 K M EXAONE 3.5 2.4B Instruct
Exaone · Felladrin
Params2.67B
Context32K
Smallest1.9 GB
GR
Granite 3.1 3b A800M Instruct
Granite · Felladrin
Params3.3B
Context128K
Smallest1.9 GB
SM
SmallThinker 3B Preview
Smallthinker · Felladrin
Params3.4B
Context32K
Smallest2.0 GB
QW
Qwen3-1.7B
Qwen · Felladrin
Params1.72B
Context40K
Smallest1.1 GB
QW
Qwen2.5 0.5B Instruct
Qwen · Felladrin
Params494M
Context32K
Smallest0.4 GB
QW
Replete LLM V2.5 Qwen 3b
Qwen · Felladrin
Params3.4B
Context32K
Smallest2.6 GB
LL
Llama 3.2 3B Instruct
Llama · Felladrin
Params3.21B
Context128K
Smallest2.4 GB
GR
MiniCPM3 4B
Granite · Felladrin
Params4.07B
Context32K
Smallest2.4 GB