GGUF models by Felladrin

267 GGUF models quantized by Felladrin on Hugging Face. Sizes run from 23M to 229B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
FL
gguf flan alpaca base
Flan · Felladrin
Params248M
Context512
Q4_K_M0.2 GB
GGUF
PI
1.5 Pints 2K v0.1
Pints · Felladrin
Params1.57B
Context16K
Smallest3.1 GB
GGUF
ZE
gguf sharded zephyr 220m dpo full
Zephyr · Felladrin
Params218M
Context2K
Smallest0.2 GB
GGUF
SM
gguf sharded Q4 K S SmolLM2 360M Instruct
SmolLM · Felladrin
Params362M
Context8K
Smallest0.3 GB
GGUF
NE
gguf sharded Q4 K S Nemotron Mini 4B Instruct
Nemotron · Felladrin
Params4.19B
Context4K
Smallest2.6 GB
Tool use
PI
1.5 Pints 16K v0.1
Pints · Felladrin
Params1.57B
Context16K
Smallest0.9 GB
GGUF
AI
gguf Aira 2 355M
Aira · Felladrin
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
GG
gguf Q5 K M fastchat t5 3b v1.0
Gguf · Felladrin
Params2.85B
Context512
Smallest2.0 GB
GGUF
GE
Gemma 3 1b It
Gemma · Felladrin
Params1B
Context32K
Smallest0.8 GB
GGUF
IN
Internlm2_5 1_8b Chat
InternLM · Felladrin
Params1.89B
Context32K
Smallest1.1 GB
GGUF
LF
Lfm2-1.2B
Lfm · Felladrin
Params1.17B
Context32K
Smallest0.7 GB
GGUF
VI
gguf sharded vicuna 160m
Vicuna · Felladrin
Params162M
Context2K
Smallest0.2 GB
GGUF
OL
gguf sharded Q3 K M OLMoE 1B 7B 0125 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest3.3 GB
GGUF
LA
gguf Q8 0 LaMini Flan T5 248M
Lamini · Felladrin
Params248M
Context512
Smallest0.3 GB
GGUF
VI
gguf vicuna 160m
Vicuna · Felladrin
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
LF
Lfm2-350M
Lfm · Felladrin
Params354M
Context32K
Smallest0.2 GB
GGUF
FA
Falcon H1 0.5B Instruct
Falcon · Felladrin
Params521M
Context16K
Smallest0.3 GB
Tool use
NE
gguf Q5 K L Nemotron Mini 4B Instruct
Nemotron · Felladrin
Params4.19B
Context4K
Smallest3.5 GB
Tool use
OL
OLMoE 1B 7B 0924 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest3.7 GB
GGUF
PO
Polaris 4B Preview
Polaris · Felladrin
Params4.02B
Context128K
Smallest2.4 GB
ReasoningTool use
MI
Mistral-7B-OpenOrca
Mistral · Felladrin
Params7.24B
Context32K
Smallest3.5 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest3.6 GB
GGUF
EX
gguf sharded Q5 K M EXAONE 3.5 2.4B Instruct
Exaone · Felladrin
Params2.67B
Context32K
Smallest1.9 GB
GGUF
GR
Granite 3.1 3b A800M Instruct
Granite · Felladrin
Params3.3B
Context128K
Smallest1.9 GB
Tool use
SM
SmallThinker 3B Preview
Smallthinker · Felladrin
Params3.4B
Context32K
Smallest2.0 GB
GGUF
QW
Qwen3-1.7B
Qwen · Felladrin
Params1.72B
Context40K
Smallest1.1 GB
ReasoningTool use
QW
Qwen2.5 0.5B Instruct
Qwen · Felladrin
Params494M
Context32K
Smallest0.4 GB
Tool use
QW
Replete LLM V2.5 Qwen 3b
Qwen · Felladrin
Params3.4B
Context32K
Smallest2.6 GB
Tool use
LL
Llama 3.2 3B Instruct
Llama · Felladrin
Params3.21B
Context128K
Smallest2.4 GB
Tool use
GR
MiniCPM3 4B
Granite · Felladrin
Params4.07B
Context32K
Smallest2.4 GB
Tool use

Keep browsing