GGUF models by Felladrin

267 GGUF models quantized by Felladrin on Hugging Face. Sizes run from 23M to 229B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LA
gguf sharded LaMini Flan T5 783M
Lamini · Felladrin
Params783M
Context512
Q4_K_M0.6 GB
GGUF
LL
Apriel 5B Instruct Llamafied
Llama · Felladrin
Params4.83B
Context16K
Smallest2.9 GB
GGUF
SM
SmolLM2-135M-Heretic-RP
SmolLM · Felladrin
Params135M
Context8K
Smallest0.1 GB
GGUF
FA
gguf sharded falcon mamba 7b instruct
Falcon · Felladrin
Params7.27B
Context1024K
Smallest3.2 GB
GGUF
SM
gguf sharded Q4 K S SmolLM2 135M Instruct
SmolLM · Felladrin
Params135M
Context8K
Smallest0.1 GB
GGUF
GE
Gemma 2 2b It
Gemma · Felladrin
Params2.61B
Context8K
Smallest2.4 GB
GGUF
NE
gguf Q5 K M Nemotron Mini 4B Instruct
Nemotron · Felladrin
Params4.19B
Context4K
Smallest6.1 GB
Tool use
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · Felladrin
Params1.54B
Context32K
Smallest1.6 GB
CodingTool use
QW
Qwen2 0.5B Instruct
Qwen · Felladrin
Params494M
Context32K
Smallest0.4 GB
GGUF
OL
gguf sharded OLMo 7B Instruct
OLMo · Felladrin
Params6.89B
Context2K
Q4_K_M4.2 GB
GGUF
GE
gguf gemma 2b orpo
Gemma · Felladrin
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
TI
gguf TinySolar 248m 4k
Tinysolar · Felladrin
Params248M
Context32K
Q4_K_M0.2 GB
GGUF
MO
gguf MobileLLaMA 1.4B Chat
Mobilellama · Felladrin
Params1.36B
Context2K
Q4_K_M0.8 GB
GGUF
PI
gguf 1.5 Pints 16K v0.1
Pints · Felladrin
Params1.57B
Context16K
Smallest0.7 GB
GGUF
FA
Falcon H1 Tiny R 0.6B
Falcon · Felladrin
Params622M
Context256K
Smallest0.4 GB
Tool use
AI
gguf sharded Aira 2 355M
Aira · Felladrin
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
MI
MiniMax-M2.5
Minimax · Felladrin
Params229B
Context192K
Smallest76.8 GB
ReasoningTool use
GP
gguf gpt2 alpaca gpt4
Gpt · Felladrin
Params163M
Context1K
Smallest0.2 GB
GGUF
LL
LlamaCorn 1.1B Chat
Llama · Felladrin
Params1.1B
Context2K
Smallest0.8 GB
Tool use
PI
gguf 1.5 Pints 2K v0.1
Pints · Felladrin
Params1.57B
Context16K
Smallest0.7 GB
GGUF
MI
gguf Minueza 32M Base
Minueza · Felladrin
Params33M
Context2K
Smallest0.1 GB
GGUF
MU
gguf multi qa MiniLM L6 cos v1
Multi · Felladrin
Params23M
Context512
Q4_K_M0.0 GB
GGUF
MI
MiniCPM5 1B
MiniCPM · Felladrin
Params1.08B
Context128K
Smallest0.7 GB
ReasoningTool use
AI
gguf sharded Aira 2 124M DPO
Aira · Felladrin
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
SM
gguf Q8 0 SmolLM2 360M Instruct
SmolLM · Felladrin
Params362M
Context8K
Smallest0.4 GB
GGUF
AI
gguf sharded Aira 2 124M
Aira · Felladrin
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
SM
gguf Q5 K M SmolLM2 1.7B Instruct
SmolLM · Felladrin
Params1.71B
Context8K
Smallest1.2 GB
GGUF
LF
LFM2.5 1.2B Thinking
Lfm · Felladrin
Params1.17B
Context125K
Smallest0.7 GB
ReasoningTool use
GG
gguf pythia 3b deduped sft
Gguf · Felladrin
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
QW
gguf sharded Qwen2 1.5B Instruct
Qwen · Felladrin
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF

Keep browsing