GGUF models by Felladrin
267 GGUF models quantized by Felladrin on Hugging Face. Sizes run from 23M to 229B parameters. The longest trained context is 1024K tokens.
LA
gguf sharded LaMini Flan T5 783M
Lamini · Felladrin
Params783M
Context512
Q4_K_M0.6 GB
LL
Apriel 5B Instruct Llamafied
Llama · Felladrin
Params4.83B
Context16K
Smallest2.9 GB
SM
SmolLM2-135M-Heretic-RP
SmolLM · Felladrin
Params135M
Context8K
Smallest0.1 GB
FA
gguf sharded falcon mamba 7b instruct
Falcon · Felladrin
Params7.27B
Context1024K
Smallest3.2 GB
SM
gguf sharded Q4 K S SmolLM2 135M Instruct
SmolLM · Felladrin
Params135M
Context8K
Smallest0.1 GB
GE
Gemma 2 2b It
Gemma · Felladrin
Params2.61B
Context8K
Smallest2.4 GB
NE
gguf Q5 K M Nemotron Mini 4B Instruct
Nemotron · Felladrin
Params4.19B
Context4K
Smallest6.1 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · Felladrin
Params1.54B
Context32K
Smallest1.6 GB
QW
Qwen2 0.5B Instruct
Qwen · Felladrin
Params494M
Context32K
Smallest0.4 GB
OL
gguf sharded OLMo 7B Instruct
OLMo · Felladrin
Params6.89B
Context2K
Q4_K_M4.2 GB
GE
gguf gemma 2b orpo
Gemma · Felladrin
Params2.51B
Context8K
Q4_K_M1.6 GB
TI
gguf TinySolar 248m 4k
Tinysolar · Felladrin
Params248M
Context32K
Q4_K_M0.2 GB
MO
gguf MobileLLaMA 1.4B Chat
Mobilellama · Felladrin
Params1.36B
Context2K
Q4_K_M0.8 GB
PI
gguf 1.5 Pints 16K v0.1
Pints · Felladrin
Params1.57B
Context16K
Smallest0.7 GB
FA
Falcon H1 Tiny R 0.6B
Falcon · Felladrin
Params622M
Context256K
Smallest0.4 GB
AI
gguf sharded Aira 2 355M
Aira · Felladrin
Params406M
Context1K
Q4_K_M0.3 GB
MI
MiniMax-M2.5
Minimax · Felladrin
Params229B
Context192K
Smallest76.8 GB
GP
gguf gpt2 alpaca gpt4
Gpt · Felladrin
Params163M
Context1K
Smallest0.2 GB
LL
LlamaCorn 1.1B Chat
Llama · Felladrin
Params1.1B
Context2K
Smallest0.8 GB
PI
gguf 1.5 Pints 2K v0.1
Pints · Felladrin
Params1.57B
Context16K
Smallest0.7 GB
MI
gguf Minueza 32M Base
Minueza · Felladrin
Params33M
Context2K
Smallest0.1 GB
MU
gguf multi qa MiniLM L6 cos v1
Multi · Felladrin
Params23M
Context512
Q4_K_M0.0 GB
MI
MiniCPM5 1B
MiniCPM · Felladrin
Params1.08B
Context128K
Smallest0.7 GB
AI
gguf sharded Aira 2 124M DPO
Aira · Felladrin
Params163M
Context1K
Q4_K_M0.1 GB
SM
gguf Q8 0 SmolLM2 360M Instruct
SmolLM · Felladrin
Params362M
Context8K
Smallest0.4 GB
AI
gguf sharded Aira 2 124M
Aira · Felladrin
Params163M
Context1K
Q4_K_M0.1 GB
SM
gguf Q5 K M SmolLM2 1.7B Instruct
SmolLM · Felladrin
Params1.71B
Context8K
Smallest1.2 GB
LF
LFM2.5 1.2B Thinking
Lfm · Felladrin
Params1.17B
Context125K
Smallest0.7 GB
GG
gguf pythia 3b deduped sft
Gguf · Felladrin
Params2.78B
Context2K
Q4_K_M1.8 GB
QW
gguf sharded Qwen2 1.5B Instruct
Qwen · Felladrin
Params1.54B
Context32K
Q4_K_M1.0 GB