GGUF models by Felladrin
267 GGUF models quantized by Felladrin on Hugging Face. Sizes run from 23M to 229B parameters. The longest trained context is 1024K tokens.
GE
Gemma 3 270m It
Gemma · Felladrin
Params268M
Context32K
Smallest0.2 GB
GG
gguf 774M 03 09 2024
Felladrin
Params770M
Context1K
Q4_K_M0.5 GB
FL
Flan T5 Small
Flan · Felladrin
Params77M
Context512
Smallest0.1 GB
PI
1.5 Pints 16K v0.1
Pints · Felladrin
Params1.57B
Context16K
Smallest3.1 GB
QW
Qwen3-4B
Qwen · Felladrin
Params4.02B
Context40K
Smallest2.5 GB
MA
mamba-370m-hf
Mamba · Felladrin
Params372M
Context1024K
Smallest0.4 GB
MI
gguf Q4 K M MiniCPM3 4B
MiniCPM · Felladrin
Params4.07B
Context32K
Smallest2.5 GB
OL
AMD OLMo 1B SFT DPO
OLMo · Felladrin
Params1.18B
Context2K
Smallest0.7 GB
LL
Llama 3.1 Nemotron Nano 4B v1.1
Llama · Felladrin
Params4.51B
Context128K
Smallest2.7 GB
GR
Granite 4.0 H 350m
Granite · Felladrin
Params340M
Context1024K
Smallest0.2 GB
DA
h2o-danube3-500m-chat
Danube · Felladrin
Params514M
Context8K
Smallest0.4 GB
DA
H2O Danube2 1.8b Chat
Danube · Felladrin
Params1.83B
Context8K
Smallest1.3 GB
PH
Phi 3.5 Mini Instruct
Phi · Felladrin
Params3.82B
Context128K
Smallest2.2 GB
LL
Llama 3.2 1B Instruct
Llama · Felladrin
Params1.24B
Context128K
Smallest1.0 GB
GR
Granite 3.0 1b A400M Instruct
Granite · Felladrin
Params1.33B
Context4K
Smallest1.0 GB
GR
Granite 3.1 1b A400M Instruct
Granite · Felladrin
Params1.33B
Context128K
Smallest0.8 GB
JA
Jais Adapted 7b Chat
Jais · Felladrin
Params7B
Context4K
Smallest3.5 GB
LL
gguf sharded Qwen2 0.5B Instruct llamafy
Llama · Felladrin
Params494M
Context4K
Q4_K_M0.4 GB
GG
TinyLlama 1.1B Chat v1.0
Gguf · Felladrin
Params1.1B
Context2K
Smallest0.8 GB
GG
gguf sharded Q4 K S pythia 1.4b sft full
Gguf · Felladrin
Params1.41B
Context2K
Smallest0.8 GB
GG
1.5 Pints 16K v0.1
Gguf · Felladrin
Params1.57B
Context16K
Smallest0.9 GB
GG
gguf sharded openhermes tinyllama sft qlora
Gguf · Felladrin
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
gguf sharded Q8 0 Qwen2.5 Coder 0.5B Instruct
Qwen · Felladrin
Params630M
Context32K
Smallest0.7 GB
WI
gguf sharded smashed WizardLM 2 7B
Wizardlm · Felladrin
Params7.24B
Context32K
Smallest2.7 GB
DA
h2o-danube3-500m-chat
Danube · Felladrin
Params514M
Context8K
Smallest0.3 GB
MA
gguf sharded Q4 K S MagpieLM 4B Chat v0.1
Magpielm · Felladrin
Params4.51B
Context128K
Smallest2.7 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest4.0 GB
LL
LlamaCorn 1.1B Chat
Llama · Felladrin
Params1.1B
Context2K
Smallest0.8 GB
GG
gguf sharded Q5 K 1.5 Pints 2K v0.1
Gguf · Felladrin
Params1.57B
Context16K
Smallest1.2 GB
FA
Falcon3 3B Instruct
Falcon · Felladrin
Params3.23B
Context32K
Smallest1.9 GB