GGUF models by Felladrin

267 GGUF models quantized by Felladrin on Hugging Face. Sizes run from 23M to 229B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 3 270m It
Gemma · Felladrin
Params268M
Context32K
Smallest0.2 GB
GGUF
GG
gguf 774M 03 09 2024
Felladrin
Params770M
Context1K
Q4_K_M0.5 GB
GGUF
FL
Flan T5 Small
Flan · Felladrin
Params77M
Context512
Smallest0.1 GB
GGUF
PI
1.5 Pints 16K v0.1
Pints · Felladrin
Params1.57B
Context16K
Smallest3.1 GB
GGUF
QW
Qwen3-4B
Qwen · Felladrin
Params4.02B
Context40K
Smallest2.5 GB
ReasoningTool use
MA
mamba-370m-hf
Mamba · Felladrin
Params372M
Context1024K
Smallest0.4 GB
GGUF
MI
gguf Q4 K M MiniCPM3 4B
MiniCPM · Felladrin
Params4.07B
Context32K
Smallest2.5 GB
GGUF
OL
AMD OLMo 1B SFT DPO
OLMo · Felladrin
Params1.18B
Context2K
Smallest0.7 GB
GGUF
LL
Llama 3.1 Nemotron Nano 4B v1.1
Llama · Felladrin
Params4.51B
Context128K
Smallest2.7 GB
Tool use
GR
Granite 4.0 H 350m
Granite · Felladrin
Params340M
Context1024K
Smallest0.2 GB
Tool use
DA
h2o-danube3-500m-chat
Danube · Felladrin
Params514M
Context8K
Smallest0.4 GB
GGUF
DA
H2O Danube2 1.8b Chat
Danube · Felladrin
Params1.83B
Context8K
Smallest1.3 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · Felladrin
Params3.82B
Context128K
Smallest2.2 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · Felladrin
Params1.24B
Context128K
Smallest1.0 GB
Tool use
GR
Granite 3.0 1b A400M Instruct
Granite · Felladrin
Params1.33B
Context4K
Smallest1.0 GB
Tool use
GR
Granite 3.1 1b A400M Instruct
Granite · Felladrin
Params1.33B
Context128K
Smallest0.8 GB
Tool use
JA
Jais Adapted 7b Chat
Jais · Felladrin
Params7B
Context4K
Smallest3.5 GB
GGUF
LL
gguf sharded Qwen2 0.5B Instruct llamafy
Llama · Felladrin
Params494M
Context4K
Q4_K_M0.4 GB
GGUF
GG
TinyLlama 1.1B Chat v1.0
Gguf · Felladrin
Params1.1B
Context2K
Smallest0.8 GB
GGUF
GG
gguf sharded Q4 K S pythia 1.4b sft full
Gguf · Felladrin
Params1.41B
Context2K
Smallest0.8 GB
GGUF
GG
1.5 Pints 16K v0.1
Gguf · Felladrin
Params1.57B
Context16K
Smallest0.9 GB
GGUF
GG
gguf sharded openhermes tinyllama sft qlora
Gguf · Felladrin
Params1.1B
Context2K
Q4_K_M0.7 GB
Tool use
QW
gguf sharded Q8 0 Qwen2.5 Coder 0.5B Instruct
Qwen · Felladrin
Params630M
Context32K
Smallest0.7 GB
CodingTool use
WI
gguf sharded smashed WizardLM 2 7B
Wizardlm · Felladrin
Params7.24B
Context32K
Smallest2.7 GB
GGUF
DA
h2o-danube3-500m-chat
Danube · Felladrin
Params514M
Context8K
Smallest0.3 GB
GGUF
MA
gguf sharded Q4 K S MagpieLM 4B Chat v0.1
Magpielm · Felladrin
Params4.51B
Context128K
Smallest2.7 GB
GGUF
OL
OLMoE 1B 7B 0924 Instruct
OLMo · Felladrin
Params6.92B
Context4K
Smallest4.0 GB
GGUF
LL
LlamaCorn 1.1B Chat
Llama · Felladrin
Params1.1B
Context2K
Smallest0.8 GB
GGUF
GG
gguf sharded Q5 K 1.5 Pints 2K v0.1
Gguf · Felladrin
Params1.57B
Context16K
Smallest1.2 GB
GGUF
FA
Falcon3 3B Instruct
Falcon · Felladrin
Params3.23B
Context32K
Smallest1.9 GB
Tool use

Keep browsing