Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
SM
smolvla libero f32
Smolvla · robotcpp
Params100M
Context—
Smallest0.0 GB
PH
Phi 3 Medium 4k Instruct Biomarker
Phi · farikaw599
Params66M
Context—
Smallest0.3 GB
TI
TinyLlama LoRA adapter 3MPER0RR abliterated Q8 0
Tinyllama · 3MPER0RR
Params—
Context—
Smallest0.0 GB
PH
phi 4 mini LoRA adapter 3MPER0RR abliterated Q8 0
Phi · 3MPER0RR
Params2M
Context—
Smallest0.0 GB
TI
Tinyllama Function Call Lora Adapter 250424
Tinyllama · makaveli10
Params25M
Context—
Smallest0.1 GB
CH
chroma
Chroma · rectangleworm
Params4.89B
Context—
Smallest2.8 GB
GG
gguf vulnerability pocs
Gguf · dashimubounty-bit
Params—
Context—
Smallest0.0 GB
LL
ultravox v0 5 llama 3 2 1b
Llama · vokra
Params683M
Context—
Smallest1.4 GB
LI
Life_Policy_Assistant_Lora_Adptr
Life · williamtom-3010
Params336M
Context—
Smallest1.3 GB
NE
blackout buddy nemotron lora de
Nemotron · mitvho09
Params21M
Context—
Smallest0.0 GB
OL
ollama gguf oom poc
Ollama · salvepilo
Params—
Context—
Smallest0.0 GB
QW
prepai interviewer
Qwen · FinalRound
Params161M
Context—
Smallest0.3 GB
GL
glm ocr viet mixed lora
GLM · tieubaoca
Params4M
Context—
Smallest0.0 GB
QW
qwen3.5 0.8B captioner Lora
Qwen · sayantan47
Params6M
Context—
Smallest0.0 GB
BI
16_bit_model
Bit · roshanrb001
Params677M
Context—
Smallest1.4 GB
GP
gpt oss 120b heretic v2 bf16 i1
gpt-oss · mradermacher
Params40M
Context—
Smallest0.2 GB
QW
qwen3.5 2b vibe
Qwen · tails1154
Params11M
Context—
Smallest0.0 GB
DE
DeepSeek V4 Flash 0731 DSpark Selective
DeepSeek · jdluzen
Params19.8B
Context1024K
Smallest7.2 GB
SB
SBDO2
Sbdo · SBDO1
Params—
Context—
Smallest4.5 GB
AD
advokat
Advokat · 75dhsx
Params11.9B
Context—
Smallest8.4 GB
QW
Qwen Manim Coder 2
Qwen · maternion
Params69M
Context—
Smallest0.3 GB
VE
velvet rope lenore lora
Velvet · build-small-hackathon
Params33M
Context—
Smallest0.1 GB
MO
mobile lcm
Mobile · Nitishsharma9
Params1.07B
Context—
Smallest1.8 GB
IL
Illustrious models00
Illustrious · mckey-draw
Params2.57B
Context—
Q4_K_M1.6 GB
LL
shisa v2 llama3.1 405b i1
Llama · mradermacher
Params19M
Context—
Smallest0.1 GB
MO
model
Model · Anton-Ding
Params20.4B
Context—
Q4_K_M2.0 GB
GE
gemma4 26b a4b agentic lora run4
Gemma · Myric
Params37M
Context—
Smallest0.1 GB
LL
Llama 3.2 3B Ascii Cats Trained Lora Adapter
Llama · Vincent-0907
Params24M
Context—
Smallest0.1 GB
LL
llama2 7b quantized
Llama · sunshein
Params6.74B
Context2K
Smallest0.0 GB
LL
Llama 3 Instruct Abliteration LoRA 8B
Llama · dysen
Params88M
Context—
Smallest0.4 GB