Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
SM
smolvla libero f32
Smolvla · robotcpp
Params100M
Context—
Smallest0.0 GB
GGUF
PH
Phi 3 Medium 4k Instruct Biomarker
Phi · farikaw599
Params66M
Context—
Smallest0.3 GB
GGUF
TI
TinyLlama LoRA adapter 3MPER0RR abliterated Q8 0
Tinyllama · 3MPER0RR
Params—
Context—
Smallest0.0 GB
GGUF
PH
phi 4 mini LoRA adapter 3MPER0RR abliterated Q8 0
Phi · 3MPER0RR
Params2M
Context—
Smallest0.0 GB
GGUF
TI
Tinyllama Function Call Lora Adapter 250424
Tinyllama · makaveli10
Params25M
Context—
Smallest0.1 GB
GGUF
CH
chroma
Chroma · rectangleworm
Params4.89B
Context—
Smallest2.8 GB
GGUF
GG
gguf vulnerability pocs
Gguf · dashimubounty-bit
Params—
Context—
Smallest0.0 GB
GGUF
LL
ultravox v0 5 llama 3 2 1b
Llama · vokra
Params683M
Context—
Smallest1.4 GB
GGUF
LI
Life_Policy_Assistant_Lora_Adptr
Life · williamtom-3010
Params336M
Context—
Smallest1.3 GB
GGUF
NE
blackout buddy nemotron lora de
Nemotron · mitvho09
Params21M
Context—
Smallest0.0 GB
GGUF
OL
ollama gguf oom poc
Ollama · salvepilo
Params—
Context—
Smallest0.0 GB
GGUF
QW
prepai interviewer
Qwen · FinalRound
Params161M
Context—
Smallest0.3 GB
GGUF
GL
glm ocr viet mixed lora
GLM · tieubaoca
Params4M
Context—
Smallest0.0 GB
GGUF
QW
qwen3.5 0.8B captioner Lora
Qwen · sayantan47
Params6M
Context—
Smallest0.0 GB
GGUF
BI
16_bit_model
Bit · roshanrb001
Params677M
Context—
Smallest1.4 GB
GGUF
GP
gpt oss 120b heretic v2 bf16 i1
gpt-oss · mradermacher
Params40M
Context—
Smallest0.2 GB
GGUF
QW
qwen3.5 2b vibe
Qwen · tails1154
Params11M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash 0731 DSpark Selective
DeepSeek · jdluzen
Params19.8B
Context1024K
Smallest7.2 GB
GGUF
SB
SBDO2
Sbdo · SBDO1
Params—
Context—
Smallest4.5 GB
GGUF
AD
advokat
Advokat · 75dhsx
Params11.9B
Context—
Smallest8.4 GB
GGUF
QW
Qwen Manim Coder 2
Qwen · maternion
Params69M
Context—
Smallest0.3 GB
GGUF
VE
velvet rope lenore lora
Velvet · build-small-hackathon
Params33M
Context—
Smallest0.1 GB
GGUF
MO
mobile lcm
Mobile · Nitishsharma9
Params1.07B
Context—
Smallest1.8 GB
GGUF
IL
Illustrious models00
Illustrious · mckey-draw
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
LL
shisa v2 llama3.1 405b i1
Llama · mradermacher
Params19M
Context—
Smallest0.1 GB
GGUF
MO
model
Model · Anton-Ding
Params20.4B
Context—
Q4_K_M2.0 GB
GGUF
GE
gemma4 26b a4b agentic lora run4
Gemma · Myric
Params37M
Context—
Smallest0.1 GB
GGUF
LL
Llama 3.2 3B Ascii Cats Trained Lora Adapter
Llama · Vincent-0907
Params24M
Context—
Smallest0.1 GB
GGUF
LL
llama2 7b quantized
Llama · sunshein
Params6.74B
Context2K
Smallest0.0 GB
GGUF
LL
Llama 3 Instruct Abliteration LoRA 8B
Llama · dysen
Params88M
Context—
Smallest0.4 GB
GGUF

Other uses

Keep browsing