Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NL
nllb-200-distilled-600M
Nllb · keisuke-miyako
Params1.4B
Context—
Smallest2.8 GB
GGUF
QW
german ocr 2b
Qwen · keyvan-ai
Params1.72B
Context256K
Smallest0.4 GB
GGUF
QW
Qwen2.5 14B Sex v2 Lora
Qwen · Runaweygek
Params69M
Context—
Smallest0.3 GB
GGUF
KI
Kimi K2.7 Code i1
Kimi · mradermacher
Params383M
Context—
Smallest1.5 GB
GGUF
ZE
Zeptonic_1.3
Zeptonic · RubixYT
Params—
Context—
Q4_K_M2.4 GB
GGUF
QW
nong trongpok lora
Qwen · Lemonade44
Params17M
Context—
Smallest0.0 GB
GGUF
NI
SD2.1 Nitro
Nitro · mrfatso
Params1.29B
Context—
Smallest1.8 GB
GGUF
PA
parameter overflow
Parameter · GGUFGuy
Params—
Context—
Smallest0.1 GB
GGUF
IM
imatrices
Imatrices · ddh0
Params14M
Context—
Smallest0.0 GB
GGUF
QW
meta qwen 14b universal doubter
Qwen · Imperius
Params134M
Context—
Smallest0.5 GB
GGUF
GE
gemma4 26b a4b agentic lora run2
Gemma · Myric
Params37M
Context—
Smallest0.1 GB
GGUF
GE
inkmic tidy ru
Gemma · graphin
Params13M
Context—
Smallest0.1 GB
GGUF
SK
skycmd-s4-micro
Skycmd · maxgfr
Params2M
Context—
Smallest0.0 GB
GGUF
QW
PRIME TURBO 8B
Qwen · Dennis1315
Params44M
Context—
Smallest0.1 GB
GGUF
PE
PeterThiel
Peterthiel · Rewritelikeme
Params168M
Context—
Smallest0.7 GB
GGUF
PH
Phi 2 Finetuned Qa Medmcqa
Phi · farikaw599
Params26M
Context—
Smallest0.1 GB
GGUF
QW
LoRA Qwen2.5 3B Instruct Abliterated
Qwen · darturi
Params140M
Context—
Smallest0.1 GB
GGUF
QW
ping device id LoRA 001
Qwen · dzur658
Params10M
Context—
Smallest0.0 GB
GGUF
LF
LFM2.5 1.2B Thinking Q4 K M BE
Lfm · librepowerai
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
SE
SelentialCore
Selentialcore · S4ntyC1t
Params—
Context—
Smallest0.0 GB
GGUF
DR
drama-3
Drama · EllaPriest45
Params—
Context—
Smallest20.3 GB
GGUF
BG
bge m3 gguf embeddings cpp
BGE · chux0519
Params—
Context—
Smallest0.4 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0 Lora
Tinyllama · garamu
Params2M
Context—
Smallest0.0 GB
GGUF
GR
meta granite 3.3 8b instruct
Granite · Imperius
Params92M
Context—
Smallest0.4 GB
GGUF
AL
t0 alpha q8 0 webgpu
Alpha · idle-intelligence
Params102M
Context—
Smallest0.1 GB
GGUF
HU
huggingface gguf poc
Huggingface · Zhuxs
Params—
Context—
Smallest0.0 GB
GGUF
SA
sarvam ai finetuning distillation v4 1 F32
Sarvam · Savyasaachin
Params24M
Context—
Smallest0.1 GB
GGUF
QW
qwen3 8b first grade tutor
Qwen · AustinWay
Params44M
Context—
Smallest0.1 GB
GGUF
MO
MobileVLMV2
Mobilevlmv · infinity95
Params2.7B
Context2K
Smallest0.6 GB
GGUF
NL
nllb-200-1.3B
Nllb · keisuke-miyako
Params2.16B
Context—
Smallest4.3 GB
GGUF

Other uses

Keep browsing