Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
NL
nllb-200-distilled-600M
Nllb · keisuke-miyako
Params1.4B
Context—
Smallest2.8 GB
QW
german ocr 2b
Qwen · keyvan-ai
Params1.72B
Context256K
Smallest0.4 GB
QW
Qwen2.5 14B Sex v2 Lora
Qwen · Runaweygek
Params69M
Context—
Smallest0.3 GB
KI
Kimi K2.7 Code i1
Kimi · mradermacher
Params383M
Context—
Smallest1.5 GB
ZE
Zeptonic_1.3
Zeptonic · RubixYT
Params—
Context—
Q4_K_M2.4 GB
QW
nong trongpok lora
Qwen · Lemonade44
Params17M
Context—
Smallest0.0 GB
NI
SD2.1 Nitro
Nitro · mrfatso
Params1.29B
Context—
Smallest1.8 GB
PA
parameter overflow
Parameter · GGUFGuy
Params—
Context—
Smallest0.1 GB
IM
imatrices
Imatrices · ddh0
Params14M
Context—
Smallest0.0 GB
QW
meta qwen 14b universal doubter
Qwen · Imperius
Params134M
Context—
Smallest0.5 GB
GE
gemma4 26b a4b agentic lora run2
Gemma · Myric
Params37M
Context—
Smallest0.1 GB
GE
inkmic tidy ru
Gemma · graphin
Params13M
Context—
Smallest0.1 GB
SK
skycmd-s4-micro
Skycmd · maxgfr
Params2M
Context—
Smallest0.0 GB
QW
PRIME TURBO 8B
Qwen · Dennis1315
Params44M
Context—
Smallest0.1 GB
PE
PeterThiel
Peterthiel · Rewritelikeme
Params168M
Context—
Smallest0.7 GB
PH
Phi 2 Finetuned Qa Medmcqa
Phi · farikaw599
Params26M
Context—
Smallest0.1 GB
QW
LoRA Qwen2.5 3B Instruct Abliterated
Qwen · darturi
Params140M
Context—
Smallest0.1 GB
QW
ping device id LoRA 001
Qwen · dzur658
Params10M
Context—
Smallest0.0 GB
LF
LFM2.5 1.2B Thinking Q4 K M BE
Lfm · librepowerai
Params1.17B
Context125K
Q4_K_M0.7 GB
SE
SelentialCore
Selentialcore · S4ntyC1t
Params—
Context—
Smallest0.0 GB
DR
drama-3
Drama · EllaPriest45
Params—
Context—
Smallest20.3 GB
BG
bge m3 gguf embeddings cpp
BGE · chux0519
Params—
Context—
Smallest0.4 GB
TI
TinyLlama 1.1B Chat v1.0 Lora
Tinyllama · garamu
Params2M
Context—
Smallest0.0 GB
GR
meta granite 3.3 8b instruct
Granite · Imperius
Params92M
Context—
Smallest0.4 GB
AL
t0 alpha q8 0 webgpu
Alpha · idle-intelligence
Params102M
Context—
Smallest0.1 GB
HU
huggingface gguf poc
Huggingface · Zhuxs
Params—
Context—
Smallest0.0 GB
SA
sarvam ai finetuning distillation v4 1 F32
Sarvam · Savyasaachin
Params24M
Context—
Smallest0.1 GB
QW
qwen3 8b first grade tutor
Qwen · AustinWay
Params44M
Context—
Smallest0.1 GB
MO
MobileVLMV2
Mobilevlmv · infinity95
Params2.7B
Context2K
Smallest0.6 GB
NL
nllb-200-1.3B
Nllb · keisuke-miyako
Params2.16B
Context—
Smallest4.3 GB