Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LF
LiquidAI/LFM2-350M-Extract
Lfm · damienlusson
Params350M
Context—
Smallest0.0 GB
GGUF
AN
AnythingXL Lightning
Anythingxl · mzwing
Params3.47B
Context—
Smallest2.6 GB
GGUF
TH
the largest
The · wop
Params—
Context—
Smallest0.0 GB
GGUF
NO
novaFurryXL ilV140
Novafurryxl · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
CO
Cohere Transcribe
Cohere · willspeak
Params2.05B
Context—
Smallest1.8 GB
GGUF
GE
hiyori gemma4 26B A4B qat gguf
Gemma · MelissaJ
Params74M
Context—
Smallest0.1 GB
GGUF
QW
qwen38 27b huihui slim lora
Qwen · sunnyyy
Params106M
Context—
Smallest0.1 GB
GGUF
SM
smollm2 360m instruct loom
SmolLM · loom-ai-org
Params362M
Context—
Smallest1.4 GB
GGUF
EV
evo1 libero
Evo · vrfai
Params776M
Context—
Smallest1.6 GB
GGUF
GE
Gemma 3N E4B Gutenberg v2
Gemma · jir88
Params38M
Context—
Smallest0.2 GB
GGUF
KR
Krea2 checkpoints
Krea · radarer168
Params12.8B
Context—
Smallest14.6 GB
GGUF
UN
solus v1 unlimited ocr q5
Unlimited · Fazmin
Params2.93B
Context32K
Smallest2.2 GB
GGUF
IM
impact so101 multi task
Impact · khanhnd61
Params96M
Context—
Smallest0.4 GB
GGUF
DE
DeepSeek V4 Flash 0731 DSpark Selective Q4 K M
DeepSeek · Ralii
Params19.8B
Context1024K
Smallest10.6 GB
GGUF
DE
DeepSeek V4 4B Toy
DeepSeek · Bert504
Params4.08B
Context1024K
Smallest2.6 GB
GGUF
TE
testgdp
Testgdp · Shrijanagain
Params—
Context—
Smallest0.0 GB
GGUF
HO
mantis
Holo · cabal-ai
Params8M
Context—
Smallest0.0 GB
GGUF
CA
calm traveler 12bultra moe lora
Calm · rp-model-heaven
Params567M
Context—
Smallest0.6 GB
GGUF
DI
diar streaming sortformer 4spk v2.1
Diar · Adit2K
Params118M
Context—
Smallest0.1 GB
GGUF
LF
LMF 2.5 2B Code Lora
Lfm · bunnycore
Params1M
Context—
Smallest0.0 GB
GGUF
FL
Flex.2 preview
Flex · Wesley1234
Params8.16B
Context—
Q4_K_M4.8 GB
GGUF
LI
limarp llongma2 8k gguf f16
Limarp · nxnhjrjtbjfzhrovwl
Params13B
Context8K
Smallest26.0 GB
GGUF
KO
KoAlpaca RealQA Solar Ko Recovery 11B LoRA ChatML
Koalpaca · beomi
Params63M
Context—
Smallest0.3 GB
GGUF
LI
pi0 libero f32
Libero · robotcpp
Params315M
Context—
Smallest0.0 GB
GGUF
BA
bananaSplitzXL vee8PointOh
Bananasplitzxl · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
QW
meta qwen 14b goalanchor
Qwen · Imperius
Params148M
Context—
Smallest0.6 GB
GGUF
JO
Josev 2B SystemOne
Josev · cstr
Params1.91B
Context—
Smallest7.7 GB
GGUF
HI
HiDreamI1
Hidreami · KazumaSensei
Params17.1B
Context—
Smallest0.2 GB
GGUF
LL
lora Meta Llama 3.1 8B Instruct
Llama · weber50432
Params8.03B
Context128K
Smallest16.1 GB
GGUF
HO
K2 Horizon MoVA 36B A4B Q2K
Horizon · CompressedGemma
Params37.4B
Context512K
Smallest0.1 GB
GGUF

Other uses

Keep browsing