Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2_VL_2B_PLZ
Qwen · Captaint2004
Params665M
Context—
Smallest1.3 GB
GGUF
OL
ollama gguf dos 1
Ollama · rajasingh010
Params—
Context—
Smallest0.0 GB
GGUF
NE
blackout buddy nemotron lora kn
Nemotron · mitvho09
Params21M
Context—
Smallest0.0 GB
GGUF
LL
Dolphin X1 Llama 3.1 405B i1
Llama · mradermacher
Params19M
Context—
Smallest0.1 GB
GGUF
QW
Qwen2_VL_2B_NEW_GGUF_TESTING
Qwen · Captaint2004
Params665M
Context—
Smallest1.3 GB
GGUF
NI
Nietzsche
Nietzsche · Rewritelikeme
Params168M
Context—
Smallest0.7 GB
GGUF
LL
llama cpp quadratic dos poc
Llama · salvepilo
Params—
Context—
Smallest0.0 GB
GGUF
CH
gr00t N1.7 checkpoint ur10e cup finetuned
Checkpoint · kamusarj
Params—
Context—
Smallest8.8 GB
GGUF
OL
ollama gguf dos 2
Ollama · rajasingh010
Params—
Context—
Smallest0.0 GB
GGUF
FI
FineLlama
Finellama · rblacha
Params1B
Context—
Smallest0.0 GB
GGUF
QW
qwen skills
Qwen · blackcloud1199
Params37M
Context—
Smallest0.1 GB
GGUF
BA
bananaSplitzXL vee5PointOh
Bananasplitzxl · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
DE
DeepSeek V4 Flash 160t2 UD IQ1 S
DeepSeek · siendsi
Params180B
Context1024K
Smallest54.2 GB
GGUF
TR
trocr_small_printed_deit_perlayer
Trocr · cstr
Params61M
Context—
Smallest0.0 GB
GGUF
AN
AnimaTurbo
Anima · DaNS2025
Params2.09B
Context—
Smallest1.5 GB
GGUF
SA
saathi lite preview
Saathi · revampedwarrior
Params1B
Context32K
Smallest0.0 GB
GGUF
MI
Medical Llm mistral7B
Mistral · AL-DN
Params7M
Context—
Smallest0.0 GB
GGUF
PU
punctuate all loom
Punctuate · loom-ai-org
Params277M
Context—
Smallest1.1 GB
GGUF
PA
paddleocr
Paddleocr · NeemaShioSe
Params22M
Context—
Smallest0.0 GB
GGUF
GE
marchespublics sft
Gemma · EloaurdiMustapha
Params37M
Context—
Smallest0.1 GB
GGUF
QW
lifestyle advisor qwen qlora
Qwen · kaushik2202
Params87M
Context—
Smallest0.3 GB
GGUF
FR
op frmttr assistant lora gguf v3
Frmttr · williamtom-3010
Params336M
Context—
Smallest0.7 GB
GGUF
DE
Finetuned DeepSeek R1 Distill Llama 8B CoT Financial Analyst F16
DeepSeek · geasadfg
Params42M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.6 27B
Qwen · eepos
Params27.3B
Context256K
Smallest20.4 GB
GGUF
QW
Qwen3.5 0.8B qcache q8
Qwen · DeepDavid
Params751M
Context—
Smallest0.8 GB
GGUF
FL
Flex.1 Alpha
Flex · Wesley1234
Params8.16B
Context—
Q4_K_M4.8 GB
GGUF
QW
coffee leaf check qwen3.5 2b
Qwen · uchaan
Params1.88B
Context256K
Smallest0.0 GB
GGUF
LL
ted llama3 8b
Llama · 44dummies
Params8.03B
Context8K
Smallest0.2 GB
GGUF
MI
MiMo V2.5 GGUF ko
Mimo · hell0ks
Params310B
Context1024K
Smallest0.5 GB
GGUF
GG
ggml oom abort poc
Ggml · MBM7
Params—
Context—
Smallest0.0 GB
GGUF

Other uses

Keep browsing