Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen2_VL_2B_PLZ
Qwen · Captaint2004
Params665M
Context—
Smallest1.3 GB
OL
ollama gguf dos 1
Ollama · rajasingh010
Params—
Context—
Smallest0.0 GB
NE
blackout buddy nemotron lora kn
Nemotron · mitvho09
Params21M
Context—
Smallest0.0 GB
LL
Dolphin X1 Llama 3.1 405B i1
Llama · mradermacher
Params19M
Context—
Smallest0.1 GB
QW
Qwen2_VL_2B_NEW_GGUF_TESTING
Qwen · Captaint2004
Params665M
Context—
Smallest1.3 GB
NI
Nietzsche
Nietzsche · Rewritelikeme
Params168M
Context—
Smallest0.7 GB
LL
llama cpp quadratic dos poc
Llama · salvepilo
Params—
Context—
Smallest0.0 GB
CH
gr00t N1.7 checkpoint ur10e cup finetuned
Checkpoint · kamusarj
Params—
Context—
Smallest8.8 GB
OL
ollama gguf dos 2
Ollama · rajasingh010
Params—
Context—
Smallest0.0 GB
FI
FineLlama
Finellama · rblacha
Params1B
Context—
Smallest0.0 GB
QW
qwen skills
Qwen · blackcloud1199
Params37M
Context—
Smallest0.1 GB
BA
bananaSplitzXL vee5PointOh
Bananasplitzxl · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
DE
DeepSeek V4 Flash 160t2 UD IQ1 S
DeepSeek · siendsi
Params180B
Context1024K
Smallest54.2 GB
TR
trocr_small_printed_deit_perlayer
Trocr · cstr
Params61M
Context—
Smallest0.0 GB
AN
AnimaTurbo
Anima · DaNS2025
Params2.09B
Context—
Smallest1.5 GB
SA
saathi lite preview
Saathi · revampedwarrior
Params1B
Context32K
Smallest0.0 GB
MI
Medical Llm mistral7B
Mistral · AL-DN
Params7M
Context—
Smallest0.0 GB
PU
punctuate all loom
Punctuate · loom-ai-org
Params277M
Context—
Smallest1.1 GB
PA
paddleocr
Paddleocr · NeemaShioSe
Params22M
Context—
Smallest0.0 GB
GE
marchespublics sft
Gemma · EloaurdiMustapha
Params37M
Context—
Smallest0.1 GB
QW
lifestyle advisor qwen qlora
Qwen · kaushik2202
Params87M
Context—
Smallest0.3 GB
FR
op frmttr assistant lora gguf v3
Frmttr · williamtom-3010
Params336M
Context—
Smallest0.7 GB
DE
Finetuned DeepSeek R1 Distill Llama 8B CoT Financial Analyst F16
DeepSeek · geasadfg
Params42M
Context—
Smallest0.1 GB
QW
Qwen3.6 27B
Qwen · eepos
Params27.3B
Context256K
Smallest20.4 GB
QW
Qwen3.5 0.8B qcache q8
Qwen · DeepDavid
Params751M
Context—
Smallest0.8 GB
FL
Flex.1 Alpha
Flex · Wesley1234
Params8.16B
Context—
Q4_K_M4.8 GB
QW
coffee leaf check qwen3.5 2b
Qwen · uchaan
Params1.88B
Context256K
Smallest0.0 GB
LL
ted llama3 8b
Llama · 44dummies
Params8.03B
Context8K
Smallest0.2 GB
MI
MiMo V2.5 GGUF ko
Mimo · hell0ks
Params310B
Context1024K
Smallest0.5 GB
GG
ggml oom abort poc
Ggml · MBM7
Params—
Context—
Smallest0.0 GB