Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
UN
Saluki 27B 1.0 Abliteration LoRA
Underdog · spelled-a66
Params27B
Context—
Smallest0.0 GB
AC
act-so101-multi-task
Act · khanhnd61
Params59M
Context—
Smallest0.2 GB
QW
Qwen3.5 35B A3B Base
Qwen · maxwellb-hf
Params35.5B
Context256K
Smallest0.2 GB
QW
Qwopus3.6 35B A3B v1
Qwopus · jamiefutch
Params35.5B
Context256K
Smallest21.2 GB
QW
qwen3.8 27b kv approximation
Qwen · alimpfard
Params931M
Context—
Smallest0.5 GB
ST
Stupid Equation Solver
Stupid · XIVAI
Params4M
Context—
Smallest0.0 GB
DE
DeepSeek V3.2 dense attn imatrix
DeepSeek · Doctor-Shotgun
Params252M
Context—
Smallest1.0 GB
OC
PP-OCRv6_small_det
Ocrv · cstr
Params2M
Context—
Smallest0.0 GB
WA
WAI REALISM Illustrious
Wai · nuupy
Params2.57B
Context—
Q4_K_M1.6 GB
XA
Xavier v10r34
Xavier · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
HT
Html Model Tinyllama Chat Bnb 4bit
Html · learn-abc
Params51M
Context—
Smallest0.2 GB
QW
qwen3.8 27B antislop svd lora
Qwen · hotdogs
Params435M
Context—
Smallest1.7 GB
DE
DeepSeek V4 Flash Abliterated lora
DeepSeek · Sabomako
Params2.16B
Context—
Smallest2.3 GB
QW
pflash scorer head
Qwen · Lucebox
Params3M
Context—
Smallest0.0 GB
FA
Falcon3 10B Base 1.58bit
Falcon · nebuxcloud
Params10.3B
Context—
Smallest2.9 GB
QW
Dflash
Qwen · cso3987
Params510M
Context256K
Q4_K_M0.3 GB
QW
Qwen3 Coder 480B A35B Instruct heretic i1
Qwen · mradermacher
Params480B
Context256K
Smallest0.6 GB
WA
Wan
Wan · coolrna
Params14.3B
Context—
Q4_K_M9.7 GB
SN
snowflake arctic embed m v2.0 gguf embeddings cpp
Snowflake · chux0519
Params—
Context—
Smallest0.2 GB
MI
MiniMax-M3.1-Flash
Minimax · mondk
Params426B
Context—
Q4_K_M258.1 GB
BI
bitvla libero
Bitvla · fai-modelopt-tech
Params1.03B
Context—
Smallest1.4 GB
QW
Qwen3.6-35B-A3B
Qwen · michaelw9999
Params35.5B
Context256K
Smallest29.3 GB
DE
DeepSeek V4 Flash 0731 heretic
DeepSeek · MorinoNushi
Params284B
Context1024K
Smallest161.9 GB
LL
Fingpt Mt_Llama2 7b_lora
Llama · shohaibsmallick
Params6M
Context—
Smallest0.0 GB
MO
most embed de
Most · cstr
Params1.14B
Context—
Smallest0.9 GB
GE
gemma 4 12B it qat q4 0 unquantized heretic lora
Gemma · Qwe1325
Params12B
Context—
Smallest0.0 GB
FA
Falcon3 1B Instruct 1.58bit
Falcon · nebuxcloud
Params1.67B
Context—
Smallest0.7 GB
CH
ChemAI v2 LoRA F16
Chemai · Virinchi999
Params40M
Context—
Smallest0.1 GB
KI
LMF2.4 2.6B Kimi
Kimi · bunnycore
Params2M
Context—
Smallest0.0 GB
PR
problem tensors
Problem · ilintar
Params—
Context—
Smallest0.0 GB