Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
SO
Solar Open2 250B Mixed Quant
Solar · Baekpica
Params250B
Context—
Smallest95.5 GB
GL
GLM 5.3 Flash abliterated Maya M
GLM · alesha-pro
Params370B
Context64K
Smallest0.0 GB
CY
CYBER-FROST-3.8-PS-GUFF
Cyber · peasantsmith
Params180B
Context256K
Smallest112.5 GB
QW
Qwen3.8 35B A3B Distill
Qwen · IsValorum
Params34.7B
Context256K
Smallest1.2 GB
QW
T-Search-Qwen3.6-35B-A3B
Qwen · t-tech
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3.6 35B A3B MTP APEX I MiniPlus V2.1 Abliterated
Qwen · IsValorum
Params34.7B
Context256K
Smallest1.2 GB
OR
Ornith 1.0 35B
Ornith · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
QW
Huihui Qwen3.6 35B A3B abliterated
Qwen · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB
ST
Step-3.7-Flash
Step · unsloth
Params197B
Context256K
Q4_K_M122.1 GB
QW
Qwen_Qwen3.8 Flash Next
Qwen · lmstudio-community
Params177B
Context256K
Q4_K_M119.2 GB
QW
Qwen3.8 Distill 35B A3B Coder Abliterated
Qwen · Lord-H4D3ZS
Params35.5B
Context256K
Smallest12.3 GB
HO
K2 Horizon MoVA 36B A4B Uncensored
Horizon · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
EU
L3.3 70B Euryale v2.3
Euryale · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3-235B-A22B
Qwen · unsloth
Params235B
Context40K
Q4_K_M142.2 GB
MI
Mistral-Medium-3.5-128B
Mistral · unsloth
Params125B
Context256K
Q4_K_M74.9 GB
GL
GLM-5.3-Flash
GLM · neuralll
Params313B
Context1024K
Smallest113.6 GB
LA
m51Lab MiniMax M2.7 REAP 139B A10B
Lab · mradermacher
Params139B
Context192K
Q4_K_M84.2 GB
QW
Qwen3.8 Flash Next Coder cut240
Qwen · Schiltmans
Params56.6B
Context256K
Smallest4.5 GB
QW
Qwen3 Coder Next Uncensored Heretic
Qwen · llmfan46
Params79.7B
Context256K
Q4_K_M49.8 GB
SA
Sage A1.5 Sangreal ICE
Sage · gbuzhf
Params35.5B
Context256K
Smallest12.2 GB
GP
Gpt Oss 120b Uncensored
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
MI
cognitivecomputations_dolphin-2.7-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
LL
jarradh_llama2_70b_chat_uncensored
Llama · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
CO
Computer 10
Computer · bartowski
Params70.6B
Context128K
Q4_K_M44.0 GB
QW
Qwen3 Next 80B A3B Thinking
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
MI
mistralai_mixtral-8x7b-v0.1
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GL
GLM 5.3 GGUF DGX Spark
GLM · autotrust
Params563B
Context1024K
Smallest160.8 GB
QW
Qwen3.8 Flash Next Abliterated Uncensored
Qwen · cc1244578151
Params177B
Context256K
Smallest83.9 GB
OR
Ornith 1.5 122B
Ornith · bartowski
Params125B
Context256K
Q4_K_M78.9 GB
SA
Sage A1.5 F16
Sage · InternScience
Params35.5B
Context256K
Smallest71.1 GB