Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
NO
notux 8x7b v1
Notux · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
SW
Swallow-70b-NVE-hf
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
MI
Air Striker Mixtral 8x7B ZLoss Instruct
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
QW
Qwen3 42B A3B 2507 TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
GR
GRM 3.2 Sky
Grm · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.8 Flash Next strixflash
Qwen · tawei-amd
Params177B
Context256K
Smallest2.8 GB
EU
Euryale 1.3 longLORA 70b rope8 32k fp16
Euryale · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen3.8 Flash Next
Qwen · whm0627
Params177B
Context256K
Smallest72.5 GB
OR
Ornith-1.5-35B-A3B-Uncensored
Ornith · vonvonhero
Params34.7B
Context256K
Q4_K_M21.2 GB
BA
bagel dpo 34b v0.5
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
TE
migtissera_tess-m-v1.1
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
MO
L3.1 MOE 6X8B Dark Reasoning Dantes Peak HORROR R1 Uncensored 36B
Moe · Jaedwards1986
Params36.2B
Context128K
Q4_K_M22.0 GB
PY
Pyrhea 72B i1
Pyrhea · mradermacher
Params72B
Context32K
Q4_K_M43.8 GB
YI
Yi-34Bx2-MoE-60B
Yi · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
OR
Ornith 1.0 35B AEON Ultimate Uncensored
Ornith · vcruz305
Params34.7B
Context256K
Q4_K_M21.2 GB
ZE
Zen4 Thinking
Zen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
MU
Muse Spark Open 816B A42B GGUF UltraOptimised Curated Protium
Muse · Solstice-AI
Params816B
Context—
Smallest0.8 GB
KI
moonshotai Kimi K2.6
Kimi · bartowski
Params1030B
Context256K
Smallest1.5 GB
LI
Ling 3.0 flash VL
Ling · AtomicChat
Params124B
Context128K
Q4_K_M79.3 GB
QW
calme-2.2-qwen2.5-72b
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
AT
Athene 70B
Athene · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
HE
Hermes 4.3 36B ABLITERATED Heretic
Hermes · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
MI
Solstice Mixtral v1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
LL
Llama-3-Swallow-70B-Instruct-v0.1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen3.5 40B Claude 4.5 Opus High Reasoning Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
NE
NVIDIA-Nemotron-3.5-Transcribe-30B-A4B BF16
Nemotron · Jmica
Params38B
Context1024K
Smallest13.9 GB
QW
spiral da HYAH Qwen2.5 72b i1
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
OR
Ornith 1.5 Cyclos 1M Uncensored
Ornith · mradermacher
Params35.5B
Context1024K
Q4_K_M21.7 GB
KI
KitchenSink 103b i1
Kitchensink · mradermacher
Params103B
Context4K
Smallest22.0 GB
AS
astrollama 2 70b base aic i1
Astrollama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB