Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
MA
magnum v3 34b
Magnum · bartowski
Params34.4B
Context32K
Q4_K_M20.7 GB
MI
vagosolutions_sauerkrautlm-mixtral-8x7b-instruct
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
QW
Qwen3.5 122B A10B Claude Distill
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
QW
Huihui Qwen3.5 35B A3B abliterated Q4 K M
Qwen · cesarsal1nas
Params34.7B
Context256K
Q4_K_M21.2 GB
OR
Ornith 1.5 35B A3B FULLY OBLITERATED
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwopus3.6 35B A3B v1 APEX
Qwopus · mudler
Params34.7B
Context256K
Smallest13.5 GB
TU
tulu 2 70b
Tulu · mradermacher
Params69B
Context8K
Q4_K_M41.4 GB
YI
Yi 1.5 34B Chat Abliterated
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
FA
Fable Coder 35B A3B
Fable · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3.8 Flash Next
Qwen · python-jo
Params177B
Context256K
Q4_K_M1.9 GB
OR
Ornith 1.5 122B IQ3 XXS 16G64G
Ornith · zephel01
Params125B
Context256K
Smallest0.4 GB
LL
Llama PLLuM 70B Instruct 2512
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OR
Ornith 1.5 35B A3B MTP
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
LL
Llama 3_1 Nemotron 51B Instruct
Llama · ymcki
Params51.5B
Context128K
Q4_K_M31.0 GB
YI
Capybara Tess Yi 34B 200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
XO
XORTRON.CriminalComputing.LARGE.2026.3
Xortron · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
IQ
IQuest Coder V1 40B Instruct
Iquest · AaryanK
Params39.8B
Context128K
Q4_K_M24.0 GB
XO
XORTRON.CriminalComputing.Config.LARGE.XPRT2
Xortron · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
LL
tulu v1 llama2 70b
Llama · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
LL
Meta Llama 3 70B Instruct
Llama · QuantFactory
Params70.6B
Context8K
Q4_K_M42.5 GB
DE
DeepSeek V4.1 Flash
DeepSeek · Solstice-AI
Params748B
Context—
Q4_K_M444.7 GB
DR
Drex v2.0
Drex · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
PR
Nohobby L3.3 Prikol 70B v0.5
Prikol · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen1.5-110B-Chat
Qwen · second-state
Params111B
Context32K
Q4_K_M67.2 GB
QW
Qwen3.6-35B-A3B
Qwen · sphaela
Params35.5B
Context256K
Q4_K_M21.7 GB
YI
Yi 34B i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
YI
Yi 34Bx2 MOE 200K
Yi · mradermacher
Params61B
Context195K
Q4_K_M37.2 GB
QW
Qwen3.5 122B A10B
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
OR
Ornith 1.5 35B A3B uncensored GGUF 8bit
Ornith · junafinity
Params35.5B
Context256K
Smallest37.8 GB
GP
Openai.Gpt Oss 120b
gpt-oss · DevQuasar
Params117B
Context128K
Q4_K_M87.9 GB