Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MA
magnum v3 34b
Magnum · bartowski
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
MI
vagosolutions_sauerkrautlm-mixtral-8x7b-instruct
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
QW
Qwen3.5 122B A10B Claude Distill
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
Vision
QW
Huihui Qwen3.5 35B A3B abliterated Q4 K M
Qwen · cesarsal1nas
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
OR
Ornith 1.5 35B A3B FULLY OBLITERATED
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
QW
Qwopus3.6 35B A3B v1 APEX
Qwopus · mudler
Params34.7B
Context256K
Smallest13.5 GB
Reasoning
TU
tulu 2 70b
Tulu · mradermacher
Params69B
Context8K
Q4_K_M41.4 GB
GGUF
YI
Yi 1.5 34B Chat Abliterated
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
FA
Fable Coder 35B A3B
Fable · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CodingReasoningTool use
QW
Qwen3.8 Flash Next
Qwen · python-jo
Params177B
Context256K
Q4_K_M1.9 GB
ReasoningTool useVision
OR
Ornith 1.5 122B IQ3 XXS 16G64G
Ornith · zephel01
Params125B
Context256K
Smallest0.4 GB
GGUF
LL
Llama PLLuM 70B Instruct 2512
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
OR
Ornith 1.5 35B A3B MTP
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CodingReasoningVision
LL
Llama 3_1 Nemotron 51B Instruct
Llama · ymcki
Params51.5B
Context128K
Q4_K_M31.0 GB
GGUF
YI
Capybara Tess Yi 34B 200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
XO
XORTRON.CriminalComputing.LARGE.2026.3
Xortron · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
IQ
IQuest Coder V1 40B Instruct
Iquest · AaryanK
Params39.8B
Context128K
Q4_K_M24.0 GB
CodingTool use
XO
XORTRON.CriminalComputing.Config.LARGE.XPRT2
Xortron · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
GGUF
LL
tulu v1 llama2 70b
Llama · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
LL
Meta Llama 3 70B Instruct
Llama · QuantFactory
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · Solstice-AI
Params748B
Context—
Q4_K_M444.7 GB
GGUF
DR
Drex v2.0
Drex · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
PR
Nohobby L3.3 Prikol 70B v0.5
Prikol · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen1.5-110B-Chat
Qwen · second-state
Params111B
Context32K
Q4_K_M67.2 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · sphaela
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
YI
Yi 34B i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
YI
Yi 34Bx2 MOE 200K
Yi · mradermacher
Params61B
Context195K
Q4_K_M37.2 GB
GGUF
QW
Qwen3.5 122B A10B
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
OR
Ornith 1.5 35B A3B uncensored GGUF 8bit
Ornith · junafinity
Params35.5B
Context256K
Smallest37.8 GB
ReasoningTool useVision
GP
Openai.Gpt Oss 120b
gpt-oss · DevQuasar
Params117B
Context128K
Q4_K_M87.9 GB
Tool use

Other sizes

Keep browsing