Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Dolphin 2.7 mixtral 8x7b
Mistral · second-state
Params46.7B
Context32K
Q4_K_M26.4 GB
CodingTool use
QW
Qwen3 Coder Next Base
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Coding
YI
RpBird Yi 34B 200k i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
MI
cognitivecomputations_dolphin-2.6-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
CodingTool use
GP
OpenAi GPT oss 36B BrainStorm20x uncensored
gpt-oss · DavidAU
Params36.6B
Context128K
Smallest21.2 GB
CodingReasoning
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.9 GB
GGUF
LL
dolphin-2.9.1-llama-3-70b
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
CodingTool use
QW
Qwen3-Vl-235B-A22B-Instruct-1M
Qwen · unsloth
Params235B
Context977K
Q4_K_M142.2 GB
Vision
LL
dolphin 2.9 llama3 70b GGUF smashed
Llama · PrunaAI
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
internlm2-math-plus-mixtral8x22b
Mistral · legraphista
Params141B
Context64K
Smallest29.6 GB
GGUF
YI
Yi-34B-200K-AEZAKMI-v2
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
IN
Index Translate 35B A3B Preview
Index · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
DO
Dots.Llm1.Inst
Dots · unsloth
Params143B
Context32K
Q4_K_M94.5 GB
GGUF
QW
Qwen3.5 35B A3B Heretic Opus 4.6 Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
QW
Qwen3 42B A3B Spock Brutal Recall Instruct
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoning
KA
karakuri lm 8x7b chat v0.1
Karakuri · mmnga
Params46.7B
Context32K
Smallest9.8 GB
GGUF
QW
Qwen3 42B A3B 2507 Thinking Abliterated Uncensored TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoning
YI
SG Raccoon Yi 55B
Yi · TheBloke
Params55.6B
Context4K
Q4_K_M33.3 GB
GGUF
ME
m42-health_med42-70b
Med · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
OR
Ornith 1.5 35B A3B FULLY OBLITERATED
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
PH
Phi 3.5 MoE Instruct
Phi · bartowski
Params41.9B
Context128K
Q4_K_M25.3 GB
Coding
DE
DeepSeek V4.1 Flash 1017 GSQ RCO
DeepSeek · taurusduan
Params197B
Context—
Smallest110.6 GB
GGUF
LL
nousresearch_yarn-llama-2-70b-32k
Llama · TheBloke
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
QW
Huihui Qwen3.6 35B A3B Claude 4.7 Opus Abliterated
Qwen · shennguyen
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningVision
AV
average-dolphin-8x7B
Average · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
LL
CodeLlama 70b Instruct Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Coding
PA
mihaiii_pallas-0.5-frankenmerge
Pallas · TheBloke
Params36B
Context195K
Q4_K_M21.6 GB
GGUF
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M 1million Ctx
Qwen · mradermacher
Params42.4B
Context1024K
Q4_K_M25.7 GB
CodingReasoning
TH
Thomson 1.0 Small
Thomson · IsValorum
Params34.7B
Context256K
Smallest14.8 GB
Reasoning
CH
chronos007 70b i1
Chronos · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
Roleplay

Other sizes

Keep browsing