Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
MI
Dolphin 2.7 mixtral 8x7b
Mistral · second-state
Params46.7B
Context32K
Q4_K_M26.4 GB
QW
Qwen3 Coder Next Base
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
YI
RpBird Yi 34B 200k i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
MI
cognitivecomputations_dolphin-2.6-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GP
OpenAi GPT oss 36B BrainStorm20x uncensored
gpt-oss · DavidAU
Params36.6B
Context128K
Smallest21.2 GB
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.9 GB
LL
dolphin-2.9.1-llama-3-70b
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
QW
Qwen3-Vl-235B-A22B-Instruct-1M
Qwen · unsloth
Params235B
Context977K
Q4_K_M142.2 GB
LL
dolphin 2.9 llama3 70b GGUF smashed
Llama · PrunaAI
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
internlm2-math-plus-mixtral8x22b
Mistral · legraphista
Params141B
Context64K
Smallest29.6 GB
YI
Yi-34B-200K-AEZAKMI-v2
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
IN
Index Translate 35B A3B Preview
Index · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
DO
Dots.Llm1.Inst
Dots · unsloth
Params143B
Context32K
Q4_K_M94.5 GB
QW
Qwen3.5 35B A3B Heretic Opus 4.6 Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3 42B A3B Spock Brutal Recall Instruct
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
KA
karakuri lm 8x7b chat v0.1
Karakuri · mmnga
Params46.7B
Context32K
Smallest9.8 GB
QW
Qwen3 42B A3B 2507 Thinking Abliterated Uncensored TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
YI
SG Raccoon Yi 55B
Yi · TheBloke
Params55.6B
Context4K
Q4_K_M33.3 GB
ME
m42-health_med42-70b
Med · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
OR
Ornith 1.5 35B A3B FULLY OBLITERATED
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
PH
Phi 3.5 MoE Instruct
Phi · bartowski
Params41.9B
Context128K
Q4_K_M25.3 GB
DE
DeepSeek V4.1 Flash 1017 GSQ RCO
DeepSeek · taurusduan
Params197B
Context—
Smallest110.6 GB
LL
nousresearch_yarn-llama-2-70b-32k
Llama · TheBloke
Params69B
Context32K
Q4_K_M41.4 GB
QW
Huihui Qwen3.6 35B A3B Claude 4.7 Opus Abliterated
Qwen · shennguyen
Params34.7B
Context256K
Q4_K_M21.2 GB
AV
average-dolphin-8x7B
Average · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
LL
CodeLlama 70b Instruct Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
PA
mihaiii_pallas-0.5-frankenmerge
Pallas · TheBloke
Params36B
Context195K
Q4_K_M21.6 GB
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M 1million Ctx
Qwen · mradermacher
Params42.4B
Context1024K
Q4_K_M25.7 GB
TH
Thomson 1.0 Small
Thomson · IsValorum
Params34.7B
Context256K
Smallest14.8 GB
CH
chronos007 70b i1
Chronos · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB