Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
FA
FashionGPT 70B v1.2
Fashiongpt · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
MiniMax M2.7
Minimax · mradermacher
Params230B
Context192K
Q4_K_M138.3 GB
AE
aegolius acadicus 34b v3 i1
Aegolius · mradermacher
Params35.4B
Context32K
Q4_K_M21.4 GB
KO
koishi 8x7b qlora i1
Koishi · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Qwen3.5 40B Holodeck Claude Deckard Picard Heretic
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
AI
airoboros-65b-gpt4-m2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
LA
Laguna S 2.1 Heretic
Laguna · mradermacher
Params118B
Context1024K
Q4_K_M71.2 GB
ME
Meditron3 70B
Meditron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Nous Hermes 2 Mixtral 8x7B SFT Wikihow
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
OR
Ornstein 122 A10B
Ornstein · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
IN
InternVL3 78B Instruct
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3 Next 80B A3B Instruct Decensored i1
Qwen · Riyan200324200324
Params80B
Context256K
Q4_K_M48.4 GB
QW
Qwen3 Coder 480B A35B Instruct
Qwen · lmstudio-community
Params480B
Context256K
Q4_K_M290.8 GB
LL
Brinebreath Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
Mistral Large Instruct 2407
Mistral · second-state
Params123B
Context128K
Q4_K_M73.2 GB
KI
Qwopus3.5 122B A10B Kimi K2.6 Destill Healed Abliterated
Kimi · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
LL
Llama3 Med42 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3 Youko 70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
Mistral 2x24B MOE Power Devstral Magistral Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
OY
OYM Qimi 122B A10B K2.6
Oym · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
OR
Ornith-1.5-35B
Ornith · gbuzhf
Params35.5B
Context256K
Smallest18.8 GB
GO
GOAT 70B Storytelling
Goat · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen3.8 Flash Next
Qwen · mradermacher
Params177B
Context256K
Smallest80.4 GB
FA
FashionGPT 70B V1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
AR
ArcaneEntanglement model64 70b i1
Arcaneentanglement · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
dolphin-2.9-llama3-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama EveningMirai 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
calme-2.2-llama3.1-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.6 35B A3B Abliterated Heretic BF16
Qwen · groxaxo
Params34.7B
Context256K
Q4_K_M21.2 GB
PE
perlthoughts_falkor-8x7b-moe
Perlthoughts · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB