Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
FA
FashionGPT 70B v1.2
Fashiongpt · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
MiniMax M2.7
Minimax · mradermacher
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
AE
aegolius acadicus 34b v3 i1
Aegolius · mradermacher
Params35.4B
Context32K
Q4_K_M21.4 GB
GGUF
KO
koishi 8x7b qlora i1
Koishi · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
QW
Qwen3.5 40B Holodeck Claude Deckard Picard Heretic
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
AI
airoboros-65b-gpt4-m2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
LA
Laguna S 2.1 Heretic
Laguna · mradermacher
Params118B
Context1024K
Q4_K_M71.2 GB
GGUF
ME
Meditron3 70B
Meditron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
Nous Hermes 2 Mixtral 8x7B SFT Wikihow
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
OR
Ornstein 122 A10B
Ornstein · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
ReasoningVision
IN
InternVL3 78B Instruct
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingTool use
QW
Qwen3 Next 80B A3B Instruct Decensored i1
Qwen · Riyan200324200324
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
QW
Qwen3 Coder 480B A35B Instruct
Qwen · lmstudio-community
Params480B
Context256K
Q4_K_M290.8 GB
Coding
LL
Brinebreath Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
Mistral Large Instruct 2407
Mistral · second-state
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
KI
Qwopus3.5 122B A10B Kimi K2.6 Destill Healed Abliterated
Kimi · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
Vision
LL
Llama3 Med42 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3 Youko 70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
Mistral 2x24B MOE Power Devstral Magistral Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
CodingReasoning
OY
OYM Qimi 122B A10B K2.6
Oym · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
ReasoningTool useVision
OR
Ornith-1.5-35B
Ornith · gbuzhf
Params35.5B
Context256K
Smallest18.8 GB
GGUF
GO
GOAT 70B Storytelling
Goat · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · mradermacher
Params177B
Context256K
Smallest80.4 GB
Vision
FA
FashionGPT 70B V1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AR
ArcaneEntanglement model64 70b i1
Arcaneentanglement · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
dolphin-2.9-llama3-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
CodingTool use
LL
Llama EveningMirai 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
calme-2.2-llama3.1-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.6 35B A3B Abliterated Heretic BF16
Qwen · groxaxo
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
PE
perlthoughts_falkor-8x7b-moe
Perlthoughts · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF

Other sizes

Keep browsing