Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
HY
HyperNova 60B
Hypernova · mradermacher
Params58.7B
Context128K
Q4_K_M40.7 GB
Tool use
YI
brucethemoose_capybara-tess-yi-34b-200k-dare-ties
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
MI
MiMo V2.6 Flash RL UNCENSORED IQ2S Down
Mimo · BattleGhost
Params310B
Context1024K
Smallest91.7 GB
ReasoningTool use
MI
MiMo V2.6 Pro MOPD
Mimo · AesSedai
Params1020B
Context—
Smallest3.1 GB
GGUF
LL
CodeLlama 70b Hf
Llama · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
Coding
QW
Qwen3 Coder Next Uncensored Heretic
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Coding
DE
Deacon-34B
Deacon · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
FA
FashionGPT 70B V1.2 i1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
OR
Ornith 1.0 397B
Ornith · unsloth
Params397B
Context256K
Q4_K_M245.0 GB
GGUF
MI
models--mistralai--Mixtral-8x22B-Instruct-v0.1
Mistral · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
LL
Llama 2 70B Ensemble v5
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · grainrigi
Params177B
Context256K
Smallest0.9 GB
GGUF
LL
Llama-3-Groq-70B-Tool-Use
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
QW
FlashModel Qwen 3.6 35B A3B Maxed
Qwen · flashback2k
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
AP
Apertus-70B-Instruct-2509
Apertus · unsloth
Params70.6B
Context64K
Q4_K_M43.7 GB
GGUF
QW
Qwen2.5 72B Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
AU
AuroraRP 8x7B i1
Aurorarp · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
Roleplay
MI
Mistral Small 4 119B 2603 GGUF HALO
Mistral · Beinsezii
Params119B
Context—
Smallest0.1 GB
GGUF
GL
GLM 4.5 Air
GLM · bartowski
Params110B
Context128K
Q4_K_M73.5 GB
GGUF
OR
Tiel Coder 35B A3B Genesis Hermes
Ornith · LuffyTheFox
Params34.7B
Context256K
Smallest20.2 GB
CodingTool useVision
CA
CalibForge 35B A3B
Calibforge · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
LL
Ornith 1.0 35B
Llama · LordNeel
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
SW
Swallow-70b-NVE-instruct-hf
Swallow · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama 2 70B Orca 200k
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
DE
Deepseek-V3.1-Terminus
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
GGUF
LL
codellama_codellama-70b-hf
Llama · TheBloke
Params69B
Context16K
Q4_K_M41.4 GB
Coding
QW
Qwen3.5 35B A3B uncensored heretic
Qwen · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
DE
deepseek llm 67b chat
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF

Other sizes

Keep browsing