Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
HY
HyperNova 60B
Hypernova · mradermacher
Params58.7B
Context128K
Q4_K_M40.7 GB
YI
brucethemoose_capybara-tess-yi-34b-200k-dare-ties
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
MI
MiMo V2.6 Flash RL UNCENSORED IQ2S Down
Mimo · BattleGhost
Params310B
Context1024K
Smallest91.7 GB
MI
MiMo V2.6 Pro MOPD
Mimo · AesSedai
Params1020B
Context—
Smallest3.1 GB
LL
CodeLlama 70b Hf
Llama · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
QW
Qwen3 Coder Next Uncensored Heretic
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
DE
Deacon-34B
Deacon · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
FA
FashionGPT 70B V1.2 i1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
OR
Ornith 1.0 397B
Ornith · unsloth
Params397B
Context256K
Q4_K_M245.0 GB
MI
models--mistralai--Mixtral-8x22B-Instruct-v0.1
Mistral · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
LL
Llama 2 70B Ensemble v5
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · grainrigi
Params177B
Context256K
Smallest0.9 GB
LL
Llama-3-Groq-70B-Tool-Use
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
FlashModel Qwen 3.6 35B A3B Maxed
Qwen · flashback2k
Params35.5B
Context256K
Q4_K_M21.7 GB
AP
Apertus-70B-Instruct-2509
Apertus · unsloth
Params70.6B
Context64K
Q4_K_M43.7 GB
QW
Qwen2.5 72B Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
AU
AuroraRP 8x7B i1
Aurorarp · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
Mistral Small 4 119B 2603 GGUF HALO
Mistral · Beinsezii
Params119B
Context—
Smallest0.1 GB
GL
GLM 4.5 Air
GLM · bartowski
Params110B
Context128K
Q4_K_M73.5 GB
OR
Tiel Coder 35B A3B Genesis Hermes
Ornith · LuffyTheFox
Params34.7B
Context256K
Smallest20.2 GB
CA
CalibForge 35B A3B
Calibforge · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Ornith 1.0 35B
Llama · LordNeel
Params34.7B
Context256K
Q4_K_M21.2 GB
SW
Swallow-70b-NVE-instruct-hf
Swallow · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama 2 70B Orca 200k
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
Deepseek-V3.1-Terminus
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
LL
codellama_codellama-70b-hf
Llama · TheBloke
Params69B
Context16K
Q4_K_M41.4 GB
QW
Qwen3.5 35B A3B uncensored heretic
Qwen · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
DE
deepseek llm 67b chat
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB