Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 35B A3B Kazakh
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3.8 Flash Next 99B A5B Niwaki 3bit
Qwen · neopolita
Params105B
Context256K
Smallest42.5 GB
GGUF
AI
airoboros 34b 3.3
Airoboros · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
RoleplayTool use
GR
GRM 3.2 Sky Abliterated
Grm · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
AU
Aurora Code 1
Aurora · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Coding
MI
Nous-Hermes-2-Mixtral-8x7B-DPO
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
SE
Seed OSS 36B Base
Seed · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
LL
CodeLlama 70B Instruct
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Coding
NE
Nex N2.5 mini Uncensored
Nex · orcarouter
Params34.7B
Context256K
Smallest12.9 GB
ReasoningTool useVision
MI
Nous-Hermes-2-Mixtral-8x7B-SFT
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
AI
airoboros l2 70b 2.2
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
SO
SorcererLM 8x22b iMat
Sorcererlm · Quant-Cartel
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
HU
Huihui4 48B A4B Abliterated
Huihui · mradermacher
Params48B
Context256K
Q4_K_M32.0 GB
GGUF
SP
SpatialAxiom 35B A3B
Spatialaxiom · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
PA
mihaiii_pallas-0.5-laser-0.6
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Qwen2-57B-A14B-Instruct
Qwen · legraphista
Params57.4B
Context32K
Smallest21.1 GB
GGUF
LL
TheDrummer Fallen Llama 3.3 R1 70B v1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
QW
Qwen3 Next 80B A3B Thinking GRPO Uncensored
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.5 GB
Reasoning
VA
Valkyrie 49B v2
Valkyrie · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
QW
Qwen3 Coder Next Abliterated
Qwen · Riyan200324200324
Params79.7B
Context256K
Q4_K_M48.6 GB
Coding
QW
Qwen3 42B A3B 2507 TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoning
LL
Llama-3-70B-Synthia-v3.5
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
IN
Index Translate 35B A3B Preview
Index · alphaZimuth
Params35.5B
Context256K
Smallest12.5 GB
Vision
MI
doctor-shotgun_mixtral-8x7b-instruct-v0.1-limarp-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
Mistral Medium 3.5 128B Desiccated
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
GGUF
CI
70B L3.3 Cirrus X1
Cirrus · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
AR
AREX Base
Arex · bartowski
Params122B
Context256K
Q4_K_M74.9 GB
ReasoningTool useVision
QW
Qwen3.8 Flash Next REAM 60Pct
Qwen · mradermacher
Params129B
Context256K
Q4_K_M87.0 GB
GGUF
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties HighDensity
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
MI
miqu 1 70b
Miqu · miqudev
Params69B
Context32K
Q4_K_M41.4 GB
GGUF

Other sizes

Keep browsing