Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.5 35B A3B Kazakh
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.8 Flash Next 99B A5B Niwaki 3bit
Qwen · neopolita
Params105B
Context256K
Smallest42.5 GB
AI
airoboros 34b 3.3
Airoboros · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GR
GRM 3.2 Sky Abliterated
Grm · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
AU
Aurora Code 1
Aurora · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
MI
Nous-Hermes-2-Mixtral-8x7B-DPO
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
SE
Seed OSS 36B Base
Seed · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
LL
CodeLlama 70B Instruct
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
NE
Nex N2.5 mini Uncensored
Nex · orcarouter
Params34.7B
Context256K
Smallest12.9 GB
MI
Nous-Hermes-2-Mixtral-8x7B-SFT
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
AI
airoboros l2 70b 2.2
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
SO
SorcererLM 8x22b iMat
Sorcererlm · Quant-Cartel
Params141B
Context64K
Q4_K_M85.6 GB
HU
Huihui4 48B A4B Abliterated
Huihui · mradermacher
Params48B
Context256K
Q4_K_M32.0 GB
SP
SpatialAxiom 35B A3B
Spatialaxiom · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
PA
mihaiii_pallas-0.5-laser-0.6
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Qwen2-57B-A14B-Instruct
Qwen · legraphista
Params57.4B
Context32K
Smallest21.1 GB
LL
TheDrummer Fallen Llama 3.3 R1 70B v1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3 Next 80B A3B Thinking GRPO Uncensored
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.5 GB
VA
Valkyrie 49B v2
Valkyrie · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
QW
Qwen3 Coder Next Abliterated
Qwen · Riyan200324200324
Params79.7B
Context256K
Q4_K_M48.6 GB
QW
Qwen3 42B A3B 2507 TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
LL
Llama-3-70B-Synthia-v3.5
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
IN
Index Translate 35B A3B Preview
Index · alphaZimuth
Params35.5B
Context256K
Smallest12.5 GB
MI
doctor-shotgun_mixtral-8x7b-instruct-v0.1-limarp-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
Mistral Medium 3.5 128B Desiccated
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
CI
70B L3.3 Cirrus X1
Cirrus · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
AR
AREX Base
Arex · bartowski
Params122B
Context256K
Q4_K_M74.9 GB
QW
Qwen3.8 Flash Next REAM 60Pct
Qwen · mradermacher
Params129B
Context256K
Q4_K_M87.0 GB
YI
CaPlatTessDolXaBoros Yi 34B 200K DARE Ties HighDensity
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
MI
miqu 1 70b
Miqu · miqudev
Params69B
Context32K
Q4_K_M41.4 GB