Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
MI
Minimax-M2.7
Minimax · mudler
Params230B
Context192K
Smallest69.1 GB
NE
Nemotron 3.5 Bolt 74B A9B 24GB Metal
Nemotron · UraionLabs
Params74B
Context256K
Smallest24.2 GB
QW
Qwen3.5 122B A10B Abliterated
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
NO
argilla_notux-8x7b-v1
Notux · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
LL
Llama-3-Groq-70B-Tool-Use
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
KI
Kimi Linear REAP 35B A3B Instruct i1
Kimi · mradermacher
Params35B
Context1024K
Q4_K_M21.3 GB
GR
Grug 35B A3B
Grug · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
DE
openbuddy deepseek 67b v15 base
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
KW
KwaiCoder AutoThink Preview
Kwaicoder · bartowski
Params40.6B
Context32K
Q4_K_M24.6 GB
LL
Llama3 OpenBioLLM 70B i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
openbuddy-llama3-70b-v21.2-32k
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
AI
airoboros-2.2.1-limarpv3-y34b
Airoboros · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
LE
leolm_leo-hessianai-70b-chat
Leo · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
QW
Qwen3.8 Flash Next
Qwen · zerodigest
Params132B
Context256K
Smallest63.3 GB
BE
Behemoth T1 123B
Behemoth · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
AS
astrollama 2 70b base aic
Astrollama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
MO
MoMo 70B V1.1
Momo · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GE
L3.3 GeneticLemonade Opus 70B
Geneticlemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Midnight Miqu 70B v1.0
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
QW
Qwen3 Yoyo V4 42B A3B Thinking TOTAL RECALL PKDick V
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
QW
Qwen3.6 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
LA
Laguna S 2.1
Laguna · bartowski
Params118B
Context1024K
Q4_K_M71.8 GB
NE
Neuron 46x4B
Neuron · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
MI
open-orca_mixtral-slimorca-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
Mixtral 8x7B Instruct v0.1
Mistral · second-state
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Qwen3 53B A3B 2507 THINKING TOTAL RECALL v2 MASTER CODER
Qwen · mradermacher
Params53B
Context256K
Q4_K_M32.1 GB
MI
Minimax-M2.5
Minimax · mudler
Params229B
Context192K
Smallest85.9 GB
DE
DeepSeek V3 0324
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M404.4 GB
AL
ALIA 40b Fc 2606
Alia · mradermacher
Params40.4B
Context160K
Q4_K_M24.6 GB
LL
dolphin-2.9.1-llama-3-70b
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB