Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
SE
T Search
Search · IsValorum
Params35.5B
Context256K
Smallest15.2 GB
ReasoningVision
MI
Chinese Mixtral 8x7B
Mistral · RichardErkhov
Params46.9B
Context32K
Q4_K_M28.6 GB
GGUF
QW
Qwen3.8 Flash Coder APEX I MiniPlus V2.1
Qwen · IsValorum
Params42.6B
Context256K
Smallest21.8 GB
CodingReasoning
QW
Ornith 1.5 35B A3B Uncensored
Qwen · 0xKitkat
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
LL
gpt 4o distil Llama 3.3 70B Instruct PaperWitch heresy i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
FlashModel Qwen 3.6 35B A3B Maxed
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
NE
L3.3 Nevoria R1 70b
Nevoria · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
OR
Ornith 1.5 122B
Ornith · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
ReasoningTool use
QW
Qwen3.6 35B A3B Uncensored Genesis Final Safetensors
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
CL
Clover 35B A3B Preview GGUF IQ4 XS Mac
Clover · austindixson
Params34.7B
Context128K
Smallest18.9 GB
GGUF
DE
deepseek r1
DeepSeek · cortexso
Params70.6B
Context128K
Q4_K_M1.1 GB
Reasoning
QW
Qwen3.8 Flash Next PaoAI STRIX BALANCED 2
Qwen · PaoAI
Params177B
Context256K
Smallest78.3 GB
GGUF
MA
MAmmoTH2-8x7B
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
NE
NVIDIA Nemotron 3 Super 120B A12B APEX
Nemotron · mudler
Params121B
Context—
Smallest8.9 GB
GGUF
EU
Euryale L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
EU
Euryale 1.3 longLORA 70b rope8 32k fp16 i1
Euryale · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.5 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · FrosT-LyRo
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
IN
Internvl3-78B-Instruct
Internvl · unsloth
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingVision
LL
Llama 2 70B OASST 1 200
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
KA
karakuri-lm-8x7b-instruct-v0.1
Karakuri · mmnga
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
HU
Huihui CyberStrike OffSec 35B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Tool useVision
MI
Mistral Large Instruct 2407
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
NE
Nex N2.5 Pro
Nex · bartowski
Params396B
Context256K
Q4_K_M250.8 GB
Vision
KI
Kimi-K3
Kimi · hellohazime
Params1810B
Context1024K
Smallest441.4 GB
GGUF
CY
CyberStrike OffSec 35B
Cyberstrike · ahmedandaloes
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
MI
MiMo-V2.6-Pro-MOPD
Mimo · ggml-org
Params1020B
Context1024K
Smallest2.1 GB
Vision
KO
Kolibri 1 APEX
Kolibri · Myric
Params78.1B
Context—
Smallest0.4 GB
GGUF
HO
K2 Horizon MoVA 36B A4B
Horizon · ngquocvinh
Params37.4B
Context512K
Q4_K_M22.4 GB
GGUF
AI
aixsatoshi Ex karakuri 8x12B chat v1
Aixsatoshi · mmnga
Params81.5B
Context32K
Smallest17.1 GB
GGUF
QW
Trohrbaugh Qwen3.5 122B A10B Heretic
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
ReasoningTool use

Other sizes

Keep browsing