Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Huihui Qwen3.5 35B A3B Claude 4.6 Opus abliterated Q4 K M
Qwen · cesarsal1nas
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · ggml-org
Params284B
Context—
Smallest10.8 GB
GGUF
OR
Ornith 1.0 35B APEX
Ornith · mudler
Params34.7B
Context256K
Smallest13.5 GB
Vision
SE
ByteDance Seed_Seed OSS 36B Instruct
Seed · lmstudio-community
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
EU
Euryale 1.4 L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · vcruz305
Params51.2B
Context256K
Q4_K_M2.8 GB
GGUF
MI
Midnight Miqu 70b v1.5
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.6 35B v2 MoE Ablit Heretic Uncensor Hermes MTP Vision FT
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningRoleplayTool use
QW
AgentWorld 35B A3B Heretic
Qwen · auttasak88
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
LI
Ling 3.1 Flash 1019
Ling · bartowski
Params572B
Context256K
Q4_K_M358.0 GB
ReasoningTool use
GL
Huihui GLM 5.2 abliterated
GLM · huihui-ai
Params754B
Context1024K
Smallest211.1 GB
GGUF
AP
Apodex 1.1 Mini
Apodex · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
Vision
IN
Infinity Parser2 Pro
Infinity · glebkudr
Params34.7B
Context256K
Smallest36.9 GB
Vision
NE
Nemotron 3.5 Super VL 120B A12B CYBER NVFP4
Nemotron · dealignai
Params124B
Context1024K
Smallest73.2 GB
ReasoningTool useVision
SY
Synthia 70B v1.2b
Synthia · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
FA
FashionGPT 70B V1.1
Fashiongpt · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
TU
tulu 2 70b i1
Tulu · mradermacher
Params69B
Context8K
Q4_K_M41.4 GB
GGUF
QW
hermes qwen3.5 35b a3b
Qwen · DJLougen
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool use
BE
34b beta2 i1
Beta · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
GGUF
QW
Qwen3.5-397B-A17B
Qwen · unsloth
Params403B
Context256K
Q4_K_M248.8 GB
Vision
PO
Poro 34B
Poro · TheBloke
Params35.1B
Context7K
Q4_K_M22.4 GB
Coding
NO
Nous Capybara 34B i1
Nous · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
AU
Aurelian v0.5 70b Rope8 32K Fp16
Aurelian · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
JA
Jais Adapted 70b Chat
Jais · RichardErkhov
Params69.5B
Context4K
Q4_K_M41.8 GB
GGUF
LA
latxa-70b-v1.2
Latxa · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
calme 2.1 qwen2 72b
Qwen · MaziyarPanahi
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
RavenX CyberAgent v6.2 Experimental
Qwen · deadbydawn101
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool use
LL
Llama-3-Patronus-Lynx-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
SW
Swallow-70b-instruct-hf
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
LI
Ling 3.0 flash Sante Uncensored
Ling · AtomicChat
Params127B
Context256K
Smallest61.1 GB
ReasoningTool use

Other sizes

Keep browsing