Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
QW
Huihui Qwen3.5 35B A3B Claude 4.6 Opus abliterated Q4 K M
Qwen · cesarsal1nas
Params34.7B
Context256K
Q4_K_M21.2 GB
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · ggml-org
Params284B
Context—
Smallest10.8 GB
OR
Ornith 1.0 35B APEX
Ornith · mudler
Params34.7B
Context256K
Smallest13.5 GB
SE
ByteDance Seed_Seed OSS 36B Instruct
Seed · lmstudio-community
Params36.2B
Context512K
Q4_K_M21.8 GB
EU
Euryale 1.4 L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen3.8 Flash Next
Qwen · vcruz305
Params51.2B
Context256K
Q4_K_M2.8 GB
MI
Midnight Miqu 70b v1.5
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
QW
Qwen3.6 35B v2 MoE Ablit Heretic Uncensor Hermes MTP Vision FT
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
AgentWorld 35B A3B Heretic
Qwen · auttasak88
Params34.7B
Context256K
Q4_K_M21.2 GB
LI
Ling 3.1 Flash 1019
Ling · bartowski
Params572B
Context256K
Q4_K_M358.0 GB
GL
Huihui GLM 5.2 abliterated
GLM · huihui-ai
Params754B
Context1024K
Smallest211.1 GB
AP
Apodex 1.1 Mini
Apodex · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
IN
Infinity Parser2 Pro
Infinity · glebkudr
Params34.7B
Context256K
Smallest36.9 GB
NE
Nemotron 3.5 Super VL 120B A12B CYBER NVFP4
Nemotron · dealignai
Params124B
Context1024K
Smallest73.2 GB
SY
Synthia 70B v1.2b
Synthia · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
FA
FashionGPT 70B V1.1
Fashiongpt · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
TU
tulu 2 70b i1
Tulu · mradermacher
Params69B
Context8K
Q4_K_M41.4 GB
QW
hermes qwen3.5 35b a3b
Qwen · DJLougen
Params34.7B
Context256K
Q4_K_M21.2 GB
BE
34b beta2 i1
Beta · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
QW
Qwen3.5-397B-A17B
Qwen · unsloth
Params403B
Context256K
Q4_K_M248.8 GB
PO
Poro 34B
Poro · TheBloke
Params35.1B
Context7K
Q4_K_M22.4 GB
NO
Nous Capybara 34B i1
Nous · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
AU
Aurelian v0.5 70b Rope8 32K Fp16
Aurelian · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
JA
Jais Adapted 70b Chat
Jais · RichardErkhov
Params69.5B
Context4K
Q4_K_M41.8 GB
LA
latxa-70b-v1.2
Latxa · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
QW
calme 2.1 qwen2 72b
Qwen · MaziyarPanahi
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
RavenX CyberAgent v6.2 Experimental
Qwen · deadbydawn101
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Llama-3-Patronus-Lynx-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
SW
Swallow-70b-instruct-hf
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
LI
Ling 3.0 flash Sante Uncensored
Ling · AtomicChat
Params127B
Context256K
Smallest61.1 GB