Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · bartowski
Params34.4B
Context32K
Q4_K_M20.7 GB
CodingTool use
MI
Nous Hermes 2 Mixtral 8x7B SFT
Mistral · second-state
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
DE
DeepSeek V4 Flash
DeepSeek · persadian
Params229B
Context1024K
Smallest61.5 GB
CodingReasoningTool use
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.9 GB
GGUF
LL
ShiningValiant
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama MagicalGirl i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Cogito-V2-Preview-Llama-109B-Moe
Llama · unsloth
Params108B
Context256K
Q4_K_M65.4 GB
Vision
LL
CodeLlama 70b Python Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Coding
ZA
Zawen v0.1 35B A3B
Zawen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningRoleplayTool use
AP
Apex 35B V1.0
Apex · prithivMLmods
Params35.5B
Context256K
Smallest18.6 GB
ReasoningTool useVision
LL
Hermes 3 Llama 3.1 70B
Llama · NousResearch
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
IS
Ising Calibration 1 35B A3B
Ising · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Whittle Qwen 3.8 35B A3B
Qwen · el4
Params35.5B
Context256K
Smallest17.3 GB
Reasoning
MO
MoMo 70B V1.1 i1
Momo · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen2 VL 72B Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Vision
LI
Ling-3.0-flash
Ling · inclusionAI
Params127B
Context256K
Q4_K_M77.0 GB
GGUF
LL
ORCA LLaMA 70B QLoRA
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
YI
brucethemoose_yi-34b-200k-dare-merge-v5
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
BE
34b beta
Beta · MaziyarPanahi
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
LL
llava v1.6 34B
LLaVA · cjpais
Params34.4B
Context4K
Q4_K_M20.7 GB
Vision
PA
mihaiii_pallas-0.3
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Nous-Hermes-2-Yi-34B
Yi · duyntnet
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
FR
Franqwenstein 35b
Franqwenstein · mradermacher
Params34.7B
Context128K
Q4_K_M21.0 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · ggml-org
Params284B
Context—
Smallest4.7 GB
GGUF
CO
c4ai-command-r-v01
Command R · qwp4w3hyb
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
LL
Llama 3.X Workout 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
TU
allenai_tulu-2-dpo-70b
Tulu · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
GGUF
EX
K EXAONE 236B A23B
Exaone · mradermacher
Params236B
Context256K
Q4_K_M143.5 GB
GGUF
LL
Meta Llama 3 70B Instruct
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
EU
L3.3 70B Euryale v2.3 Heretic
Euryale · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Other sizes

Keep browsing