Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · bartowski
Params34.4B
Context32K
Q4_K_M20.7 GB
MI
Nous Hermes 2 Mixtral 8x7B SFT
Mistral · second-state
Params46.7B
Context32K
Q4_K_M28.4 GB
DE
DeepSeek V4 Flash
DeepSeek · persadian
Params229B
Context1024K
Smallest61.5 GB
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.9 GB
LL
ShiningValiant
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama MagicalGirl i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Cogito-V2-Preview-Llama-109B-Moe
Llama · unsloth
Params108B
Context256K
Q4_K_M65.4 GB
LL
CodeLlama 70b Python Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
ZA
Zawen v0.1 35B A3B
Zawen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
AP
Apex 35B V1.0
Apex · prithivMLmods
Params35.5B
Context256K
Smallest18.6 GB
LL
Hermes 3 Llama 3.1 70B
Llama · NousResearch
Params70.6B
Context128K
Q4_K_M42.5 GB
IS
Ising Calibration 1 35B A3B
Ising · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Whittle Qwen 3.8 35B A3B
Qwen · el4
Params35.5B
Context256K
Smallest17.3 GB
MO
MoMo 70B V1.1 i1
Momo · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen2 VL 72B Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
LI
Ling-3.0-flash
Ling · inclusionAI
Params127B
Context256K
Q4_K_M77.0 GB
LL
ORCA LLaMA 70B QLoRA
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
YI
brucethemoose_yi-34b-200k-dare-merge-v5
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
BE
34b beta
Beta · MaziyarPanahi
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
llava v1.6 34B
LLaVA · cjpais
Params34.4B
Context4K
Q4_K_M20.7 GB
PA
mihaiii_pallas-0.3
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Nous-Hermes-2-Yi-34B
Yi · duyntnet
Params34.4B
Context4K
Q4_K_M20.7 GB
FR
Franqwenstein 35b
Franqwenstein · mradermacher
Params34.7B
Context128K
Q4_K_M21.0 GB
DE
DeepSeek V4 Flash
DeepSeek · ggml-org
Params284B
Context—
Smallest4.7 GB
CO
c4ai-command-r-v01
Command R · qwp4w3hyb
Params35B
Context128K
Q4_K_M21.5 GB
LL
Llama 3.X Workout 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
TU
allenai_tulu-2-dpo-70b
Tulu · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
EX
K EXAONE 236B A23B
Exaone · mradermacher
Params236B
Context256K
Q4_K_M143.5 GB
LL
Meta Llama 3 70B Instruct
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
EU
L3.3 70B Euryale v2.3 Heretic
Euryale · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB