Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
FU
functionary medium v2.4
Functionary · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
AT
Athene V2 Chat
Athene · bartowski
Params73B
Context32K
Q4_K_M47.4 GB
GGUF
MI
orangetin_openhermes-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
Tool use
LL
Meta-Llama-3-70B-Instruct-abliterated-v3.5
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
UN
una xaberius 34b v1beta
Una · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
LL
Llama 3.1 70B Instruct Jbliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
DE
DeepSeek V3 Bf16
DeepSeek · bullerwins
Params671B
Context160K
Q4_K_M404.4 GB
Tool use
FL
Flint-40B-A2.5B-abliterated
Flint · dima6312
Params39.8B
Context256K
Smallest22.9 GB
CodingReasoningTool use
MI
MiniMax M3.1 Flash StrixHalo
Minimax · Harsha001
Params313B
Context1024K
Smallest96.6 GB
ReasoningTool use
QW
Qwen3.8 KAT AgentWorld 35B A3B Coder
Qwen · pragmaticcs
Params34.7B
Context256K
Q4_K_M21.2 GB
CodingReasoningTool use
BA
weyaxi_bagel-hermes-2x34b
Bagel · TheBloke
Params60.8B
Context195K
Q4_K_M36.7 GB
Tool use
QW
Qwen3.6 35B A3B TinyKV
Qwen · darioooooo0o
Params35.5B
Context256K
Q4_K_M22.1 GB
ReasoningTool use
MI
MiniMax M2
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.6 GB
GGUF
LL
Llama 3.3 Swallow 70B Instruct v0.4
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
OpenMath2 Llama3.1 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
OD
L3-Odyssey-70B
Odyssey · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
MO
Steelskull L3.3 Mokume Gane R1 70b v1.1
Mokume · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
QW
Qwen3.8 Flash Next
Qwen · Guile
Params177B
Context256K
Q4_K_M119.6 GB
Vision
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoningTool use
MI
MiMo V2.6 Flash MOPD NVFP4
Mimo · ProCreations
Params310B
Context1024K
Smallest4.2 GB
Coding
QW
Qwen2.5 6x7B Six Pack Coder Instruct 38B
Qwen · mradermacher
Params42B
Context32K
Q4_K_M25.4 GB
Coding
YI
Yi 70B 200k RPMerge Franken
Yi · mradermacher
Params71.2B
Context195K
Q4_K_M42.6 GB
GGUF
OR
Ornith 1.5 35B Uncensored YMQ MTP
Ornith · zerodigest
Params35.5B
Context256K
Smallest12.0 GB
Vision
YI
blossom v3 1 yi 34b
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
AL
ALIA 40b Instruct 2601
Alia · mradermacher
Params40.4B
Context160K
Q4_K_M24.6 GB
Reasoning
QW
Qwen3 Coder Next Heretic
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Coding
CO
c4ai-command-r-v01
Command R · bartowski
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
LL
Llama 4 Scout 17B 16E Instruct
Llama · mradermacher
Params108B
Context10240K
Smallest22.2 GB
GGUF
EV
L3.3 MS Evayale 70B
Evayale · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
UnifiedReward 2.0 Qwen 72b
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision

Other sizes

Keep browsing