Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
LL
Cogito v1 Preview Llama 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Hermes-2-Theta-Llama-3-70B-32k
Llama · mradermacher
Params70.6B
Context32K
Q4_K_M42.5 GB
RE
Reasoner Hermes3 70b
Reasoner · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.8 Flash Next Uncensored ROCmFP4 FAST
Qwen · kingjones777
Params177B
Context256K
Smallest94.4 GB
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Smaug-Llama-3-70B-Instruct-32K
Llama · mradermacher
Params70.6B
Context32K
Q4_K_M42.5 GB
MI
MiniMax M2.5 REAP 172B A10B i1
Minimax · mradermacher
Params173B
Context192K
Q4_K_M104.4 GB
QW
Qwen3.8 Flash Next
Qwen · bitlamas
Params177B
Context256K
Smallest102.5 GB
QW
Qwen3.8 Flash Next
Qwen · Myric
Params177B
Context256K
Smallest91.7 GB
ET
steelskull_etheria-55b-v0.1
Etheria · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
YI
Dolphin 2.2 Yi 34B
Yi · second-state
Params34.4B
Context16K
Q4_K_M20.7 GB
EV
Eva Mindlink 72b
Eva · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
QW
Deepwen 3.6
Qwen · quimmedes
Params34.7B
Context256K
Smallest10.1 GB
SE
T Search
Search · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
IQ
IQuest Coder V1 40B Thinking Heretic
Iquest · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
MI
Mixtral-8x22B-v0.1
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
QW
dolphin 2.9.2 qwen2 72b
Qwen · dphn
Params72.7B
Context128K
Q4_K_M47.4 GB
OM
Omega Sapphira L3.3 70B v1.3
Omega · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
YI
Faro Yi 34B 200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
QW
Qwen3 Coder 57B
Qwen · mradermacher
Params56.6B
Context256K
Q4_K_M34.4 GB
SI
Simsema_Small 4 119B 32226
Simsema · mradermacher
Params119B
Context1024K
Q4_K_M72.2 GB
IN
InnoSpark3.0 397B q8
Innospark · innospark
Params396B
Context256K
Smallest290.8 GB
QW
Qwen1.5 55B Chat Cut i1
Qwen · mradermacher
Params54.8B
Context32K
Q4_K_M33.3 GB
AI
airoboros-70b-3.3
Airoboros · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GP
Gpt Oss 120b
gpt-oss · SoAIHQ
Params117B
Context128K
Smallest65.4 GB
CA
Cathallama 70B
Cathallama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
SE
senku-70b
Senku · NexesQuants
Params69B
Context32K
Smallest14.1 GB
LA
Laguna-S-2.1
Laguna · ggml-org
Params118B
Context1024K
Q4_K_M67.7 GB
P1
P1 VL 235B A22B
axi0mX
Params235B
Context256K
Q4_K_M142.2 GB
DE
CyberNeurova DeepSeek V4 Flash abliterated
DeepSeek · cyberneurova
Params284B
Context1024K
Smallest98.8 GB