General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Alif 1.0 8B Instruct
Llama · large-traversaal
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Einstein-v7-Qwen2-7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
PH
Phi 3.5 Mini Instruct
Phi · duyntnet
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
QW
Hemmingway 1 Uncensored Heretic
Qwen · OS-Software
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
YI
Yi 9B i1
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
FL
PornMaster flux2 klein 9b
Flux · cl0537furry
Params8.19B
Context256K
Q4_K_M5.0 GB
GGUF
OS
Osmosis Mcp 4b
Osmosis · osmosis-ai
Params4.41B
Context40K
Q4_K_M2.7 GB
GGUF
SO
SOLAR 10.7B Instruct v1.0
Solar · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
UN
UndiMix v2 13B
Undimix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
Neuron 46x4B Instruct
Neuron · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
Tool use
ME
Mega Destroyer 8x7B
Mega · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
LE
leolm_leo-hessianai-13b-chat
Leo · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
QW
ElisNovel V2 14B
Qwen · cyanelis
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
CY
Cydonia 24B v4.3
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
GGUF
CL
ClaudioItaly Evolutionstory 7B v3.0
Claudioitaly · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
YuisekinAI Mistral 0.7B
Mistral · RichardErkhov
Params746M
Context4K
Q4_K_M0.5 GB
GGUF
AI
airoboros l2 13B 2.2.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
NemoMix Unleashed 12B i1
Nemomix · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
flammenai flammen15X mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
Deepseek ai.DeepSeek V3.2 BF16
DeepSeek · DevQuasar
Params670B
Context160K
Q4_K_M404.5 GB
GGUF
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · bullerwins
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
HE
Hemlock Philter 14B
Hemlock · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
HU
Hunyuan MT Chimera 7B
Hunyuan · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
GE
gemma 4 E2B it qat MTP
Gemma · magnitudedev
Params77M
Context128K
Smallest0.1 GB
GGUF
BU
Buddy E4B v2
Buddy · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
GGUF
OE
Oellm 9b 128k Theta32M
Oellm · mradermacher
Params9.1B
Context128K
Q4_K_M5.7 GB
GGUF
GP
Gpt2 Large
Gpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
LI
Ling-3.0-tiny-base-30T
Ling · FriskyFennec
Params8.2B
Context8K
Q4_K_M5.0 GB
GGUF
WI
WizardLM-2-7B-abliterated
Wizardlm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Other uses

Keep browsing