GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
RO
rocket 3B
Rocket · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
NO
Nous Hermes 13B Code
Nous · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CodingTool use
AI
airoboros l2 7b gpt4 1.4.1
Airoboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TE
tenyx_tenyxchat-7b-v1
Tenyxchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
meta-math_metamath-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZA
Zarafusionex 1.1 L2 7B
Zarafusionex · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
EV
totally-not-an-llm_everythinglm-13b-v3-16k
Everythinglm · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
TO
TowerInstruct 7B v0.1
Towerinstruct · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
EH
ehartford_wizardlm-13b-v1.0-uncensored
Ehartford · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
YI
Nous Hermes 2 Yi 34B
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
LL
codellama_codellama-13b-python-hf
Llama · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
NO
Noromaid 20B v0.1.1
Noromaid · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
SO
SOLAR 10.7B Instruct v1.0
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SA
vagosolutions_sauerkrautlm-7b-hero
Sauerkrautlm · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TR
Trurl 2 13B
Trurl · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
stable code 3b
Stable · TheBloke
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
DP
openaccess-ai-collective_dpopenhermes-7b-v2
Dpopenhermes · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
AI
Airoboros L2 13B 3.1.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AI
jondurbin_airoboros-m-7b-3.1.2
Airoboros · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
Sakura SOLAR Instruct
Sakura · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MA
Magicoder S DS 6.7B
Magicoder · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DO
weyaxi_dolphin2.1-openorca-7b
Dolphin · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AT
Athnete 13B
Athnete · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
nondzu_mistral-7b-code-16k-qlora
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
TI
TimeCrystal L2 13B
Timecrystal · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
AR
ARIA 70B V2
Aria · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Coding
LL
LosslessMegaCoder Llama2 7B Mini
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
OP
rombodawg_open_gpt4_8x7b
Open · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
AU
Augmental 13B v1.50 B
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AI
Airoboros L2 70B GPT4 m2.0
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Keep browsing