GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
Nethena 20B Glued
Nethena · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
MI
Amethyst 13B Mistral
Mistral · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CL
undi95_clover3-17b
Clover · TheBloke
Params16.8B
Context32K
Q4_K_M10.1 GB
GGUF
XW
Xwin LM 7B V0.2
Xwin · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CA
Camel Platypus2 70B
Camel · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
causallm_8x7b-moe-test-not-mixtral
Mistral · TheBloke
Params38B
Context32K
Q4_K_M22.1 GB
GGUF
DI
dillfrescott_sonya-medium-x8-moe
Dillfrescott · TheBloke
Params69.9B
Context8K
Q4_K_M39.6 GB
GGUF
MI
migtissera_synthia-34b-v1.2
Migtissera · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
LL
openbuddy llama2 70B v13.2
Llama · TheBloke
Params69.1B
Context4K
Q4_K_M41.5 GB
GGUF
AI
airoboros l2 7B 3.0
Airoboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TI
gryphe_tiamat-7b-1.1-dpo
Tiamat · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JA
openaccess-ai-collective_jackalope-7b
Jackalope · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UN
Uni TianYan 70B
Uni · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama 2 7B LoRA Assemble
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
PS
PsyMedRP v1 13B
Psymedrp · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
YI
adamo1139_yi-34b-200k-aezakmi-v2
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
CH
Chronoboros Grad L2 13B
Chronoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TU
allenai_tulu-30b
Tulu · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
JU
fblgit_juanako-7b-una
Juanako · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PS
psyonic cetacean 20B
Psyonic · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
KI
Kimiko 7B
Kimi · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
EH
ehartford_based-7b
Ehartford · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
cgato_thespis-mistral-7b-v0.5
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SY
Synthia 13B
Synthia · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WI
WizardLM 13B 1.0
Wizardlm · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
ST
Stable Platypus2 13B
Stable · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DI
dillfrescott_sonya-7b-x8-moe
Dillfrescott · TheBloke
Params46.7B
Context8K
Q4_K_M26.4 GB
GGUF
ME
MetaMath 7B V1.0
Metamath · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ME
MetaMath 70B V1.0
Metamath · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
EC
echidna tiefigther 25
Echidna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing