GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
NE
Nethena 20B Glued
Nethena · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
MI
Amethyst 13B Mistral
Mistral · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CL
undi95_clover3-17b
Clover · TheBloke
Params16.8B
Context32K
Q4_K_M10.1 GB
XW
Xwin LM 7B V0.2
Xwin · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
CA
Camel Platypus2 70B
Camel · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
causallm_8x7b-moe-test-not-mixtral
Mistral · TheBloke
Params38B
Context32K
Q4_K_M22.1 GB
DI
dillfrescott_sonya-medium-x8-moe
Dillfrescott · TheBloke
Params69.9B
Context8K
Q4_K_M39.6 GB
MI
migtissera_synthia-34b-v1.2
Migtissera · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
openbuddy llama2 70B v13.2
Llama · TheBloke
Params69.1B
Context4K
Q4_K_M41.5 GB
AI
airoboros l2 7B 3.0
Airoboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
TI
gryphe_tiamat-7b-1.1-dpo
Tiamat · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
JA
openaccess-ai-collective_jackalope-7b
Jackalope · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
UN
Uni TianYan 70B
Uni · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama 2 7B LoRA Assemble
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
PS
PsyMedRP v1 13B
Psymedrp · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
YI
adamo1139_yi-34b-200k-aezakmi-v2
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
CH
Chronoboros Grad L2 13B
Chronoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
TU
allenai_tulu-30b
Tulu · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
JU
fblgit_juanako-7b-una
Juanako · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
PS
psyonic cetacean 20B
Psyonic · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
KI
Kimiko 7B
Kimi · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
EH
ehartford_based-7b
Ehartford · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
cgato_thespis-mistral-7b-v0.5
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
SY
Synthia 13B
Synthia · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
WI
WizardLM 13B 1.0
Wizardlm · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
ST
Stable Platypus2 13B
Stable · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
DI
dillfrescott_sonya-7b-x8-moe
Dillfrescott · TheBloke
Params46.7B
Context8K
Q4_K_M26.4 GB
ME
MetaMath 7B V1.0
Metamath · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
ME
MetaMath 70B V1.0
Metamath · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
EC
echidna tiefigther 25
Echidna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB