GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
HI
openaccess-ai-collective_hippogriff-30b-chat
Hippogriff · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
ME
adaptllm_medicine-llm
Medicine · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
Mixtral 11Bx2 MoE 19B
Mistral · TheBloke
Params19.2B
Context4K
Q4_K_M10.9 GB
GGUF
YI
mlinmg_sg-raccoon-yi-200k-2.0
Yi · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
GGUF
MI
arc53_docsgpt-7b-mistral
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
janhq_pandora-v1-13b
Pandora · TheBloke
Params12.5B
Context32K
Q4_K_M7.5 GB
GGUF
OP
rombodawg_open_gpt4_8x7b_v0.2
Open · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MA
MAmmoTH 70B
Mammoth · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
rossascends_mistral_7b_dolphin2.1_lima0.5_fp16
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
Noromaid 13B v0.1
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NU
nucleusai_nucleus-22b-token-500b
Nucleus · TheBloke
Params21.8B
Context2K
Q4_K_M13.2 GB
GGUF
NE
Nethena 20B
Nethena · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
TI
tigerresearch_tigerbot-70b-chat-v4
Tigerbot · TheBloke
Params69.5B
Context2K
Q4_K_M41.8 GB
GGUF
CO
Code 13B
Code · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Coding
AI
airoboros l2 13B 3.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OR
Orca2myth7.2
Orca · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
SQ
sqlcoder
Sqlcoder · TheBloke
Params15.8B
Context8K
Q4_K_M10.0 GB
Coding
SW
Swallow 7B Instruct
Swallow · TheBloke
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
PL
lilloukas_platypus-30b
Platypus · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
SY
migtissera_synthia-7b-v2.0
Synthia · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
openbuddy_openbuddy-mistral-7b-v13.1
Mistral · TheBloke
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
IN
Inkbot 13B 8k 0.2
Inkbot · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WI
WizardLM 70B V1.0
Wizardlm · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
FR
fredithefish_openzephyrchat-v0.2
Fredithefish · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LE
sanjiwatsuki_lelantos-7b
Lelantos · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
KU
Kuchiki 1.1 L2 7B
Kuchiki · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
NO
Noromaid 13B v0.2
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SC
ajibawa-2023_scarlett-7b
Scarlett · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
AK
Akins 3B
Akins · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
AI
airoboros l2 7B 2.2.1
Airoboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing