GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
cognitivecomputations_dolphin-2.6-mistral-7b-dpo-laser
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
LE
Lemur 70B Chat v1
Lemur · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Coding
LL
togethercomputer_llama-2-7b-32k-instruct
Llama · TheBloke
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
ME
q-bert_metamath-cybertron-starling
Metamath · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WI
ehartford_wizard-vicuna-30b-uncensored
Wizard · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
LL
openassistant_llama2-13b-orca-8k-3319
Llama · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
LL
ehartford_samantha-1.11-codellama-34b
Llama · TheBloke
Params33.7B
Context2K
Q4_K_M20.2 GB
Coding
JA
japanese stablelm instruct beta 70B
Japanese · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PY
Python Code 13B
Python · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Coding
LL
Llama 2 Coder 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
AI
jondurbin_airoboros-m-7b-3.1
Airoboros · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MY
MythoLogic Mini 7B
Mythologic · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AI
Airoboros L2 70B 3.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SA
SauerkrautLM UNA SOLAR Instruct
Sauerkrautlm · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
NO
argilla_notus-7b-v1
Notus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
01-ai_yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
WI
monero_wizardlm-uncensored-supercot-storytelling-30b
Wizardlm · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
KU
sanjiwatsuki_kunoichi-7b
Kunoichi · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MY
Mythalion 13B
Mythalion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AI
Airoboros L2 70B 2.1 Creative
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
norquinal_mistral-7b-claude-chat
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
undi95_mixtral-8x7b-moe-rp-story
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
Roleplay
GU
Guanaco 13B Uncensored
Guanaco · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OP
openchat_openchat_3.5
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Nous Hermes Llama2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
MI
jphme_em_german_leo_mistral
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AS
asclepius-13b
Asclepius · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
OP
openchat_openchat-3.5-0106
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
NE
Nethena 13B
Nethena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
paixai_astrid-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing