GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
PA
neuralnovel_panda-7b-v0.1
Panda · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
conceptofmind_hermes-llongma-2-13b-8k
Hermes · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
Tool use
YI
SG Raccoon Yi 55B
Yi · TheBloke
Params55.6B
Context4K
Q4_K_M33.3 GB
GGUF
ME
m42-health_med42-70b
Med · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
LL
nousresearch_yarn-llama-2-70b-32k
Llama · TheBloke
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
PA
mihaiii_pallas-0.5-frankenmerge
Pallas · TheBloke
Params36B
Context195K
Q4_K_M21.6 GB
GGUF
CH
austism_chronos-wizardlm-uc-scot-st-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
NO
doctor-shotgun_nous-capybara-limarpv3-34b
Nous · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
LA
law chat
Law · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TI
jeff31415_tinyllama-1.1b-1t-openorca
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
PH
phi 2 orange
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
YI
taozi555_rpbird-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
FR
Free Sydney V2 13B
Free · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
EV
EverythingLM 13b V2 16K
Everythinglm · TheBloke
Params13B
Context—
Q4_K_M6.3 GB
GGUF
SY
migtissera_synthia-7b-v3.0
Synthia · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
intel_neural-chat-7b-v3-1
Neural · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Dolphin Llama2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SO
SOLARC MOE 10.7Bx4
Solarc · TheBloke
Params36B
Context4K
Q4_K_M20.4 GB
GGUF
MY
MythoLogic L2 13B
Mythologic · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PY
Pygmalion 2 13B SuperCOT
Pygmalion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SU
sustech_sus-chat-34b
Sus · TheBloke
Params34.4B
Context8K
Q4_K_M20.7 GB
GGUF
ME
steve-cse_mellogpt
Mellogpt · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
triadparty_deepmoney-34b-200k-base
Deepmoney · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
LL
Upstage Llama 2 70B instruct v2
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
NO
argilla_notux-8x7b-v1
Notux · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
PH
LMCocktail phi 2 v1
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
DE
openbuddy deepseek 67b v15 base
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
HA
potatooff_hamster-0.1
Hamster · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LE
sanjiwatsuki_lelantos-maid-dpo-7b
Lelantos · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TO
llm-agents_tora-code-7b-v1.0
Tora · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding

Keep browsing