GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
PA
neuralnovel_panda-7b-v0.1
Panda · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
conceptofmind_hermes-llongma-2-13b-8k
Hermes · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
YI
SG Raccoon Yi 55B
Yi · TheBloke
Params55.6B
Context4K
Q4_K_M33.3 GB
ME
m42-health_med42-70b
Med · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
LL
nousresearch_yarn-llama-2-70b-32k
Llama · TheBloke
Params69B
Context32K
Q4_K_M41.4 GB
PA
mihaiii_pallas-0.5-frankenmerge
Pallas · TheBloke
Params36B
Context195K
Q4_K_M21.6 GB
CH
austism_chronos-wizardlm-uc-scot-st-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
NO
doctor-shotgun_nous-capybara-limarpv3-34b
Nous · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
LA
law chat
Law · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
TI
jeff31415_tinyllama-1.1b-1t-openorca
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
PH
phi 2 orange
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
YI
taozi555_rpbird-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
FR
Free Sydney V2 13B
Free · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
EV
EverythingLM 13b V2 16K
Everythinglm · TheBloke
Params13B
Context—
Q4_K_M6.3 GB
SY
migtissera_synthia-7b-v3.0
Synthia · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
intel_neural-chat-7b-v3-1
Neural · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Dolphin Llama2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
SO
SOLARC MOE 10.7Bx4
Solarc · TheBloke
Params36B
Context4K
Q4_K_M20.4 GB
MY
MythoLogic L2 13B
Mythologic · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
PY
Pygmalion 2 13B SuperCOT
Pygmalion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SU
sustech_sus-chat-34b
Sus · TheBloke
Params34.4B
Context8K
Q4_K_M20.7 GB
ME
steve-cse_mellogpt
Mellogpt · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
triadparty_deepmoney-34b-200k-base
Deepmoney · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
Upstage Llama 2 70B instruct v2
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
NO
argilla_notux-8x7b-v1
Notux · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
PH
LMCocktail phi 2 v1
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
DE
openbuddy deepseek 67b v15 base
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
HA
potatooff_hamster-0.1
Hamster · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LE
sanjiwatsuki_lelantos-maid-dpo-7b
Lelantos · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
TO
llm-agents_tora-code-7b-v1.0
Tora · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB