GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
MI
akjindal53244_arithmo-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
teknium_airoboros-mistral2.2-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
pipizhao_pandalyst-7b-v1.1
Pandalyst · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
Mistral Pygmalion 7B
Mistral · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
AI
jondurbin_airoboros-c34b-2.1
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
MI
severian_anima-phi-neptune-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
UN
ajibawa-2023_uncensored-jordan-7b
Uncensored · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
OP
openthaigpt 1.0.0 beta 13B chat
Openthaigpt · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
LL
CodeUp Llama 2 13B Chat HF
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
nousresearch_yarn-llama-2-7b-64k
Llama · TheBloke
Params6.74B
Context64K
Q4_K_M4.1 GB
YI
brucethemoose_capybara-tess-yi-34b-200k-dare-ties
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
Llama 2 70B Ensemble v5
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
upstage_llama-30b-instruct-2048
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
MO
pclanglais_monadgpt
Monadgpt · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
DP
openaccess-ai-collective_dpopenhermes-7b
Dpopenhermes · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
Airoboros L2 13B 2.2
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SY
maywell_synatra-7b-v0.3-rp
Synatra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 2 70B Orca 200k
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
codellama_codellama-70b-hf
Llama · TheBloke
Params69B
Context16K
Q4_K_M41.4 GB
DE
deepseek llm 67b chat
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
AI
aidc-ai-business_marcoroni-7b-v3
Aidc · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
emrgnt-cmplxty_mistral-7b-phibrarian-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
AN
sao10k_ana-v1-m7
Ana · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
ALMA 13B Pretrain
Alma · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AI
Airoboros 33B 2.1
Airoboros · TheBloke
Params32.5B
Context4K
Q4_K_M19.6 GB
SO
Solar 10.7B SLERP
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
AI
airoboros l2 70B GPT4 2.0
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama 2 13B Chat Dutch
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CO
COTHuginn 4.5 19B
Cothuginn · TheBloke
Params19.4B
Context4K
Q4_K_M11.7 GB
OP
weyaxi_openchat-3.5-1210-seraph-slerp
Openchat · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB