GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
MX
MXLewd L2 20B
Mxlewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
PI
maywell_pivot-0.1-early
Pivot · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
LLaMA Pro 8B Instruct
Llama · TheBloke
Params8.36B
Context4K
Q4_K_M5.1 GB
VI
lmsys_vicuna-13b-v1.5-16k
Vicuna · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
ME
epfl-llm_meditron-7b
Meditron · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
nkpz_llama2-22b-daydreamer-v3
Llama · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
MI
macadeliccc_laser-dolphin-mixtral-2x7b-dpo
Mistral · TheBloke
Params12.9B
Context32K
Q4_K_M7.8 GB
CH
Chinese Alpaca 2 13B
Chinese · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
CO
Code 290k 13B
Code · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
TO
llm-agents_tora-code-13b-v1.0
Tora · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
MI
jphme_em_german_mistral_v01
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LO
LongAlpaca 70B
Longalpaca · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
PR
prometheus 7B v1.0
Prometheus · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
ME
meditron 70B
Meditron · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
XW
Xwin LM 70B V0.1
Xwin · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
NE
intel_neural-chat-7b-v3-2
Neural · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
Noromaid 13B v0.3
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
bavest_fin-llama-33b-merged
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
DA
abideen_darevox-7b
Darevox · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
TU
allenai_tulu-2-dpo-7b
Tulu · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
LL
flozi00_llama-2-13b-german-assistant-v4
Llama · TheBloke
Params13.1B
Context2K
Q4_K_M7.9 GB
MI
openpipe_mistral-ft-optimized-1227
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
ShiningValiant 1.2
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
uukuguy_speechless-mistral-moloras-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
SP
uukuguy_speechless-tora-code-7b-v1.0
Speechless · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
OP
s4sch_open-hermes-2.5-neural-chat-3.1-frankenmerge-11b
Open · TheBloke
Params11.4B
Context32K
Q4_K_M6.8 GB
MI
cognitivecomputations_dolphin-2.6-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MA
tiger-lab_mammoth-coder-13b
Mammoth · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
OR
Orca 2 13B SFT v5
Orca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
OP
dreamgen_opus-v0-7b
Opus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB