GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
MX
MXLewd L2 20B
Mxlewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
PI
maywell_pivot-0.1-early
Pivot · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
LLaMA Pro 8B Instruct
Llama · TheBloke
Params8.36B
Context4K
Q4_K_M5.1 GB
GGUF
VI
lmsys_vicuna-13b-v1.5-16k
Vicuna · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
ME
epfl-llm_meditron-7b
Meditron · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
nkpz_llama2-22b-daydreamer-v3
Llama · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
GGUF
MI
macadeliccc_laser-dolphin-mixtral-2x7b-dpo
Mistral · TheBloke
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
CH
Chinese Alpaca 2 13B
Chinese · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
CO
Code 290k 13B
Code · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Coding
TO
llm-agents_tora-code-13b-v1.0
Tora · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
MI
jphme_em_german_mistral_v01
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LO
LongAlpaca 70B
Longalpaca · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PR
prometheus 7B v1.0
Prometheus · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ME
meditron 70B
Meditron · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
XW
Xwin LM 70B V0.1
Xwin · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
NE
intel_neural-chat-7b-v3-2
Neural · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
Noromaid 13B v0.3
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
bavest_fin-llama-33b-merged
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
DA
abideen_darevox-7b
Darevox · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
TU
allenai_tulu-2-dpo-7b
Tulu · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
LL
flozi00_llama-2-13b-german-assistant-v4
Llama · TheBloke
Params13.1B
Context2K
Q4_K_M7.9 GB
GGUF
MI
openpipe_mistral-ft-optimized-1227
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
ShiningValiant 1.2
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
uukuguy_speechless-mistral-moloras-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SP
uukuguy_speechless-tora-code-7b-v1.0
Speechless · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
OP
s4sch_open-hermes-2.5-neural-chat-3.1-frankenmerge-11b
Open · TheBloke
Params11.4B
Context32K
Q4_K_M6.8 GB
Tool use
MI
cognitivecomputations_dolphin-2.6-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
CodingTool use
MA
tiger-lab_mammoth-coder-13b
Mammoth · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
OR
Orca 2 13B SFT v5
Orca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Coding
OP
dreamgen_opus-v0-7b
Opus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing