GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 2 13B LoRA Assemble
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
FU
tomgrc_fusionnet_34bx2_moe
Fusionnet · TheBloke
Params60.8B
Context32K
Q4_K_M36.7 GB
GGUF
LL
openassistant_llama2-13b-megacode2-oasst
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
AM
Amethyst 13B
Amethyst · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CL
claude2 alpaca 7B
Claude · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SP
Spicyboros c34b 2.2
Spicyboros · TheBloke
Params33.7B
Context4K
Q4_K_M20.2 GB
GGUF
MI
undi95_mistral-11b-cc-air-rp
Mistral · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
MI
pulsarai_slimopenorca-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
mlabonne_neuralbeagle14-7b
Neuralbeagle · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AQ
AquilaChat2 34B 16K
Aquilachat · TheBloke
Params33.7B
Context4K
Q4_K_M20.3 GB
GGUF
IA
Iambe RP DARE 20B DENSE
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
VI
kevinpro_vicuna-7b-cot
Vicuna · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
CA
camel-ai_camel-13b-combined-data
Camel · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
AL
ALMA 7B Pretrain
Alma · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OL
v1olet_v1olet_marcoroni-go-bruins-merge-7b
Olet · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
herman555_dolphin-2.2.1-ashhlimarp-mistral-7b-gguf
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
Noromaid 13B v0.1.1
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ME
mihaiii_metis-0.5
Metis · TheBloke
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF
MI
weyaxi_metamath-neuralhermes-2.5-mistral-7b-linear
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
SA
sethuiyer_dr_samantha-7b
Samantha · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
QU
quantumaikr_quantum-dpo-v0.1
Quantum · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
openerotica_cockatrice-7b-v0.1
Cockatrice · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
opus v0 70B
Opus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PL
Platypus2 70B
Platypus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PL
Platypus2 13B
Platypus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AM
U Amethyst 20B
Amethyst · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
OR
orca mini v3 70B
Orca · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
nsql llama 2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
EM
Emerhyst 20B
Emerhyst · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
PS
PsyMedRP v1 20B
Psymedrp · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF

Keep browsing