GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
LL
Llama 2 13B LoRA Assemble
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
FU
tomgrc_fusionnet_34bx2_moe
Fusionnet · TheBloke
Params60.8B
Context32K
Q4_K_M36.7 GB
LL
openassistant_llama2-13b-megacode2-oasst
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
AM
Amethyst 13B
Amethyst · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CL
claude2 alpaca 7B
Claude · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
SP
Spicyboros c34b 2.2
Spicyboros · TheBloke
Params33.7B
Context4K
Q4_K_M20.2 GB
MI
undi95_mistral-11b-cc-air-rp
Mistral · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
pulsarai_slimopenorca-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
mlabonne_neuralbeagle14-7b
Neuralbeagle · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
AQ
AquilaChat2 34B 16K
Aquilachat · TheBloke
Params33.7B
Context4K
Q4_K_M20.3 GB
IA
Iambe RP DARE 20B DENSE
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
VI
kevinpro_vicuna-7b-cot
Vicuna · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
CA
camel-ai_camel-13b-combined-data
Camel · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
AL
ALMA 7B Pretrain
Alma · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
OL
v1olet_v1olet_marcoroni-go-bruins-merge-7b
Olet · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
herman555_dolphin-2.2.1-ashhlimarp-mistral-7b-gguf
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
Noromaid 13B v0.1.1
Noromaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ME
mihaiii_metis-0.5
Metis · TheBloke
Params7.24B
Context128K
Q4_K_M4.4 GB
MI
weyaxi_metamath-neuralhermes-2.5-mistral-7b-linear
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
sethuiyer_dr_samantha-7b
Samantha · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
QU
quantumaikr_quantum-dpo-v0.1
Quantum · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
openerotica_cockatrice-7b-v0.1
Cockatrice · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
opus v0 70B
Opus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
PL
Platypus2 70B
Platypus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
PL
Platypus2 13B
Platypus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AM
U Amethyst 20B
Amethyst · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
OR
orca mini v3 70B
Orca · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
nsql llama 2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
EM
Emerhyst 20B
Emerhyst · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
PS
PsyMedRP v1 20B
Psymedrp · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB