GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
CorticalStack neurotic crown clown 7b ties
Corticalstack · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JA
Jais Adapted 70b Chat
Jais · RichardErkhov
Params69.5B
Context4K
Q4_K_M41.8 GB
GGUF
OP
OpenCodeInterpreter-DS-6.7B
Opencodeinterpreter · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
LL
Llama 2 7b WikiChat
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GE
GeM2 Llamion 14B LongChat
Gem · RichardErkhov
Params14.5B
Context195K
Q4_K_M8.8 GB
GGUF
GR
Granite 8b Code Base
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
MI
bitext Mistral 7B Customer Support
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
rana shahroz mistral 7b roleplay alpaca merge
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
PH
migtissera Tess v2.5 Phi 3 medium 128k 14B
Phi · RichardErkhov
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
TO
tokyotech llm Swallow 7b instruct hf
Tokyotech · RichardErkhov
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
TH
The Trinity Coder 7B
The · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
TI
TinySolar-248m-4k-py
Tinysolar · RichardErkhov
Params248M
Context32K
Q4_K_M0.2 GB
GGUF
CO
ConfigurableBeagle-11B
Configurablebeagle · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
YI
Yi 1.5 34B 32K
Yi · RichardErkhov
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
MI
speechless-mistral-dolphin-orca-platypus-samantha-7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
allknowingroger CalmExperiment 7B slerp
Allknowingroger · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JP
jpacifico Chocolatine 14B Instruct DPO v1.2
Jpacifico · RichardErkhov
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
LL
hon9kon9ize Cantonese Llama 2 7B preview20240625
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Yi 34B 200K DARE Merge v7
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
LL
PiSSA Llama 2 7b R128
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OP
Openbuddy Yi1.5 34b v21.3 32k
Openbuddy · RichardErkhov
Params34.4B
Context128K
Q4_K_M20.7 GB
GGUF
GE
Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
NeuralHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
CL
ClaudioItaly Evolutionstory 7B v3.0
Claudioitaly · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
YuisekinAI Mistral 0.7B
Mistral · RichardErkhov
Params746M
Context4K
Q4_K_M0.5 GB
GGUF
MI
flammenai flammen15X mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
speechless-mistral-six-in-one-7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KU
Kukedlc NeuralSynthesis 7B v0.3
Kukedlc · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UM
Umievo Itr012 Gleipnir 7B
Umievo · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF

Keep browsing