GGUF models by RichardErkhov
14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.
QW
Kukedlc Qwen2 1.5B Spanish 1.0
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
ME
merlinite-7b
Merlinite · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
suzume-llama-3-8B-multilingual-orpo-borda-top75
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
Phi 2 Insurance_Qa Sft Lora
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
SA
Sakura-SOLAR-Instruct-CarbonVillain-en-10.7B-v2-slerp
Sakura · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
mistral7b_ocr_to_json_v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GI
Gille StrangeMerges 32 7B slerp
Gille · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
mlfoundations dev llama3 1 8b oh v3.1 wo metamath 40k
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
google-gemma-2b-dequantized
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
MI
Mistrality-7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SE
selectorseb s2 oracle trained drone dataset
Selectorseb · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Magpie Align Llama 3 8B Magpie Align v0.1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
AmpleGCG Llama2 Sourced Llama2 7b Chat
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
BL
Bloom 1b1
Bloom · RichardErkhov
Params1.45B
Context2K
Q4_K_M1.0 GB
MI
Mistral-7B-Instruct-v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OpenCodeInterpreter SC2 3B
Opencodeinterpreter · RichardErkhov
Params3.18B
Context16K
Q4_K_M2.0 GB
MI
Ja ck Mistral instruct Y24 v5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
self-correct_Llama-3.2-3B-Instruct_metaMathQA_dpo_iter3
Llama · RichardErkhov
Params3.61B
Context128K
Q4_K_M2.2 GB
PH
sujithatz finbot phi3.5 merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
MI
avemio digital mistral continued training pre trained
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev mistral alpaca sft sample 3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen Encoder 0.5B
Qwen · RichardErkhov
Params494M
Context128K
Q4_K_M0.4 GB
OP
Open Instruct Stanford Alpaca 7b
Open · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
TR
trl internal testing tiny BloomForCausalLM
Trl · RichardErkhov
Params22M
Context—
Q4_K_M0.0 GB
DO
DongfuJiang prm version3 subsample hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
yujiepan QwQ tiny random
Qwen · RichardErkhov
Params11M
Context—
Q4_K_M0.0 GB
LI
lightblue reranker 0.5 cont filt 7max
Lightblue · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
MI
mlfoundations dev hp ablations mistral bsz256 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Hermes Instruct 7B 217K
Hermes · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
Yi Coder 1.5B Chat
Coder · RichardErkhov
Params1.48B
Context128K
Q4_K_M1.0 GB