GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
12thD/ko-Llama-3-8B-sft-v0.3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
grimjim/llama-3-Nephilim-v2.1-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
shleeeee/mistral-ko-OpenOrca-Platypus-v1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
KnutJaegersberg/MistralInstructLongish
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
CooolDude/TinyLlama_v1.1_finetuned_oscar_ru_65k_examples_test_gone_wrong
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
KU
HyunCello/KULLM3-empathy-v1.0
Kullm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
ZE
royallab/ZephRP-m7b
Zephrp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
InferenceIllusionist/Excalibur-7b-DPO
Excalibur · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
Jeeeeeeeeeeeeeeez/my-tinyreco-model-new-data-bright10.4
Tinyreco · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
AL
Alsebay/model-test-3
Alsebay · featherless-ai-quants
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
LU
mrcuddle/Lumimaid-v0.2-8B
Lumimaid · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AL
allknowingroger/StarlingMaxLimmy2-7B-slerp
Allknowingroger · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Wengwengwhale/llama-3.1-8B-Instruct-finance-analyst
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
PetterLee/Meta-Llama-3-8B-Instruct-finetuned-backdoor-100
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SK
NovaSky-AI/Sky-T1-32B-Preview
Sky · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
LL
jdqqjr/llama3-8b-instruct-uncensored-JR-sft
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
MergeMerge/Gemma2-2B-Tulu3-SFT-Personas-Code
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
TI
Jeeeeeeeeeeeeeeez/my-tinyreco-model-new-data-bright11
Tinyreco · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
shleeeee/mistral-ko-7b-tech
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
etri-xainlp/llama2-13b-lima-sft-dpo
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Cognitive-Lab/LLama3-Gaja-Hindi-8B-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
uukuguy/speechless-thoughts-mistral-7b
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Herry443/Mistral-7B-KNUT-ref-ALL
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
AIdenU/Mistral-7B-v0.2-ko-Y24_v2.0
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
RituGujela100/gemma-qlora-customer-support
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
TI
ambrosfitz/tinyllama-history-chat_v0.2
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
erhj3eh3ehweg/mini-pozor
Mini · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
CO
williamlcn/6851_64_32_0321_combined
Combined · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
proxectonos/Llama-3.1-Carballo
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
FU
meetkai/functionary-small-v3.1
Functionary · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing