GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
tmd-rahul/tinyllama-chatbot-merged
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
NickyNicky/TinyDolphin-2.8-1.1b_oasst2_chatML_Cluster_1_V1
Tinydolphin · featherless-ai-quants
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
MI
kaist-ai/mistral-orpo-capybara-7k
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
yuiseki/tinyllama-ja-wikipedia-scp-1.5T-v0.1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
ST
Luni/StarDust-12b-v2
Stardust · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Fischerboot/LLama3-Lexi-Aura-3Some-SLERP-SLERP
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
WI
maldv/winter-garden-7b-alpha
Winter · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LI
erfanzar/LinguaMatic-1B
Linguamatic · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TE
twololing1/TestingChip
Testingchip · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MC
williamlcn/6851_mcq_8_4_new_format_combined
Mcq · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
OP
Locutusque/OpenCerebrum-1.0-7b-SFT
Opencerebrum · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TE
chenluuli/test-text-vis
Test · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
LL
Shaleen123/llama-3.1-8b-reasoning
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
MI
hamxea/Mistral-7B-v0.1-activity-fine-tuned-v5
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MY
MoaData/Myrrh_solar_10.7b_2.0
Myrrh · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
SakanaAI/Llama-3-8B-Instruct-Coding-Expert
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
fradinho/llama-mistral
Llama · featherless-ai-quants
Params7.24B
Context2K
Q4_K_M4.4 GB
GGUF
MI
uukuguy/speechless-mistral-hermes-code-7b
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
AR
saucam/Arithmo-Wizard-2-7B
Arithmo · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Munia-ak/llama-2-7b-miniguanaco
Llama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TR
Muhammad2003/TriMistral-7B-MODELSTOCK
Trimistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
shleeeee/mistral-ko-exo-mrc-v1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
theminji/TinyLlama-Casual1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
SO
w4r10ck/SOLAR-10.7B-Instruct-v1.0-uncensored
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
nbeerbower/llama-3-wissenschaft-8B-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen/Qwen2-1.5B-Instruct
Qwen · featherless-ai-quants
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
nawhgnuj/DonaldTrump-Llama3.1-8B-Chat
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
HODACHI/Llama-3-EZO-8b-Common-it
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
WE
CultriX/Wernicke-7B-dpo
Wernicke · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
hfl/llama-3-chinese-8b-instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing