GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
MI
Locutusque/Mistral-7B-SFT
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
minpeter/Llama-3.2-1B-AlternateTokenizer-chatml
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
aifeifei798/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
tuneai/Meta-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
EE
cwaud/ea2844eea0cce-8688-4e12-9786-0793d849b262
Eea · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
ME
EQUES/MedLLama3-JP-v2
Medllama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
HE
DreadPoor/Heart_Stolen-8B-Model_Stock
Heart · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
aisingapore/llama3.1-70b-cpt-sea-lionv3-instruct
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
SakanaAI/Llama-3-8B-Instruct-DB-Expert
Llama · featherless-ai-quants
Params8.03B
Context4K
Q4_K_M4.9 GB
MI
QuantumIntelligence/QI-mistral-7B-slerp
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
arshadshk/Mistral-Hinglish-7B-Instruct-v0.2
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
anakin87/gemma-2-2b-neogenesis-ita
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
TI
elijahww/TinyLlama-1.1B-merged
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
aimlresearch2023/llama-3.2-1b-it-merged-llama-factory
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
SEOKDONG/llama3.1_korean_v1.6_sft_by_aidx
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
TU
chujiezheng/tulu-2-dpo-13b-ExPO
Tulu · featherless-ai-quants
Params13B
Context8K
Q4_K_M7.9 GB
GE
Buuhzerah/gemma-code-2b-instruct-finetune-test
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
AL
Alsebay/test-model-v2
Alsebay · featherless-ai-quants
Params10.7B
Context8K
Q4_K_M6.5 GB
TI
SakanaAI/TinySwallow-1.5B-Instruct
Tinyswallow · featherless-ai-quants
Params1.54B
Context32K
Q4_K_M1.0 GB
MI
CorticalStack/mistral-7b-tak-stack-dpo
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
ByteResearch/Llama-3-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
pansophic/pansophic-1-preview-LLaMA3.1-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
maywell/Llama-3-Ko-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
bunnycore/Gemma-2-2B-Smart
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
ZE
heegyu/zephyr-7b-beta-KOR-OpenOrca-Platypus-1e-5
Zephyr · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
decem/Dionysus-Mistral-m3-v6
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
FR
freewheelin/free-solar-evo-v0.1
Free · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GE
xriminact/Gemma-2-2b-it-chat-lessons
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Hachipo/qwen2.5-0.5B_PIFT-jaen_manywords_1000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
destinyzxj/llama-3-chinese-8b-instruct-v3-accident
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB