GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
TR
Muhammad2003/TriMistral-7B-TIES
Trimistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
Trappu/Magnum-Picaro-0.7-v2-12b
Magnum · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
dganochenko/llama-3-8b-chat
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
JS
johnsnowlabs/JSL-MedLlama-3-8B-v1.0
Jsl · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
THUDM/LongWriter-llama3.1-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
TI
yuiseki/tinyllama-si-wikipedia-1.5T-v0.1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
ST
bunnycore/Starling-dolphin-E26-7B
Starling · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Kukedlc/NeuralExperiment-7b-MagicCoder-v7.5
Neuralexperiment · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
XN
automerger/T3qm7xNeuralsirkrishna-7B
Xneuralsirkrishna · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
beomi/Llama-3-Open-Ko-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Ja-ck/llama-2-13b-instruct-Y24-v1
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
QW
Hachipo/Qwen2.5-Coder-0.5B-Instruct_MIFT-en_manywords_2000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
MI
nazimali/Mistral-Nemo-Kurdish-Instruct
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
BI
lamm-mit/BioinspiredLlama-3-8B
Bioinspiredllama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
TU
allenai/tulu-v2.5-ppo-13b-uf-mean
Tulu · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GH
ghost-x/ghost-7b-v0.9.1
Ghost · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
IG
NeuralNovel/Ignis-7B-DPO
Ignis · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
Locutusque/lr-experiment1-7B
Experiment · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
WE
giraffe176/WestLake_Noromaid_OpenHermes_neural-chatv0.1
Westlake · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
HINT-lab/llama3-8b-final-ppo-m-v0.3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
NE
Kukedlc/Neural-4-ARC-7b
Neural · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Hachipo/Qwen2.5-Coder-0.5B-Instruct_MIFT-ja_manywords_2000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
TsinghuaC3I/Llama-3-8B-UltraMedical
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
dddsaty/SOLAR-Instruct-ko-Adapter-Attach
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
TI
Narednra/tinyllama2_updated
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
typeof/tiny-llama-1b-py
Llama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
SO
PracticeLLM/SOLAR-tail-10.7B-instruct-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
unsloth/Qwen2.5-Math-7B-Instruct
Qwen · featherless-ai-quants
Params7.62B
Context4K
Q4_K_M4.7 GB
SO
Cartinoe5930/SOLAR-10.7B-iDUS
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
Qwen/Qwen2-0.5B-Instruct
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB