GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
ChocoLlama/Llama-3-ChocoLlama-8B-instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
OwenArli/ArliAI-Llama-3-8B-Dolfin-v0.5
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
4yo1/llama3-eng-ko-8b-sl4
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
chheplo/dhenu2-in-climate-llama3.2-1b
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
AI-Sweden-Models/Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
etri-xainlp/SOLAR-10.7B-merge-dpo
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
wkshin89/mistral-7b-instruct-ko-test-v0.2
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
TU
allenai/tulu-v2.5-dpo-13b-uf-mean
Tulu · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
LL
p208p2002/llama-3-zhtw-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MC
williamlcn/6851_mcq_128_32_new_format
Mcq · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
mzbac/llama-3-8B-Instruct-function-calling
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SA
SuperAGI/SAM
Sam · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Muadil/Llama-3.2-1B-Instruct_sum_DPO_10k_1_2ep_4bit
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
NE
Weyaxi/neural-chat-7b-v3-1-Nebula-v2-7B
Neural · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
jamesohe/Llama3-CAS-Audit8B-GCNI-V3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
ZE
giux78/zefiro-7b-sft-qlora-ITA-v0.5
Zefiro · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CorticalStack/mistral-7b-distilabel-truthy-dpo
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Gensyn/Qwen2.5-0.5B-Instruct
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
MI
adonlee/Mistral_7B_SFT_DPO_v0
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
allknowingroger/PrometheusLaser-7B-slerp
Allknowingroger · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
KU
SanjiWatsuki/Kunoichi-DPO-7B
Kunoichi · featherless-ai-quants
Params7.24B
Context8K
Q4_K_M4.4 GB
HE
Weyaxi/HelpSteer-filtered-Solar-Instruct
Helpsteer · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
wang7776/Mistral-7B-Instruct-v0.2-sparsity-30-v0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
sanghwa-na/llama2-13b.kor
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
QW
Hachipo/qwen2.5-0.5B_evol_instruct_mini
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
ppuuttyy/llm-project
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
unsloth/mistral-7b
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Kukedlc/NeuralKuke-4-All-7b
Neuralkuke · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Hachipo/qwen2.5-0.5B_MIFT-ja_manywords_2000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
MF
netcat420/MFANNv0.20.12
Mfannv · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB