GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
TitanML/Qwen2-0.5B-Instruct
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
RE
GitBag/rebel_ultrafeedback_armo_OneBatch_newprob_full_lr_3e-7_eta_1e6_bs_128_1722343397
Rebel · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
AliMaatouk/LLama-3-8B-Tele
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen/Qwen2.5-Math-72B-Instruct
Qwen · featherless-ai-quants
Params72.7B
Context4K
Q4_K_M47.4 GB
Tool use
GE
jena-shreyas/gemma-2-2b-it-sft-dare
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
silent666/Qwen-Qwen1.5-1.8B-1718022339
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
QW
unsloth/Qwen2-0.5B
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
LL
duyhv1411/Llama-3.2-1B-en-vi
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
OwenArli/ArliAI-Llama-3-8B-Dolfin-v0.2-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
hdve/Qwen-Qwen1.5-1.8B-1718162486
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
MI
mtc/upstage-SOLAR-10.7B-v1.0-classification-with-mixtral-explanation-3-epochs-finetuned
Mistral · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
maldv/badger-kappa-llama-3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KA
Himitsui/Kaiju-11B
Kaiju · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_PPO_Skywork_10k_1_2ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-5_1.0_0.25_0.25_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
XE
Xenon1/Xenon-3
Xenon · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
AMindToThink/gemma-2-2b_RMU_s400_a100_layer3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Hastagaras/Halu-8B-Llama3-Blackroot
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
clinicalnlplab/finetuned-Llama-2-13b-hf-MedQA
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
besimray/test-llama
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
CH
williamlcn/chatmodsft
Chatmodsft · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LI
Saxo/Linkbricks-Horizon-AI-Korean-Advanced-12B
Linkbricks · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
GE
AMindToThink/gemma-2-2b_RMU_s200_a500_layer3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
KA
NilanE/karasu-web-2
Karasu · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
youjunhyeok/llama3-8B-dpo-sft-v1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
SEOKDONG/llama3.1_korean_v1.1_sft_by_aidx
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AT
invisietch/Atlantis-v0.1-12B
Atlantis · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
NESPED-GEN/Llama-3.2-text2SQL-indentacao
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
meta-llama/Meta-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
flammenai/Mahou-1.1-mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing