GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
MI
madatnlp/mist-enko-lora-2950
Mist · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
yuiseki/tinyllama-yo-wikipedia-1.5T-v0.1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.25_0.5_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
BE
hantempler101/beer
Beer · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
MO
Dava84/Mod2
Mod · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Hachipo/qwen2.5-0.5B_MIFT-en_top_2000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
MI
aloobun/bun_mistral_7b_v2
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
KONIexp/v3_1_pt_ep1_sft_5_based_on_llama3_1_70b_final_data_20241026
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s400_a100_layer15
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
upvantage/llama32-8b-gptcleaned-30k
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s200_a100_layer11
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
MA
GabrielMM/Math_SFT_v4_4ksteps
Math · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GE
nitinmahawadiwar/arnab_ft_gemma2_from_vm_st_v1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Gensyn/Qwen2.5-1.5B-Instruct
Qwen · featherless-ai-quants
Params1.54B
Context32K
Q4_K_M1.0 GB
MI
WebraftAI/synapsellm-7b-mistral-v0.4-preview2
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
williamlcn/gemmadpo7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
pavan01729/Merged_axolotl_llama3.1_GPT_Ai_5.0
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
IR
leafspark/Iridium-72B-v0.1
Iridium · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
MY
khKim/mytest
Mytest · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SF
skarnam/SFT_fft_Resta
Sft · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
AL
Alsebay/L3-test-2
Alsebay · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
nbeerbower/Llama-3.1-Saoirse-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
PO
Nitral-AI/Poppy_Porpoise-0.72-L3-8B
Poppy · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s400_a500_layer11
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
dariaL27/llama3-1b-gt-g-s-e
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
Telugu-LLM-Labs/Indic-gemma-2b-finetuned-sft-Navarasa-2.0
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
dmis-lab/llama-3-meerkat-70b-v1.0
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
SongTonyLi/Llama-3.2-1B-Instruct-CPT-D1_chosen-then-SFT-D2_chosen-pref-mix2
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
yentinglin/Llama-3-Taiwan-70B-Instruct
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB