GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
RJ1200/llama-3-fine_tuned_C
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
TI
yuiseki/tinyllama-zh-wikipedia-aya-1.5T-v0.1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
dushuai112233/Qwen2-0.5B-Instruct
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top9000_codeonly
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.25_0.25_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
princeton-nlp/Llama-3-Base-8B-SFT-IPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
g-ronimo/llama3-8b-SlimHermes
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Nisk36/DPO_gemma_ojousamachosen
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_selec5000_pythonblock_dataselection_en
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s100_a1200_layer11
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
AGI-0/Artificium-llama3.1-8B-001
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
lex-hue/Delexa-V0.1-7b
Delexa · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s100_a500_layer3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
MI
shleeeee/mistral-ko-exo-wiki-quiz-v1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
KONIexp/v3_1_pt_ep1_sft_5_based_on_llama3_1_8b_50_per_data_20240918
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
mikhaelcohen/llama-31-hhrlhf-squad-rlhf-policy-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
richmondsin/finetuned-gemma-2-2b-output-layer-20-16k-4
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
DiscoResearch/Llama3_DiscoLM_German_8b_v0.1_experimental
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Omartificial-Intelligence-Space/al-baka-16bit-llama3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
xxxxxccc/mediaDescr_2epoch_Mistral-Nemo-Base-2407_model
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GA
GasAslan/C1-3
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s100_a1200_layer15
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
choco58/LLaMAdelic
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
xxxxxccc/climate_framestance_5epoch_Mistral-Nemo-Base-2407_model
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s200_a500_layer15
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
jknottllm/Meta-Llama-3-8B-Instruct-FineTuned
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
NE
allura-org/TQ2.5-14B-Neon-v1
Neon · featherless-ai-quants
Params14.8B
Context128K
Q4_K_M9.0 GB
LL
ArliAI/Llama-3.3-70B-ArliAI-RPMax-v1.4
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.15_0.25_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
MI
spow12/Mistral-Nemo-Instruct-2407_sft_ver_4.4
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB