GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.75_0.5_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
NaoS2/qwen2.5-0.5B_linear_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top3000_noncreated
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
QW
komi77/qwen2.5-0.5B_educational_instruct_uni_5p-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top3000_en_ja
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
QW
magnifi/qwen2-rephrase-4bit-10-epochs
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
QW
Hachipo/qwen2.5-0.5B_MIFT-ja_manywords_8000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
MI
BarraHome/Mistroll-7B-v2.2
Mistroll · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
BI
liyinghong/BioQwen-1.8B
Bioqwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
YU
Yuma42/KangalKhan-Alpha-Rubyroid-7B-Fixed
Yuma · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Minirecord/Mini_DPO_test02
Mini · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GR
DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS
Grand · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.25_0.5_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Hachipo/qwen2.5-0.5B_PIFT-jaen_manywords_4000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen/Qwen2.5-Math-72B
Qwen · featherless-ai-quants
Params72.7B
Context4K
Q4_K_M47.4 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top3000_en-ja-2
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
KISTI-KONI/KONI-Llama3.1-8B-Instruct-20241024
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Seanxh/Qwen-Qwen1.5-1.8B-1717758501
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
FU
meetkai/functionary-medium-v3.2
Functionary · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
CE
Slomb/MN-CelesteGold-12B-Merge
Celestegold · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
HikariLight/Mistral_ACI_Bench_SFT
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
MaziyarPanahi/calme-2.5-qwen2-7b
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
AM
typeof/amall
Amall · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
benhaotang/llama3.2-1B-physics-finetuned
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
SO
saishf/SOVL-Mega-Mash-L3-8B
Sovl · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
adalbertojunior/Llama-3-8B-Dolphin-Portuguese-v0.3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
ME
memevis/try24
Memevis · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
TEL-LLM/gemma-2-2b-TEL-A
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
jtromero/qwen2-0.5b-lora-no-ff-aws
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
OwenArli/ArliAI-Llama-3-8B-Cumulus-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB