GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
guirrock/gemma-Finetune-bloom-taxonomy
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
SY
migtissera/Synthia-7B-v3.0
Synthia · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
hyokwan/familidata_llama31
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Hachipo/qwen2.5-0.5B_educational_instruct_pythonblock_en_2000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.15_0.05_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
mlgawd/gemma2b-it-cyberdost
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
wisenut-nlp-team/wisenut-llama-3-8B-0.5-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TE
Rama-adi/test-merge
Test · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
GE
AMindToThink/gemma-2-2b-it_RMU_s100_a100_layer11
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
AQ
saucam/aqua-smaug-0.3-8B
Aqua · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.05_0.15_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
FU
minchyeom/Furina-experimental
Furina · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
NeverSleep/Llama-3-Lumimaid-70B-v0.1-OAS
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
NanQiangHF/llama3_8b_instruct_bwgenerator
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LA
AXEUS/LATMOv0
Latmov · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
QW
e-palmisano/Qwen2-0.5B-ITA-Instruct
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
smjain/student-qwen
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
magnifi/qwen2-classify-12-epochs
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
SP
Haon-Chen/speed-synthesis-8b-senior
Speed · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Orion-zhen/Llama3-70B-Orion-Chinese
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
GE
burtenshaw/gemma-help-tiny-sft
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
akshit-Gupta/qwenfinal_merged-FinetunedByAG
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
LL
omsr/llama-31-hhrlhf-squad-rlhf-policy-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
GE
AMindToThink/gemma-2-2b-it_RMU_s200_a500_layer11
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
FI
jinv2/finetuned-zhengding-tourism
Finetuned · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_PIFT-jaen_manywords_6000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
AXCXEPT/EZO-Qwen2.5-72B-Instruct
Qwen · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
KI
genne/kiwi_solar_merge_slerp_test_v1
Kiwi · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
BI
danyoung/billie
Billie · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.05_0.15_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF

Keep browsing