GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
QW
magnifi/qwen2-rephrase-classify-reverse-5-epochs
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
TE
Envoid/L3-TenyxChat-Daybreak-Storywriter-RAE-70B
Tenyxchat · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.5_0.5_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
AMindToThink/gemma-2-2b_RMU_s200_a100_layer3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
beomi/gemma-ko-2b
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
NE
saishf/Neural-SOVLish-Devil-8B-L3
Neural · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
NE
adalbertojunior/NeuralDaredevil-Dolphin-Portuguese
Neuraldaredevil · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
richmondsin/finetuned-gemma-2-2b-output-layer-20-4k-3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
MI
flammenai/Mahou-1.3-mistral-nemo-12B
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
NousResearch/Meta-Llama-3-8B-Alternate-Tokenizer
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
jsk0214/Seagull-llama-3-8B-orpo-v0.4
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
OL
lodrick-the-lafted/Olethros-8B
Olethros · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
unsloth/Hermes-3-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
MC
williamlcn/6851_mcq_16_16_fixed
Mcq · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
beomi/Llama-3-KoEn-8B-Instruct-preview
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.75_0.75_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
AXCXEPT/Llama-3-EZO-8b-Common-it
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
OwenArli/ArliAI-Llama-3-8B-Instruct-DPO-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Redgalaxy2/gemma-reformat_text-Finetune-2
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
JA
bardsai/jaskier-7b-dpo
Jaskier · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
NaoS2/qwen2.5-0.5B_drop_freq30_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.5_0.25_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Hachipo/qwen2.5-0.5B_PIFT-enja_manywords_4000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
AN
yifanxie/angry-pelican-1-1
Angry · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
TE
migtissera/Tess-7B-v1.4
Tess · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
princeton-nlp/Llama-3-Instruct-8B-ORPO-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
JesseLiu/llama_re098
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
NE
netcat420/MFANNv0.13.10
Netcat · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
LL
mesolitica/malaysian-llama-3-8b-instruct-16k-post
Llama · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
JA
bardsai/jaskier-7b-dpo-v6.1
Jaskier · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB