GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
TW
mlabonne/TwinLlama-3.1-8B-DPO
Twinllama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
kz919/sliding_llama3_8b_instruct_no_finetune
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
imone/Llama-3-8B-fixed-special-embedding
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
justinxzhao/google-gemma-2b-dequantized
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
SO
etri-xainlp/SOLAR-10.7B-sft-dpo-v1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
AZ
Abhishek107/Azure_metric_log1
Azure · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GE
MergeMerge/gemma-2-2B-allenai-tulu-3-sft-codealpaca
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
CA
FelixChao/Capricorn-7B-DPO
Capricorn · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
Eric111/SOLAR-10.7B-Instruct-v1.0-DPO
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
shleeeee/mistral-ko-OpenOrca-2000
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GH
ghost-x/ghost-8b-beta
Ghost · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
SEOKDONG/llama3.1_korean_v1.5_sft_by_aidx
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
saishf/Merge-Mayhem-L3-V2.1
Merge · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
YA
yam-peleg/Experiment21-7B
Yam · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
etri-xainlp/llama2-13b-sft-dpo
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
AR
aryashah00/survey-finetuned-tinyllama-for-deployment
Aryashah · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
NY
tannedbum/L3-Nymeria-8B
Nymeria · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
12thD/I-SOLAR-10.7B-sft-v0.1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
RE
jinaai/reader-lm-0.5b
Reader · featherless-ai-quants
Params494M
Context250K
Q4_K_M0.4 GB
SI
ABX-AI/Silver-Sun-v2-11B
Silver · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
PH
Sayan01/Phi3-TL-ORCAMEL-Skew-1-0.25
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
HY
Locutusque/hyperion-medium-preview
Hyperion · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
Deepnoid/deep-solar-Rev-v2.0.4
Deepnoid · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
shitshow123/mistral7b_sft_dpo
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
Gille/StrangeMerges_49-7B-dare_ties
Strangemerges · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
HY
hyokwan/hkcode_solar_10.7b
Hyokwan · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
CO
raidhon/coven_7b_128k_orpo_alpha
Coven · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
Jeeeeeeeeeeeeeeez/my-tinyreco-model-new-data-bright12
Tinyreco · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
FlagAlpha/Llama3-Chinese-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB