GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
CH
Changgil/k2s3_test_24001
Changgil · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
LL
lemon07r/Llama-3-MahouDevil-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SL
crestf411/MN-Slush
Slush · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Hachipo/Qwen2.5-Coder-0.5B-Instruct_PIFT-jaen_manywords_2000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GE
justinxzhao/google-gemma-2b-it-dequantized
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
BU
Mihaiii/Bucharest-0.2
Bucharest · featherless-ai-quants
Params10.7B
Context6K
Q4_K_M6.5 GB
RE
jinaai/reader-lm-1.5b
Reader · featherless-ai-quants
Params1.54B
Context250K
Q4_K_M1.0 GB
MI
PIXMELT/Mistral-7B-Instruct-v0.2
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
Jeeeeeeeeeeeeeeez/my-tinyreco-model-new-data-bright10.2
Tinyreco · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
SO
megastudyedu/M-SOLAR-10.7B-v1.1-beta
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
Hachipo/qwen2.5-0.5B_MIFT-en_manywords_3000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
Ja-ck/llama-2-13b-instruct-Y24-v2
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
LL
rombodawg/test_dataset_Codellama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
isakovsh/llama-3-8b-chat-srtip
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
SEOKDONG/llama3.1_korean_v1.3_sft_by_aidx
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
T3Q-LLM/T3Q-LLM2-FP-v1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
AP
crumb/apricot-wildflower-20
Apricot · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
PJMixers/LLaMa-3-CursedStock-v1.6-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top3000_pythonblock_en-ja
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GE
priyanshi27dixit/gemma2-sft-full
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Qwen/Qwen2.5-72B-Instruct
Qwen · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
SK
NovaSky-AI/Sky-T1-7B-step1
Sky · featherless-ai-quants
Params7.62B
Context4K
Q4_K_M4.7 GB
LL
KONIexp/v3_1_pt_ep1_sft_5_based_on_llama3_1_8b_last_data_20240921
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
OwenArli/ArliAI-Llama-3-8B-Instruct-ORPO-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
akjindal53244/Llama-3.1-Storm-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
google/gemma-2-2b-it
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
FA
hyokwan/familidata
Familidata · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GE
MergeBench/gemma-2-2b-it_instruction
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Fischerboot/LLama3-Lexi-Aura-3Some-SLERP-SLERP-ql-merge
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB