GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
MI
DrNicefellow/Mistral-4-from-Mixtral-8x7B-v0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.6 GB
KA
niryuu/Karasu-1.1b-task1357-vector
Karasu · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GE
kuanhoong/gemma-2b-mt-German-to-English-1
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
MI
DrNicefellow/Mistral-1-from-Mixtral-8x7B-v0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.6 GB
TI
haibh/TinyLlamaText2SQL_HASRND
Tinyllamatext · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
shanchen/llama3-8B-slerp-biomed-chat-chinese
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
Sayan01/Phi3-TL-ORCA-10
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
DE
deepnet/C00ReadyModel3
Deepnet · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Ahmad0067/llama-3-8b-Instruct-Referral_Synth_data_Phase_1_and_2_corect_unsloth_merged
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
IlyaGusev/saiga_llama3_8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
Ppoyaa/StarMonarch-7B
Starmonarch · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
LeroyDyer/Mixtral_AI_CyberCoder_7b
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SS
ssaryssane/ssary-solar-10.7B
Ssary · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
UN
fblgit/UNA-POLAR-10.7B-InstructMath-v2
Una · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
DA
0x0daughter1/g11c
Daughter · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
DA
Edentns/DataVortexS-10.7B-dpo-v1.12
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
TI
zizi917/tiny-forward-lora
Tiny · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
NI
Nitral-AI/Visual-LaylelemonMaidRP-7B
Nitral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
UN
fblgit/UNA-SOLAR-10.7B-Instruct-v1.0
Una · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
TI
yyassif/tinyllama-france-code-penal1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
TI
iujinasena/tinyllama-1_1b-conv
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
TI
lleticiasilvaa/TinyLlama1B-spider-v2-28000steps
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
PS
DaveGergern/13B-Psyfighter2-Erebus3-DareTies
Psyfighter · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
RA
Kukedlc/Ramakrishna-7b-v3
Ramakrishna · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Hachipo/Qwen2.5-0.5B_MIFT-ja_250
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
mylesgoose/Meta-Llama-3-8B-Instruct-abliterated
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
YA
yam-peleg/Experiment15-7B
Yam · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
etri-xainlp/SOLAR-10.7B-merge-dpo_v1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
ST
Gille/StrangeMerges_48-7B-dare_ties
Strangemerges · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
JA
shyamieee/JARVIS-v1.0
Jarvis · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB