GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
ST
v000000/L3.1-Storniitova-8B
Storniitova · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
MergeMerge/Gemma2-2B-Tulu3-SFT-Personas-Math-MATH
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QR
TeeZee/Qra-13B-chat
Qra · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
LL
MaziyarPanahi/Llama-3-8B-Instruct-v0.9
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
akshit-Gupta/qwen199f16_merged-FinetunedByAG
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
AI
jondurbin/airoboros-m-7b-3.1.2
Airoboros · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
Sayan01/Phi3-TL-ORCAMEL-10
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
TH
Lambent/threebird-7B
Threebird · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
kevin009/TinyNaughtyLlama-v1.0
Tinynaughtyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
DE
nbeerbower/DeepSeek-R1-Qwen-lorablated-32B
DeepSeek · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
MI
flammenai/flammen24-mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MY
MoaData/Myrrh_solar_10.7b_3.0
Myrrh · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
DA
DavidAU/MN-Dark-Planet-TITAN-12B
Dark · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
FI
rafajafa/finetunellama3.1
Finetunellama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
4yo1/llama3-eng-ko-8-llama
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
megastudyedu/M-SOLAR-10.7B-v1.3-dpo
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
AS
DreadPoor/Aspire-8B-model_stock
Aspire · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
AgentPublic/llama3-instruct-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
grimjim/llama-3-merge-virt-req-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Siddharth63/Qwen2_emotions_without_reasoning
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
TI
Jeeeeeeeeeeeeeeez/my-tinyreco-model-new-data-bright10.1
Tinyreco · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
IC
icefog72/IceLatteRP-7b
Icelatterp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
NousResearch/Llama-3.2-1B
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
vicky4s4s/gemma-2-2b-instruct
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
SL
crestf411/L3.1-8B-Slush-v1.1
Slush · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
wwe180/Llama3-15B-ShenNu-v0.1
Llama · featherless-ai-quants
Params15B
Context8K
Q4_K_M9.1 GB
SO
AIdenU/SOLAR-10.7b-ko-Y24_v0.1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
vectorzhou/Qwen2.5-1.5B-Instruct-SFT-OpenHermes-2.5-Standard-SFT
Qwen · featherless-ai-quants
Params1.54B
Context32K
Q4_K_M1.0 GB
GE
Svenni551/gemma-2b-it-toxic-v2.0
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB