GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
v000000/L3.1-Storniitova-8B
Storniitova · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
MergeMerge/Gemma2-2B-Tulu3-SFT-Personas-Math-MATH
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QR
TeeZee/Qra-13B-chat
Qra · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
MaziyarPanahi/Llama-3-8B-Instruct-v0.9
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
akshit-Gupta/qwen199f16_merged-FinetunedByAG
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
Tool use
AI
jondurbin/airoboros-m-7b-3.1.2
Airoboros · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
Sayan01/Phi3-TL-ORCAMEL-10
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TH
Lambent/threebird-7B
Threebird · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
kevin009/TinyNaughtyLlama-v1.0
Tinynaughtyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
DE
nbeerbower/DeepSeek-R1-Qwen-lorablated-32B
DeepSeek · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
MI
flammenai/flammen24-mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MY
MoaData/Myrrh_solar_10.7b_3.0
Myrrh · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
DA
DavidAU/MN-Dark-Planet-TITAN-12B
Dark · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
FI
rafajafa/finetunellama3.1
Finetunellama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
4yo1/llama3-eng-ko-8-llama
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
megastudyedu/M-SOLAR-10.7B-v1.3-dpo
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
AS
DreadPoor/Aspire-8B-model_stock
Aspire · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
AgentPublic/llama3-instruct-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
grimjim/llama-3-merge-virt-req-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Siddharth63/Qwen2_emotions_without_reasoning
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
Reasoning
TI
Jeeeeeeeeeeeeeeez/my-tinyreco-model-new-data-bright10.1
Tinyreco · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
IC
icefog72/IceLatteRP-7b
Icelatterp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
NousResearch/Llama-3.2-1B
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
GE
vicky4s4s/gemma-2-2b-instruct
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SL
crestf411/L3.1-8B-Slush-v1.1
Slush · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
wwe180/Llama3-15B-ShenNu-v0.1
Llama · featherless-ai-quants
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
SO
AIdenU/SOLAR-10.7b-ko-Y24_v0.1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
vectorzhou/Qwen2.5-1.5B-Instruct-SFT-OpenHermes-2.5-Standard-SFT
Qwen · featherless-ai-quants
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
GE
Svenni551/gemma-2b-it-toxic-v2.0
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF

Keep browsing