GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LI
lodrick-the-lafted/Limon-8B
Limon · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
WI
fearlessdots/WizardLM-2-7B-abliterated
Wizardlm · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
Milo91/tinyllama-colorist-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
TI
yuiseki/tinyllama-coder-color-en-v0.1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
TI
sargetun/tinyllama-1.1B-CrimsonAI-movie-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
jjourney1125/llama2-13b-v1
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
LI
hchung1017/linear-merge
Linear · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
SM
tomoe007/smollm-finetunedx
SmolLM · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
MI
ericpolewski/AIRIC-The-Mistral
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
grimjim/Llama-3.1-SuperNova-Lite-lorabilterated-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
T3Q-LLM/T3Q-LLM2-CP-v1.1
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
grimjim/llama-3-Nephilim-v3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
nbeerbower/bophades-mistral-truthy-DPO-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
MarinaraSpaghetti/NemoRemix-12B
Nemoremix · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
RO
OpenLLM-Ro/RoLlama3-8b-Instruct-2024-06-28
Rollama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
l3utterfly/mistral-7b-v0.1-layla-v2
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
unsloth/Qwen2-0.5B-Instruct
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
TI
tmd-rahul/tinyllama-chatbot-clean
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
TI
istiak101/TinyLlama-1.1B-Chat-v0.6-rag-finetunedv1.0
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
PA
appvoid/palmer-instruct-test-18
Palmer · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
MI
DeepMount00/Mistral-RAG
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
TA
yentinglin/Taiwan-LLM-13B-v2.0-chat
Taiwan · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
MI
kaist-ai/mistral-orpo-alpha
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
hyokwan/llama3-ko-8b-hkcode
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
JS
johnsnowlabs/JSL-MedLlama-3-8B-v2.0
Jsl · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LI
IlyaGusev/T-lite-instruct-0.1-abliterated
Lite · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
UN
proto-llm/uniwiz-7B-v0.2
Uniwiz · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
giux78/zefiro-7b-beta-ITA-v0.1
Zefiro · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
AT
GalrionSoftworks/Atlantum-12B-v1
Atlantum · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
OR
Sayan01/TL-ORCA-SFT-0
Orca · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB