GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
DI
google/DiarizationLM-13b-Fisher-v1
Diarizationlm · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
LL
mlx-community/defog-llama-3-sqlcoder-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
ArianAskari/SOLID_SFT-WoDPO-WoMixQ
Solid · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen/Qwen2.5-14B-Instruct
Qwen · featherless-ai-quants
Params14.8B
Context32K
Q4_K_M9.0 GB
EX
yam-peleg/Experiment25-7B
Experiment · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
etri-xainlp/llama2-12.8b_lora-dpo_v1
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
CU
jwkweon/CUBOX-SOLAR-DPO-v0.2
Cubox · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MO
ichigoberry/MonarchPipe-7B-slerp
Monarchpipe · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
VI
Epiculous/Violet_Twilight-v0.2
Violet · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
netcat420/MFANN-llama3.1-abliterated-SLERP-v3.1
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Skywork/Skywork-o1-Open-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
DA
mlabonne/Daredevil-8B
Daredevil · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
wons/mistral-7B-test-v0.3
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
Gille/StrangeMerges_53-7B-model_stock
Strangemerges · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
coderbojack/google-gemma-2b-1717553223
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
NU
numind/NuExtract-1.5-tiny
Nuextract · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
OwenArli/Meta-Llama-3-8B-Instruct-Dolfin-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
KI
Chat-Error/Kimiko-10.7B-v3
Kimi · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MA
kaitchup/Mayonnaise-4in1-03
Mayonnaise · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
CorticalStack/pastiche-crown-clown-7b-dare-dpo
Pastiche · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
xw17/TinyLlama-1.1B-Chat-v1.0_finetuned_s02_i
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
CA
Doctor-Shotgun/CalliopeDS-v2-L2-13B
Calliopeds · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
TI
Hoyeon/TinyLlama-1.1B-scratch
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
OpenBuddy/openbuddy-llama3.1-8b-v22.2-131k
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
alpindale/Llama-3.2-1B
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
PI
yeniceriSGK/PiBrain-TinyLlama-V2
Pibrain · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
SO
soniox/Soniox-7B-v1.0
Soniox · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
ENERGY-DRINK-LOVE/SOLAR_merge2
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
Locutusque/Hyperion-3.0-Mistral-7B-alpha
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
vlada22/Meta-Llama-3.1-8B-Instruct-finki-edu-5c
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB