GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
AL
Alphacode-AI/AlphaMist7B-slr-v4-slow2
Alphamist · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
BR
I-BRICKS/Cerebro_BM_solar_v01
Bricks · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
HA
sosoai/hansoldeco-SOLAR-10.7B-DPO
Hansoldeco · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
gradientai/Llama-3-8B-Instruct-Gradient-4194k
Llama · featherless-ai-quants
Params8.03B
Context1K
Q4_K_M4.9 GB
QW
rombodawg/Rombos-Coder-V2.5-Qwen-14b
Qwen · featherless-ai-quants
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
Saxo/Linkbricks-Horizon-AI-Korean-llama3-sft-dpo-8b-base
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
teknium/Llama-3.1-AlternateTokenizer
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
deepseek-ai/DeepSeek-R1-Distill-Llama-70B
DeepSeek · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
CH
shibing624/chinese-text-correction-7b
Chinese · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
TheTsar1209/llama3-carpskel-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
kingabzpro/Llama-3.1-8B-Instruct-Mental-Health-Classification
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
danieldk/Qwen2.5-1.5B-Instruct-w8a8-int-dynamic-weight
Qwen · featherless-ai-quants
Params1.54B
Context32K
Q4_K_M1.0 GB
PA
FelixChao/Patronum-7B
Patronum · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
macadeliccc/SOLAR-10.7b-Instruct-dpo
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
netcat420/MFANN-llama3.1-Abliterated-SLERP
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
shanchen/llama3-8B-slerp-med-262k
Llama · featherless-ai-quants
Params8.03B
Context256K
Q4_K_M4.9 GB
LL
ContextualAI/archangel_sft-dpo_llama13b
Llama · featherless-ai-quants
Params13B
Context2K
Q4_K_M7.9 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s100_a300_layer7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
IC
icefog72/IceLemonTeaRP-32k-7b
Icelemontearp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
JefiRyan/Llama-3.2-1B-bnb-4bit-soulcare_no_serialization_4000_steps
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Eurdem/Defne-llama3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LU
Ppoyaa/LuminRP-7B-128k-v0.2
Luminrp · featherless-ai-quants
Params7.24B
Context128K
Q4_K_M4.4 GB
DP
eren23/dpo-binarized-NeuralTrix-7B
Dpo · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
BarraHome/zephyr-dpo-v2
Zephyr · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SI
jambroz/sixtyoneeighty-7b-dpo
Sixtyoneeighty · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
dmis-lab/llama-3-meerkat-8b-v1.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
ContextualAI/Contextual_KTO_Mistral_PairRM
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
LeroyDyer/Mixtral_AI_Cyber_5.0
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
PO
haes95/POLAR-10.7B-HES-DPO-v0.1
Polar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
mlx-community/Meta-Llama-3-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB