GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
ST
AuriAetherwiing/MN-12B-Starcannon-v2
Starcannon · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
NaoS2/qwen2.5-0.5B_mask_uni30_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
NurtureAI/Meta-Llama-3-8B-Instruct-32k
Llama · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
MA
louisbrulenaudet/Maxine-7B-0401-stock
Maxine · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
ArliAI/QwQ-32B-ArliAI-RpR-v3
Qwen · featherless-ai-quants
Params32.8B
Context40K
Q4_K_M19.9 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-5_1.0_0.15_0.15_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
akshit-Gupta/llamait_merged-FinetunedByAG
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
Hachipo/qwen2.5-0.5B_MIFT-en_manywords_8000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
NO
tomoe007/non
Non · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GE
williamlcn/geninstruct
Geninstruct · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
maldv/badger-writer-llama-3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
HA
ChaoticNeutrals/Hathor_RP-v.01-L3-8B
Hathor · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
dat-lequoc/fast-apply-16bit-v0.13.1-Llama3.2-1B
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
AR
HeshamHaroon/araGemma2B-instruct
Aragemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
SO
12thD/I-SOLAR-10.7B-dpo-sft-v0.2
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MA
anthracite-org/magnum-v2.5-12b-kto
Magnum · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
AL
allknowingroger/M7merge-7B-slerp
Allknowingroger · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
NaoS2/qwen2.5-0.5B_freq10_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
nbeerbower/llama-3-stella-truthy-dpo-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
ME
TroyDoesAI/MermaidSolar
Mermaidsolar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
lizchu413/phase1_qwen2.5_0.5b_csn_plus
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
HE
inflatebot/L3-8B-Helium3-baseStheno
Helium · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
emandana/llama_8b_class_ft
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
AITeamVN/Vi-Qwen2-7B-RAG
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
DA
PocketDoc/Dans-PersonalityEngine-V1.1.0-12b
Dans · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
astronomer/Llama-3-8B-Special-Tokens-Adjusted
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
TI
tmd-rahul/tinyllama-chatbot-merged-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
SA
BanusreeM/sawit-tamil-full-model
Sawit · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
jeffmeloy/Qwen2.5-7B-olm-v1.0
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
GE
BAAI/bge-reranker-v2-gemma
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB