GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
RO
Fizzarolli/MN-12b-Rosier-v1
Rosier · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
AC
nvidia/AceMath-7B-Instruct
Acemath · featherless-ai-quants
Params7.62B
Context4K
Q4_K_M4.7 GB
AN
AnasTySia/C-1
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
4yo1/llama
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
RohitSuresh15/llama3.2_1b-physics-v1
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
CS
knarayan/cspm_lora_final_v1
Cspm · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
MI
Locutusque/OpenCerebrum-1.5-Mistral-7b-v0.2-alpha
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GH
ghost-x/ghost-8b-beta-1608
Ghost · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Hachipo/qwen2.5-0.5B_MIFT-ja_onsentence_3000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
RL
pxyyy/rlhflow_mixture_clean_empty_round_with_dart_scalebiosampled-600k
Rlhflow · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
DatToad/Chuluun-Qwen2.5-72B-v0.01
Qwen · featherless-ai-quants
Params72.7B
Context128K
Q4_K_M47.4 GB
CO
bunnycore/Cognitron-8B
Cognitron · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
dpwls003/Gemma-2-2b-it-game-recommendation
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
traversaal-llm-regional-languages/Unsloth_Urdu_Llama3_1_FP16_PF100
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
AL
Alsebay/L3-krai-test-2
Alsebay · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
UN
fblgit/una-cybertron-7b-v3-OMA
Una · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
Casual-Autopsy/L3-Super-Nova-RP-8B
Casual · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
AndresR2909/Llama-3.1-8B-Instruct-suicide-related-text-classification
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
windmaple/gemma-2b-cn-finetuned-model-llama-factory
Llama · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
allganize/Llama-3-Alpha-Ko-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
livil/llama3.1-8b-instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
CA
Casual-Autopsy/L3-Umbral-Mind-RP-v1.0-8B
Casual · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
BL
Azure99/blossom-v5-32b
Blossom · featherless-ai-quants
Params32.5B
Context32K
Q4_K_M19.7 GB
LU
Model-SafeTensors/Lumimaid-v0.2-70B
Lumimaid · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
ArliAI/QwQ-32B-ArliAI-RpR-v4
Qwen · featherless-ai-quants
Params32.8B
Context40K
Q4_K_M19.9 GB
GE
vdm-gilda-4/Gemma-2-2b-it-vdm-sq4-car-motion_beta
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
princeton-nlp/Llama-3-Base-8B-SFT-CPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
jtromero/qwen2-0.5b-lora-single-device-ff-testing
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
hyokwan/hkcode_llama3_8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
wkshin89/mistral-7b-instruct-ko-test-v0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB