GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
nbeerbower/llama3.1-gutenberg-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
CultriX/Qwen2.5-14B-Wernicke
Qwen · featherless-ai-quants
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top_1000_pythonblock_ja_en
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
PO
Nitral-Archive/Poppy_Porpoise-L3-8B
Poppy · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
southfreebird/Qwen2.5-0.5B-Instruct
Qwen · featherless-ai-quants
Params494M
Context64K
Q4_K_M0.4 GB
QW
NaoS2/qwen2.5-0.5B_drop_low25_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
twerkmeister/calm-demo-llama3.1-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
MH
Sao10K/70B-L3.3-mhnnn-x1
Mhnnn · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
TE
Danilas/test3
Test · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s200_a300_layer11
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Dogge/llama-3-70B-instruct-uncensored
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
kuotient/Meta-Llama-3-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
MaziyarPanahi/Llama-3-8B-Instruct-v0.4
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AZ
Azazelle/L3-RP_io
featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
axolotl-ai-co/Mistral-Nemo-Base-2407-chatml
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
NE
Kukedlc/NeuralSynthesis-7B-v0.2
Neuralsynthesis · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Danielbrdz/Barcenas-Llama3-8b-ORPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
NCSOFT/Llama-3-OffsetBias-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
panxinyang/Qwen-Qwen1.5-1.8B-1717768779
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
LL
florian987/llama-31-hhrlhf-squad-rlhf-policy-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
ME
Mihaiii/Metis-0.3
Metis · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Hachipo/qwen2.5-0.5B_MIFT-ja_onsentence_2000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
QW
zJuu/Qwen-Qwen2-0.5B-1718017271
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
LL
triplee/torchtune_1B_full_finetuned_llama3.2_millfield_241219_meta_header_word_1epoch
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
ZE
Xenon1/Zenith-7B-dpo
Zenith · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
PetterLee/Meta-Llama-3-8B-Instruct-finetuned-backdoor-5
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
CK
ckoozzzu/dl6
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
NaoS2/qwen2.5-0.5B_mask_uni10_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
akshit-Gupta/llamanew1merged-FinetunedByAG
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
d0rj/Llama-3-8B-saiga-suzume-ties
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB