GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
nbeerbower/llama3.1-gutenberg-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
CultriX/Qwen2.5-14B-Wernicke
Qwen · featherless-ai-quants
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top_1000_pythonblock_ja_en
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
PO
Nitral-Archive/Poppy_Porpoise-L3-8B
Poppy · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
southfreebird/Qwen2.5-0.5B-Instruct
Qwen · featherless-ai-quants
Params494M
Context64K
Q4_K_M0.4 GB
Tool use
QW
NaoS2/qwen2.5-0.5B_drop_low25_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
twerkmeister/calm-demo-llama3.1-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MH
Sao10K/70B-L3.3-mhnnn-x1
Mhnnn · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
TE
Danilas/test3
Test · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
AMindToThink/gemma-2-2b-it_RMU_s200_a300_layer11
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Dogge/llama-3-70B-instruct-uncensored
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
kuotient/Meta-Llama-3-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
MaziyarPanahi/Llama-3-8B-Instruct-v0.4
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AZ
Azazelle/L3-RP_io
featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
MI
axolotl-ai-co/Mistral-Nemo-Base-2407-chatml
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
NE
Kukedlc/NeuralSynthesis-7B-v0.2
Neuralsynthesis · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Danielbrdz/Barcenas-Llama3-8b-ORPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
NCSOFT/Llama-3-OffsetBias-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
panxinyang/Qwen-Qwen1.5-1.8B-1717768779
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
LL
florian987/llama-31-hhrlhf-squad-rlhf-policy-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
ME
Mihaiii/Metis-0.3
Metis · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_MIFT-ja_onsentence_2000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
zJuu/Qwen-Qwen2-0.5B-1718017271
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
LL
triplee/torchtune_1B_full_finetuned_llama3.2_millfield_241219_meta_header_word_1epoch
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
ZE
Xenon1/Zenith-7B-dpo
Zenith · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
PetterLee/Meta-Llama-3-8B-Instruct-finetuned-backdoor-5
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CK
ckoozzzu/dl6
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
NaoS2/qwen2.5-0.5B_mask_uni10_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
akshit-Gupta/llamanew1merged-FinetunedByAG
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
d0rj/Llama-3-8B-saiga-suzume-ties
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing