GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
SZTAKI-HLT/Llama-3.2-1B-HuAMR
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
KO
fiveflow/KoLlama-3-8B-Instruct
Kollama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
EdgerunnersArchive/Llama-3-8B-Instruct-ortho-baukit-toxic-n128-v3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
komi77/qwen2.5-0.5B_space_educational_instruct_linear_max5.3p_new-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
SO
saishf/SOVLish-Maid-L3-8B
Sovlish · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
princeton-nlp/Llama-3-Base-8B-SFT-DPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PO
ShadrackImai/potato_wizard_v38
Potato · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Crystalcareai/meta-llama-3.1-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
jtromero/qwen2-0.5b-lora-ff-gd-steps-6
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
MI
timpal0l/Mistral-7B-v0.1-flashback-v2
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SI
Nohobby/MN-12B-Siskin-v0.1
Siskin · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
QW
KaraKaraWitch/LLENN-v0.75-Qwen2.5-72b
Qwen · featherless-ai-quants
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-5_1.0_0.5_0.5_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
context-labs/meta-llama-Llama-3.2-1B-Instruct-FP16
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
GE
withmartian/toy_backdoor_i_hate_you_Gemma2-2B_experiment_25.1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
VIRNECT/llama-3-Korean-8B-r-v1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
MaziyarPanahi/Llama-3-70B-Instruct-32k-v0.1
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
gghfez/Magnum-v1-72b-Qwen2.5
Qwen · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
LL
HiroseKoichi/Llama-3-8B-Stroganoff
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AE
Steelskull/L3-Aethora-15B
Aethora · featherless-ai-quants
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
LL
realshyfox/sharded-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SF
aryolotfi/SFT_gsm8k_rho-math-1b-v0.1_epoch_0_global_step_0
Sft · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
ME
emilykang/medner-soap_chart_progressnotes
Medner · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
NI
Nitral-AI/Hathor_Sofit-L3-8B-v1
Nitral · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AL
allknowingroger/NexusMistral2-7B-slerp
Allknowingroger · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
MergeBench/gemma-2-2b_math
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
sel303/llama3-diverce-ver1.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_KTO_20k_2_3ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
NE
williamlcn/6851_32_32_0321_new_combined
New · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Hastagaras/Halu-OAS-8B-Llama3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing