GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
HA
DreadPoor/Harpy-7B-Model_Stock
Harpy · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
HiroseKoichi/Llama-3-8B-Stroganoff-2.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
ParasiticRogue/Magnum-Instruct-DPO-12B
Magnum · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
jebish7/GEMMA-2B-A90
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
CH
chrischain/SatoshiNv5
Chrischain · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
DeepAutoAI/ldm_soup_Llama-3.1-8B-Inst
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
rhaymison/Mistral-portuguese-luana-7b
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
letgoofthepizza/Llama-3-8B-Instruct-korean-news-summary
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
AMindToThink/gemma-2-2b_RMU_cyber-forget-corpus_s100_a300_layer7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
najeebtpni001/Gemma-2-2b-it-fine-review
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MC
williamlcn/6851_mcq_64_16_new_format_combined
Mcq · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_DPO_40k_4_2ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
dat-lequoc/vLLM-fast-apply-16bit-v0.12-Llama3.2-1B
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Userb1az/llama3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
flammenai/Mahou-1.0-llama3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
adamo1139/Llama-3-8B-AEZAKMI-run1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TI
Haary/TinyLlama-1.1B-indo-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top6000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
allknowingroger/Llama3merge5
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
nvidia/OpenMath2-Llama3.1-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
CE
nothingiisreal/L3-8B-Celeste-V1.2
Celeste · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
KISTI-KONI/KONI-Llama3.1-8B-Merged-20240830
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AL
alielfilali01/Q2AW1M-0010
featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
UM
Casual-Autopsy/L3-Umbral-Mind-RP-v0.3-8B
Umbral · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.5_0.75_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
RLHFlow/pair-preference-model-LLaMA3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
CarrotAI/ko-gemma-2b-it-sft
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
Eric111/Yarn-Mistral-7b-128k-DPO
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
ericlewis/Qwen2-0.5B-Instruct-xLAM-0.1
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
ST
ockerman0/MN-12B-Starcannon-v4-unofficial
Starcannon · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing