GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
ME
mergekit-community/L3.1-Artemis-c-8B
Mergekit · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen/Qwen2-Math-72B
Qwen · featherless-ai-quants
Params72.7B
Context4K
Q4_K_M47.4 GB
MC
williamlcn/6851_mcq_8_8_new_format_combined
Mcq · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
NT
NTIS/merge_v3.1
Ntis · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
2A
2A2I-R/L100MT
featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ContextualAI/archangel_dpo_llama13b
Llama · featherless-ai-quants
Params13B
Context2K
Q4_K_M7.9 GB
SI
StatPan/SinGung7B-DPO-v0.1-12600c
Singung · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
grimjim/llama-3-merge-avalon-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
CR
Epiculous/Crimson_Dawn-V0.1
Crimson · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Hastagaras/Llama-3.1-8B-Tortoise
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
komi77/qwen2.5-0.5B_space_educational_instruct_low_start9150_max95p_new-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
niznik-dev/llama-pubmed-example
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
T3Q-LLM/T3Q-LLM2-sft1.4
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
SU
crestf411/L3.1-8B-sunfall-v0.6.1-dpo
Sunfall · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-5_1.0_0.5_0.5_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
quantumaikr/gemma-2b-it-ko
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.75_0.75_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
nem012/gemma2b-1e-5r8
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
ME
mergekit-community/L3-Boshima-a
Mergekit · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
lamm-mit/Bioinspired-Llama-3-1-8B-128k-2-alpha
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
Sumail/Derrick16
Derrick · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.25_0.5_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
mirlab/AkaLlama-llama3-70b-v0.1
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
ArliAI/ArliAI-RPMax-12B-v1.1
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
fearlessdots/Llama-3-Alpha-Centauri-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
vicgalle/ConfigurableSOLAR-10.7B
Configurablesolar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
spow12/Mistral-Nemo-Instruct-2407_orpo_ver_1.0
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
ME
Fischerboot/mergekit-slerp-awrvish
Mergekit · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
WI
BarryFutureman/WildMarcoroni-Variant3-7B
Wildmarcoroni · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
InsultedByMathematics/infoNCA_ultrafeedback
Infonca · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB