GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LU
NeverSleep/Lumimaid-v0.2-12B
Lumimaid · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
PJMixers-Dev/Qwen2.5-QwQ-RP-Draft-v0.1-0.5B
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.15_0.05_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
birgermoell/llama-3-merge-disco-neural-pace
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
PA
ichigoberry/pandafish-7b
Pandafish · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
vijayvarmak/gemma-FT-Gemini1
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
MI
l3utterfly/mistral-7b-v0.1-layla-v3
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Saxo/Linkbricks-Horizon-AI-Korean-llama-3.1-sft-dpo-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
SO
megastudyedu/M-SOLAR-10.7B-v1.3
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MA
yifanxie/magenta-swine
Magenta · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
maxxi146/LLaMa_FactoryV2
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
AMindToThink/gemma-2-2b_RMU_cyber-forget-corpus_s100_a300_layer3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
TilQazyna/llama-kaz-instruct-8B-1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
ihopper/I-SOLAR-10.7B-dpo-sft-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
PO
ShadrackImai/potato_wizard_v59
Potato · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
BR
rwitz2/go-bruins-v2.1
Bruins · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LO
louisgrc/Montebello_7B_SLERP
Louisgrc · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
FILM6912/Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
RL
rudrashah/RLM-spell-checker
Rlm · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
Muadil/Llama-3.2-1B-Instruct_sum_DPO_40k_4_1ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
TO
Tokerss/mergekit-linear-cnukgdw
Tokerss · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
CorticalStack/mistral-7b-alpaca-sft
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
KO
heegyu/KoSafeGuard-8b-0503
Kosafeguard · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
princeton-nlp/Llama-3-Instruct-8B-RRHF
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
namespace-Pt/Llama-3-8B-Instruct-80K-QLoRA-Merged
Llama · featherless-ai-quants
Params8.03B
Context80K
Q4_K_M4.9 GB
GE
MergeMerge/gemma-2-2B-allenai-tulu-3-sft-math-MATH
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
VAGOsolutions/SauerkrautLM-Qwen-32b
Qwen · featherless-ai-quants
Params32.5B
Context32K
Q4_K_M19.7 GB
QW
gbueno86/QwQ-R1-Distill-Merge-32B
Qwen · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
SI
williamlcn/simpotest
Simpotest · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
MI
nbeerbower/Mistral-Nemo-Gutenberg-Doppel-12B-v2
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB