GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
NE
mlabonne/NeuralLlama-3-8B-Instruct-abliterated
Neuralllama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AR
katanemo/Arch-Function-7B
Arch · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
NI
Sao10K/L3-8B-Niitama-v1
Niitama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
Gille/StrangeMerges_50-7B-slerp
Strangemerges · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
CE
Cesco2004/TW3CESCO.V3
Cesco · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
allknowingroger/CalmExperiment-7B-slerp
Allknowingroger · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CorticalStack/mistral-7b-dolphin-sft
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Locutusque/OpenCerebrum-1.5-Mistral-7B-v0.2-beta
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
winninghealth/WiNGPT2-Llama-3-8B-Base
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SA
kyujinpy/Sakura-SOLRCA-Instruct-DPO
Sakura · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
tuneai/Meta-Llama-3-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
chihoonlee10/T3Q-ko-solar-dpo-v6.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
AZ
MoxoffSrL/Azzurro
Azzurro · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
maldv/badger-lambda-llama-3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
WI
wisenut-nlp-team/Wisedom-8B-EmbeddingReordering
Wisedom · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
NaoS2/qwen2.5-0.5B_drop_linear5_edu_instruct-3_2
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
MI
wang7776/Mistral-7B-Instruct-v0.2-sparsity-20-v0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Ananya8154/Gemma-2-2B-Indian-Law
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
dat-lequoc/vLLM-fast-apply-16bit-v0.13-Llama3.2-1B
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
RE
saturated-labs/T-Rex-mini
Rex · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
MrRobotoAI/llama3-8B-Special-Dark-RP2
Llama · featherless-ai-quants
Params8.03B
Context1024K
Q4_K_M4.9 GB
WI
winninghealth/WiNGPT-Babel
Wingpt · featherless-ai-quants
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Zardos/nil_Llama-3-8B-Instruct_v0.1.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
DO
nothingiisreal/L3-8B-dolphin-2.9.1-WritingPrompts
Dolphin · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Weyaxi/Einstein-v4-Qwen-1.5-32B
Qwen · featherless-ai-quants
Params32.5B
Context32K
Q4_K_M19.7 GB
MI
silvercoder67/Mistral-7b-instruct-v0.2-summ-sft-e2m
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Redgalaxy2/gemma-reformat_text-Finetune
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
PH
Sayan01/Phi3-TL-ORCA-1
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
MaziyarPanahi/calme-2.6-qwen2-7b
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
sel303/llama3-diverce-ver1.6
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB