GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
DA
DavidAU/L3.1-Dark-Planet-SpinFire-Uncensored-8B
Dark · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
RLHFlow/LLaMA3-iterative-DPO-final
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
komi77/qwen2.5-0.5B_educational_instruct_low_start4400_max95p_new-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
NE
Kukedlc/Neural-4-QA-7b
Neural · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Locutusque/Hyperion-2.1-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
explorewithai/ChatFrame-Uncensored-Instruct-Small
Chatframe · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ModelsLab/Llama-3.1-8b-Uncensored-Dare
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
CH
shibing624/chinese-text-correction-1.5b
Chinese · featherless-ai-quants
Params1.54B
Context32K
Q4_K_M1.0 GB
FI
Sao10K/Fimbulvetr-11B-v2.1-16K
Fimbulvetr · featherless-ai-quants
Params10.7B
Context16K
Q4_K_M6.5 GB
MI
unsloth/Mistral-Nemo-Base-2407
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
unsloth/Llama-3.1-Storm-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
lemon-mint/gemma-ko-1.1-2b-it
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
kuotient/Meta-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
NousResearch/Hermes-3-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
abhinand/gemma-2b-it-tamil-v0.1-alpha
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
jphme/em_german_13b_v01
German · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
VE
Syed-Hasan-8503/Versatile-7B
Versatile · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Orion-zhen/Meissa-Qwen2.5-7B-Instruct
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
nbeerbower/mistral-nemo-wissenschaft-12B
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
PA
ichigoberry/pandafish-2-7b-32k
Pandafish · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
failspy/Llama-3-8B-Instruct-MopeyMule
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
SherlockAssistant/Mistral-7B-Instruct-Ukrainian
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
DeepSeek · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen/Qwen2-7B-Instruct
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
nbeerbower/llama-3-spicy-abliterated-stella-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
athirdpath/Llama-3.1-Instruct_NSFW-pretrained_e1-plus_reddit
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
NO
Deathsquad10/NoNameBrand_1.1B
Nonamebrand · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
lllyasviel/omost-llama-3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SM
Kukedlc/SmartLlama-3-8B-MS-v0.1
Smartllama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
duyhv1411/Llama-1.1B-qlora-ft
Llama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB