GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LO
Local-Novel-LLM-project/Ninja-V2-7B
Local · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
haqishen/h2o-Llama-3-8B-Japanese-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
RLHFlow/LLaMA3.2-1B-SFT
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
TI
jawadmohmmad/tinyllama-colorist-v2
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
TI
Prajna1999/tinyllama-prajna
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
TI
wamegabe/tinyllama-wame-4bit-curi
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
ST
ProdeusUnity/Stellar-Odyssey-12b-v0.0
Stellar · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
allura-org/Qwen2.5-32b-RP-Ink
Qwen · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top3000_DeepL_ja
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
MI
flammenai/flammen18X-mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
4bit/Llama-3.2-1B
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
davidkim205/Ko-Llama-3-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_pythonblock_en_1000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
QW
Hachipo/qwen2.5-0.5B_MIFT-ja_combined_18000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
CH
perlthoughts/Chupacabra-7B-v2
Chupacabra · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
We-Want-GPU/SOLAR-10.7B-orca-alpaca-gpt4-math
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
WA
WasamiKirua/Westworld-1.0-Nemo-Base-2407-ita-16bit
Wasamikirua · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
CK
ckoozzzu/d3
featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
CO
aloobun/CosmicBun-8B
Cosmicbun · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
TOPAI-Network/Llama-3-LewdPlay-8B-evo
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
12thD/I-SOLAR-10.7B-dpo-sft-v0.1
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
justinphan3110/Llama-3-8B-RMU
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
maldv/badger-iota-llama-3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
nbeerbower/llama3-KawaiiMahouSauce-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
mesolitica/llama-3-8b-8192-hf
Llama · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top_1000_pythonblock_en_ja
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
Muadil/Llama-3.2-1B-Instruct_sum_KTO_10k_1_3ep_4bit
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
jtromero/qwen2-0.5b-lora-ff-gd-steps-6-aws
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
QW
Hachipo/Qwen2.5-0.5B_PIFT-jaen_8250
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB