GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
anakin87/yo-Llama-3-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
light77/gemma-Code-Instruct-Finetune-test-0.2
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
QW
magnifi/qwen2-rephrase-classify-multitask-v6
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
NI
Nitral-AI/Sekhmet_Bet-L3.1-8B-v0.2
Nitral · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
cookinai/LlamaReflect-8B-CoT-safetensors
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
phamtungthuy/Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ME
ChenWeiLi/MedLlama-3-8B_DARE
Medllama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
tokyotech-llm/Llama-3.1-Swallow-70B-v0.1
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GR
DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-MADNESS
Grand · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
TI
ewqr2130/TinyLamma-SFT
Tinylamma · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
lizchu413/qwen2-0.5b-vanilla-single-device
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
OP
OpenLLM-Ro/RoLlama3-8b-Instruct
Openllm · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
magnifi/qwen2-rephrase-4bit-3-epochs
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
QW
MaziyarPanahi/calme-2.3-qwen2-72b
Qwen · featherless-ai-quants
Params72.7B
Context128K
Q4_K_M47.4 GB
RE
aloobun/Reyna-Mini-1.8B-v0.2
Reyna · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
EX
DISLab/Ext2Gen-8B-R2
Ext · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
JoaoVitorIA/fine-tunning-gemma2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
masa-research/Qwen2-0.5B_20240829_175401
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GE
Dohyeon1/gemma-2-2b-it-pm-ep1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
MI
nazimali/Mistral-Nemo-Kurdish
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
charles22/Qwen-Qwen1.5-1.8B-1717697976
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
OP
Locutusque/OpenCerebrum-2.0-7B
Opencerebrum · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
jjourney1125/M-SOLAR-10.7B-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
NaoS2/qwen2.5-0.5B_freq15_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
CY
dad1909/cybersentinal-2.0
Cybersentinal · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
TU
alexredna/Tukan-1.1B-Chat-v0.6
Tukan · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
TI
tmd-rahul/tinyllama-chatbot-merged-v11
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
Zardos/A.I.Kant-Test_Llama-3-8B-Instruct_v0.1.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
princeton-nlp/Mistral-7B-Base-SFT-DPO
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.4
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB