GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
KU
Nitral-AI/KukulStanta-7B
Kukulstanta · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Goekdeniz-Guelmez/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
lightblue/suzume-llama-3-8B-multilingual-orpo-borda-half
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.3
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
elinas/Llama-3-15B-Instruct-ft-v2
Llama · featherless-ai-quants
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
LL
DevsDoCode/LLama-3-8b-Uncensored
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
LeroyDyer/Mixtral_AI_CyberCoder
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
LL
zhichen/Llama3-Chinese
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
fyuuki0jp/gemma-2-2b-jpn-it_finetuning_sft
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Qwen/Qwen2.5-Coder-7B
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
LL
Rookie/Llama-3-8B-Instruct-Chinese
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TI
yuiseki/tinyllama-es-wikipedia-aya-1.5T-v0.1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PR
ProdeusUnity/Prismatic-12b
Prismatic · featherless-ai-quants
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
GI
abacusai/Giraffe-13b-32k-v3
Giraffe · featherless-ai-quants
Params13B
Context32K
Q4_K_M7.9 GB
GGUF
TI
R1pathak/TinyLlama_v1.1_float16_0.0
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PA
ohyeah1/Pantheon-Hermes-rp
Pantheon · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
RoleplayTool use
MB
macadeliccc/MBX-7B-v3-DPO
Mbx · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
timpal0l/Llama-3-8B-flashback-v1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NU
kalisai/Nusantara-1.8b-Indo-Chat
Nusantara · featherless-ai-quants
Params1.84B
Context8K
Q4_K_M1.2 GB
GGUF
LI
KeyonZeng/lion-zephyr-7b
Lion · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FI
clinicalnlplab/finetuned-PMCLLaMA-PubmedSumm
Finetuned · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ZE
grimjim/zephyr-beta-wizardLM-2-merge-7B
Zephyr · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HI
Elizezen/Himeyuri-v0.1-12B
Himeyuri · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
HU
darkcloudai/huskylm-2.5-8b
Huskylm · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
DrNicefellow/Mistral-8-from-Mixtral-8x7B-v0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.6 GB
GGUF
SF
aryolotfi/SFT_gsm8k_rho-math-1b-v0.1_epoch_2_global_step_58
Sft · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
BCCard/Llama-3-Kor-BCCard-Finance-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
chihoonlee10/T3Q-LLM2-sft1.0-dpo1.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
DP
eren23/dpo-binarized-NeutrixOmnibe-7B
Dpo · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
vicgalle/Roleplay-Hermes-3-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use

Keep browsing