GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
birgermoell/llama-3-open-hermes-disco
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
MI
nbeerbower/Lyra-Gutenberg-mistral-nemo-12B
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
cloudyu/Meta-Llama-3-8B-Instruct-DPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
intervitens/mini-magnum-12b-v1.1
Mini · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ME
MiniMoog/Mergerix-7b-v0.3
Mergerix · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
OwenArli/ArliAI-Llama-3-8B-Instruct-Dolfin-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
Goekdeniz-Guelmez/J.O.S.I.E.v4o-0.5b-stage1-beta1
Stage · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
LL
OpenBuddy/openbuddy-llama3.1-8b-v22.3-131k
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
shleeeee/mistral-7b-ko-dpo-v1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
ContextualAI/archangel_sft_llama13b
Llama · featherless-ai-quants
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
SO
chihoonlee10/T3Q-ko-solar-dpo-v5.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
wang7776/Mistral-7B-Instruct-v0.2-attention-sparsity-20
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
AIDC-AI/Marco-LLM-AR-V2
Marco · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
QW
Qwen/QwQ-32B-Preview
Qwen · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
NO
NeverSleep/Noromaid-13b-v0.1.1
Noromaid · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GE
muamarkadafidev/gemma-2b-chat-doctor
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LI
Saxo/Linkbricks-Horizon-AI-Korean-Advanced-8B-COT-boost
Linkbricks · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Sao10K/32B-Qwen2.5-Kunou-v1
Qwen · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
LL
ModelsLab/Llama-3-uncensored-Dare-1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
CardinalOperations/ORLM-LLaMA-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
MaziyarPanahi/calme-2.2-qwen2-7b
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
elinas/Llama-3-15B-Instruct-zeroed
Llama · featherless-ai-quants
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.75_0.5_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
aixsatoshi/Meta-Llama-3.1-8B-Instruct-plus-Swallow
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
williamlcn/gen1
Gen · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
ST
Gille/StrangeMerges_51-7B-dare_ties
Strangemerges · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
komi77/qwen2.5-0.5B_ed_gauss_freq_10-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top_2000_pythonblock_en
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
KA
NilanE/karasu-translation
Karasu · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
RO
Fizzarolli/L3-8b-Rosier-v1
Rosier · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing