GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
mp1704/qwen_1.8b_sft_full_3
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
QR
TeeZee/Qra-13b-instruct
Qra · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_MIFT-jaen_manywords_2000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
southfreebird/Qwen2.5-Coder-0.5B-Instruct
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
LL
expertai/SLIMER-LLaMA3
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TI
NilanE/tinyllama-en_ja-translation-v2
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
hivaze/ParaLex-Llama-3-8B-SFT
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
CorticalStack/neurotic-crown-clown-7b-tak-stack-dpo
Neurotic · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
arnavgrg/llama-2-13b-chat-nf4-fp16-upscaled
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GE
nervmouse/gemma-Code-Instruct-Finetune-test
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
Coding
PR
Gandhiv112/proposly-tinyllama
Proposly · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
akshit-Gupta/llama1Bnew-FinetunedByAG
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
MI
nbeerbower/mistral-nemo-gutenberg-12B-v2
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
jpquiroga/Mistral_7B_slerp_merge_instruct_open_orca
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VI
ChaoticNeutrals/Visual-LaylelemonMaidRP-7B
Visual · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
chargoddard/Meta-Llama-3-8B-InitializedEmbeds
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
Embedding
LL
sh2orc/Llama-3.1-Korean-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Qwen/Qwen2.5-Math-1.5B-Instruct
Qwen · featherless-ai-quants
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use
LL
KoboldAI/LLaMA2-13B-Erebus-v3
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ME
MiniMoog/Mergerix-7b-v0.4
Mergerix · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
C10X/LongWriter-Qwen2.5-7B-Instruct
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
IG
NeuralNovel/Ignis-7B-DPO-Laser
Ignis · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
xw17/TinyLlama-1.1B-Chat-v1.0_finetuned_3_def
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
ME
emilykang/medquad-information
Medquad · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
CE
nothingiisreal/L3-8B-Celeste-v1
Celeste · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ZE
giux78/zefiro-7b-dpo-qlora-ITA-v0.7
Zefiro · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WE
PetroGPT/WestSeverus-7B-DPO-v2
Westseverus · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FR
freewheelin/free-solar-evo-v0.13
Free · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
YA
yam-peleg/Experiment28-7B
Yam · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing