GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
jc9080/llama3-open-ko-8b-Instruct-shimshimi-500-ver2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
anakin87/Llama-3-8b-ita-slerp
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
failspy/llama-3-70B-Instruct-abliterated
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
DE
BotCuddles/to_deploy
Deploy · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
anakin87/Llama-3-8b-ita-ties
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DR
abacusai/Dracarys2-72B-Instruct
Dracarys · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
LL
nreHieW/Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
RA
SuanChang/rain-SQLCoder
Rain · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
QW
Qwen/QwQ-32B
Qwen · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
KU
nlpai-lab/KULLM3
Kullm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
seedboxai/Llama-3-KafkaLM-8B-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AL
AgentPublic/albert-spp-8b
Albert · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Muhammad2003/Llama3-8B-OpenHermes-DPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
student-abdullah/Llama3.2_Medicine-Hinglish-Dataset_Fine-Tuned_29-09
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
ST
RUC-AIBOX/STILL-2
Still · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
TI
MR-Eder/tinyllamatestbymarcel
Tinyllamatestbymarcel · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
AZ
AswanthCManoj/azma-tinyllama-instruct-adapter
Azma · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
QW
MaziyarPanahi/calme-2.3-qwen2-7b
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
QW
jiangcongtao/Qwen2-0.5B-alpaca-merged-st
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
LL
lighteternal/Llama3-merge-biomed-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SY
mergekit-community/Synaptica
Synaptica · featherless-ai-quants
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
NI
v000000/L3.1-Niitorm-8B-DPO-t0.0001
Niitorm · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AL
alielfilali01/Q2AW1M-1100
featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
RLHFlow/Llama3-v2-iterative-DPO-iter3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
komi77/qwen2.5-0.5B_educational_instruct_uni5p-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
etri-xainlp/llama3-8b-dpo_v1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
TIGER-Lab/MAmmoTH2-8B-Plus
Mammoth · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_educational_instruct_selec5000_pythonblock_dataselection_jaen
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
GE
AMindToThink/gemma-2-2b-it_RMU_s100_a500_layer7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
skarnam/FFT_model_Gemma
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF

Keep browsing