GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
jc9080/llama3-open-ko-8b-Instruct-shimshimi-500-ver2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
anakin87/Llama-3-8b-ita-slerp
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
failspy/llama-3-70B-Instruct-abliterated
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
DE
BotCuddles/to_deploy
Deploy · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
anakin87/Llama-3-8b-ita-ties
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
DR
abacusai/Dracarys2-72B-Instruct
Dracarys · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
nreHieW/Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
RA
SuanChang/rain-SQLCoder
Rain · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen/QwQ-32B
Qwen · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
KU
nlpai-lab/KULLM3
Kullm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
seedboxai/Llama-3-KafkaLM-8B-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AL
AgentPublic/albert-spp-8b
Albert · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Muhammad2003/Llama3-8B-OpenHermes-DPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
student-abdullah/Llama3.2_Medicine-Hinglish-Dataset_Fine-Tuned_29-09
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
ST
RUC-AIBOX/STILL-2
Still · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
TI
MR-Eder/tinyllamatestbymarcel
Tinyllamatestbymarcel · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
AZ
AswanthCManoj/azma-tinyllama-instruct-adapter
Azma · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
MaziyarPanahi/calme-2.3-qwen2-7b
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
jiangcongtao/Qwen2-0.5B-alpaca-merged-st
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
LL
lighteternal/Llama3-merge-biomed-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SY
mergekit-community/Synaptica
Synaptica · featherless-ai-quants
Params10.7B
Context8K
Q4_K_M6.5 GB
NI
v000000/L3.1-Niitorm-8B-DPO-t0.0001
Niitorm · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
AL
alielfilali01/Q2AW1M-1100
featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
RLHFlow/Llama3-v2-iterative-DPO-iter3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
komi77/qwen2.5-0.5B_educational_instruct_uni5p-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
etri-xainlp/llama3-8b-dpo_v1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
TIGER-Lab/MAmmoTH2-8B-Plus
Mammoth · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_selec5000_pythonblock_dataselection_jaen
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s100_a500_layer7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
skarnam/FFT_model_Gemma
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB