GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
RL
rudrashah/RLM-hinglish-translator
Rlm · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
DE
deepnet/C00ReadyModel
Deepnet · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
nbeerbower/llama-3-stinky-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
abeja/ABEJA-Qwen2.5-32b-Japanese-v1.0
Qwen · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
princeton-nlp/Llama-3-Instruct-8B-ORPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
AIDC-AI/Marco-LLM-ES
Marco · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
GE
d-matrix/gemma-2b
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
KE
Obrolin/Kesehatan-7B-v0.1
Kesehatan · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
princeton-nlp/Llama-3-Instruct-8B-IPO-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AL
alielfilali01/Q2AW1M-1010
featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
GE
lemon-mint/gemma-2b-translation-v0.91
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
SA
sail/Sailor-1.8B
Sailor · featherless-ai-quants
Params1.84B
Context8K
Q4_K_M1.2 GB
AL
alielfilali01/Q2H10M-0000
featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
GE
suriya7/Gemma2B-Finetuned-Sql-Generator
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
TI
Novaciano/TinyKiller-NSFW-DPO-1.1B
Tinykiller · featherless-ai-quants
Params1.1B
Context32K
Q4_K_M0.7 GB
QW
Hachipo/qwen2.5-0.5B_PIFT-enja_combined_18000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
SH
shuttleai/shuttle-2.5-mini
Shuttle · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
PI
betterdataai/PII_DETECTION_MODEL
Pii · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
LL
context-labs/Meta-Llama-3.1-8B-Instruct-FP16
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
wanghaikuan/Qwen2-0.5B_merge_v2.9
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
RP
djuna/L3.1-RPganoff-8B-B
Rpganoff · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Salesforce/LLaMA-3-8B-SFR-Iterative-DPO-R
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AU
ResplendentAI/Aura_L3_8B
Aura · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
MaziyarPanahi/calme-2.2-qwen2-72b
Qwen · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Hachipo/qwen2.5-0.5B_PIFT-enja_onsentence_2000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GE
xw17/gemma-2-2b-it_finetuned_1_def
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
google/gemma-2-2b
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
MA
MaziyarPanahi/YamshadowInex12_Experiment26T3q
Maziyarpanahi · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
migtissera/Tess-2.0-Llama-3-70B-v0.2
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
PU
ChaoticNeutrals/Puppy_Purpose_0.69
Puppy · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB