GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
YU
Yuma42/KangalKhan-Alpha-Sapphiroid-7B-Fixed
Yuma · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DA
Edentns/DataVortexM-7B-Instruct-v0.1
Datavortexm · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
NaoS2/qwen2.5-0.5B_low10_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
youjunhyeok/llama3-koen-8b-sft-v1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
withmartian/sft_backdoors_Gemma2-2B_code3_dataset_experiment_19.1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
AXCXEPT/Llama-3.1-8B-EZO-1.1-it
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DI
google/DiarizationLM-8b-Fisher-v1
Diarizationlm · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
AwikDhar/Llama3.1_8b_2707
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
AliMaatouk/LLama-3-8B-Tele-it
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
mlabonne/NeuralMarcoro14-7B
Neuralmarcoro · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
coderbojack/Qwen-Qwen1.5-1.8B-1717573782
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
Coding
LE
DeepMount00/Lexora-Medium-7B
Lexora · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
QW
Qwen/Qwen2-Math-7B
Qwen · featherless-ai-quants
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
LL
shibing624/llama-3-8b-instruct-262k-chinese
Llama · featherless-ai-quants
Params8.03B
Context256K
Q4_K_M4.9 GB
GGUF
SO
Changgil/K2S3-SOLAR-11b-v3.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
DBCMLAB/Llama-3-instruction-constructionsafety-layertuning
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
LeroyDyer/Mixtral_AI_SwahiliTron_7b
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
amazingvince/Not-WizardLM-2-7B
Not · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
DiscoResearch/Llama3-DiscoLeo-Instruct-8B-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
YA
yam-peleg/Experiment19-7B
Yam · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
lemon-mint/gemma-2b-translation-v0.122
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MC
williamlcn/6851_mcq_64_16_new_format
Mcq · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
AwanLLM/Meta-Llama-3-8B-Instruct-Dolfin-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
unsloth/Mistral-Nemo-Instruct-2407
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LL
ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.0
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
wons/mistral-7B-v0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
drudilorenzo/dpo_qwen2
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
SU
djuna/L3.1-Suze-Vume-calc
Suze · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
derek33125/llama3.2_1_400
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
AL
allknowingroger/Calmesmol-7B-slerp
Allknowingroger · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing