GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
Codellama 7b
Llama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
GE
Gemma2 Farsi
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
LL
Open_Llama_3B_V2
Llama · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
LL
Llama 3 Instruct 8B SLiC HF
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
NP
NPC LLM 3 8B
Npc · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
OR
NewstaR 7B Orfini
Orfini · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
Masani SFT_modgsm8k_Llama 3.2 3B_epoch_1_global_step_25
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
ME
Unsloth Medgemma 27b Text It
Medgemma · tensorblock
Params27B
Context128K
Smallest10.5 GB
LL
Llama 3.1 Nemotron Nano 4B v1.1
Llama · tensorblock
Params4.51B
Context128K
Smallest1.8 GB
LL
Yujiepan Llama 3.3 Tiny Random Dim64
Llama · tensorblock
Params8M
Context128K
Smallest0.0 GB
LL
Llama 3.1 Tulu 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
PA
Gryphe Pantheon Proto RP 1.8 30B A3B
Pantheon · tensorblock
Params30.5B
Context32K
Smallest11.3 GB
LL
Masani SFT_gsm8k t2_Llama 3.2 1B_epoch_1_global_step_15
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
LL
Llama 2 Koen 13b
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
CL
CleverGirl 20b
Clevergirl · tensorblock
Params20B
Context4K
Smallest7.4 GB
CA
calme-3.2-instruct-3b
Calme · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
TI
Felladrin TinyMistral 248M Chat v2
Tinymistral · tensorblock
Params248M
Context2K
Smallest0.1 GB
SO
Kyujinpy SOLAR Platypus 10.7B v1
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
llama3 8b sft ultrafb
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
TE
k2s3 test 24001
Test · tensorblock
Params13B
Context4K
Smallest4.9 GB
SA
Sambanovasystems SambaLingo Thai Base
Sambalingo · tensorblock
Params6.95B
Context4K
Smallest2.7 GB
PY
TehVenom Pygmalion Vicuna 1.1 7b
Pygmalion · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
SA
Saiga_Tlite_8B_Abliterated_Sft_M1_D9
Saiga · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
TaylorAI Flash Llama 1B Zombie
Llama · tensorblock
Params1.28B
Context4K
Smallest0.5 GB
MI
mistral ft optimized 1227
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Collaiborator MEDLLM Llama 3 8B v1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
OR
orthogonal 2x7B base
Orthogonal · tensorblock
Params12.9B
Context32K
Smallest4.8 GB
LL
Llama 3 8b It Ko Chang
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
EX
Yam Peleg Experiment25 7B
Experiment · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
ST
stackexchange physics
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB