GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
TE
DL11
Tensorblock · tensorblock
Params7.72B
Context128K
Smallest3.1 GB
QW
Lihengma Qwen 2.5 7B Instruct_2wiki_kg_sfted
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
QW
JIAN PENG LLM Beyond Base Model qwen2.5 3b v2
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
GE
Datumo Gemma3 12B Q Generation LoRA Rank32 Merged
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
GE
lemon mint gemma 2b translation v0.90
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
LL
llama2 7b chat hf v2
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
PH
Thytu Phi 2 Audio Super
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
DE
Dear My best Friends v2 13B
Dear · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
QW
krx qwen2 7b instruct v2
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
GP
gpt2 implicit cot multiplication 20 digits
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
LL
LLaMa3 8b WangchanX sft Full
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Llama 2 Koen 13b
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
OC
occiglot 7b fr en
Occiglot · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
heegyu llama 2 ko 7b chat
Llama · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
QW
Qwen1.5 0.5B
Qwen · tensorblock
Params464M
Context32K
Smallest0.2 GB
OP
OpenThinker 7B
Openthinker · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
LL
vicgalle Configurable Llama 3 8B v0.2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
TI
tigerbot 13b test v0 1
Tigerbot · tensorblock
Params13.3B
Context2K
Smallest5.0 GB
JS
JSL MedLlama 3 8B v2.0
Jsl · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GR
Ibm Granite Granite 3b Code Base 128k
Granite · tensorblock
Params3.48B
Context125K
Smallest1.3 GB
LL
Llama 3 Alpha Ko 8B Instruct v0.2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
KA
Kakaocorp Kanana Nano 2.1b Base
Kanana · tensorblock
Params2.09B
Context8K
Smallest0.9 GB
RE
rebel ultrafeedback armo OneBatch newprob full lr 3e 7 eta 1e6 bs 128 1722343397
Rebel · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
QU
Quantum v0.01
Quantum · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
Mistral 7b Dpo Merge v1.1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
Qwen-2.5-7B-RL-LACPO-BaselineNoKLNoEntropyNoSmoothSoftLabelNormAdv
Qwen · tensorblock
Params7.62B
Context4K
Smallest3.0 GB
LL
Felladrin Llama 160M Chat v1
Llama · tensorblock
Params162M
Context2K
Smallest0.1 GB
MA
magnum v2.5 12b kto
Magnum · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
ME
Meditron 7b
Meditron · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
LI
ds-limo-te-100
Limo · tensorblock
Params7.62B
Context128K
Smallest3.0 GB