GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TE
DL11
Tensorblock · tensorblock
Params7.72B
Context128K
Smallest3.1 GB
GGUF
QW
Lihengma Qwen 2.5 7B Instruct_2wiki_kg_sfted
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
QW
JIAN PENG LLM Beyond Base Model qwen2.5 3b v2
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Tool use
GE
Datumo Gemma3 12B Q Generation LoRA Rank32 Merged
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
GGUF
GE
lemon mint gemma 2b translation v0.90
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
GGUF
LL
llama2 7b chat hf v2
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
PH
Thytu Phi 2 Audio Super
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
DE
Dear My best Friends v2 13B
Dear · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
QW
krx qwen2 7b instruct v2
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
GGUF
GP
gpt2 implicit cot multiplication 20 digits
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
LL
LLaMa3 8b WangchanX sft Full
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama 2 Koen 13b
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
OC
occiglot 7b fr en
Occiglot · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
heegyu llama 2 ko 7b chat
Llama · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
GGUF
QW
Qwen1.5 0.5B
Qwen · tensorblock
Params464M
Context32K
Smallest0.2 GB
GGUF
OP
OpenThinker 7B
Openthinker · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
LL
vicgalle Configurable Llama 3 8B v0.2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
TI
tigerbot 13b test v0 1
Tigerbot · tensorblock
Params13.3B
Context2K
Smallest5.0 GB
GGUF
JS
JSL MedLlama 3 8B v2.0
Jsl · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
GR
Ibm Granite Granite 3b Code Base 128k
Granite · tensorblock
Params3.48B
Context125K
Smallest1.3 GB
Coding
LL
Llama 3 Alpha Ko 8B Instruct v0.2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
KA
Kakaocorp Kanana Nano 2.1b Base
Kanana · tensorblock
Params2.09B
Context8K
Smallest0.9 GB
GGUF
RE
rebel ultrafeedback armo OneBatch newprob full lr 3e 7 eta 1e6 bs 128 1722343397
Rebel · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
QU
Quantum v0.01
Quantum · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Mistral 7b Dpo Merge v1.1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QW
Qwen-2.5-7B-RL-LACPO-BaselineNoKLNoEntropyNoSmoothSoftLabelNormAdv
Qwen · tensorblock
Params7.62B
Context4K
Smallest3.0 GB
ReasoningTool use
LL
Felladrin Llama 160M Chat v1
Llama · tensorblock
Params162M
Context2K
Smallest0.1 GB
GGUF
MA
magnum v2.5 12b kto
Magnum · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
ME
Meditron 7b
Meditron · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
LI
ds-limo-te-100
Limo · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
ReasoningTool use

Keep browsing