GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
ML
Mlfoundations Dev opencodereasoning_32B
Mlfoundations · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
CodingReasoningTool use
QW
Yuuta208 Qwen2.5 7B Instruct Qwen2.5 Math 7B Instruct Merged Ties 29
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
QW
C10X Qwen3 0.6B Fp32
Qwen · tensorblock
Params596M
Context40K
Smallest0.3 GB
ReasoningTool use
BE
beril
Beril · tensorblock
Params615M
Context32K
Smallest0.4 GB
GGUF
LU
Menlo Lucy 128k
Lucy · tensorblock
Params1.72B
Context128K
Smallest0.8 GB
GGUF
SE
semcoder
Semcoder · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
LL
Daekeun Ml Llama 2 Ko DPO 13B
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
MN
Nfelber MNLP_M3_mcqa_model
Mnlp · tensorblock
Params596M
Context32K
Smallest0.3 GB
GGUF
QU
Quyen Pro v0.1
Quyen · tensorblock
Params14.2B
Context32K
Smallest5.9 GB
Tool use
RA
RaoFoundation 774M 03_09_2024
tensorblock
Params770M
Context1K
Smallest0.3 GB
GGUF
LO
Loyal Toppy Bruins Maid 7B DARE
Loyal · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
TheBloke Samantha 1 1 Llama 7B SuperHOT 8K Fp16
Llama · tensorblock
Params6.74B
Context8K
Smallest2.5 GB
GGUF
MI
NeuralHermes 2.5 Mistral 7B distilabel
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Tool use
OL
Amd AMD OLMo 1B SFT
OLMo · tensorblock
Params1.18B
Context2K
Smallest0.5 GB
GGUF
LE
Yi_lee v2 DPO 6B
Lee · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
LL
Meta Llama CodeLlama 34b Hf
Llama · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
Coding
YI
Brucethemoose Yi 34B 200K DARE Merge v7
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
QW
Turboderp Qwama 0.5B Instruct
Qwama · tensorblock
Params473M
Context32K
Smallest0.3 GB
GGUF
RA
Rabbit 7B v2 DPO Chat
Rabbit · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QW
stellialm smallfr qwen7b lead
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
SO
T3Q ko solar dpo v3.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
FA
Fanar 1 9B
Fanar · tensorblock
Params8.78B
Context4K
Smallest3.4 GB
GGUF
LL
FlagAlpha Llama3 Chinese 8B Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
GE
EZO Common 9B gemma 2 it
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
ML
Mlfoundations Dev Mlfoundations Dev_Code Stratos Verified Scaled 0_5_stratos_7b
Mlfoundations · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
CodingTool use
NE
Kukedlc NeuTrixOmniBe DPO
Neutrixomnibe · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
TI
Tito 7B slerp
Tito · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
DA
H2O Danube 1.8b Base
Danube · tensorblock
Params1.83B
Context16K
Smallest0.7 GB
GGUF
GE
Gemma 2 9b It SimPO
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
SA
Kyujinpy Sakura SOLAR Instruct DPO v2
Sakura · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF

Keep browsing