GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GP
Gpt2 Medium
Gpt · tensorblock
Params406M
Context1K
Smallest0.2 GB
GGUF
SU
Hardlyworking Sugma4B
Sugma · tensorblock
Params4.02B
Context32K
Smallest1.7 GB
ReasoningTool use
LL
Wide Sheared LLaMA 290M
Llama · tensorblock
Params465M
Context4K
Smallest0.2 GB
GGUF
LL
Llama 3 Taiwan 8B Instruct Rc2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
BA
Barcenas 2x10.7b Korean
Barcenas · tensorblock
Params7.24B
Context4K
Smallest2.7 GB
GGUF
LL
Beomi Open Llama 2 Ko 7b
Llama · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
GGUF
LL
awaisakhtar Llama 2 7b summarization finetuned on xsum
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
PY
Pythia 1b
Pythia · tensorblock
Params1.01B
Context2K
Smallest0.4 GB
GGUF
LL
Llama 3 Base 8B SFT DPO
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MI
QI mistral 7B slerp
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Minitron 4B Base
Minitron · tensorblock
Params4.19B
Context4K
Smallest1.9 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
PH
calme-2.1-phi3.5-4b
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
QW
lambda qwen2.5 32b dpo test
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
Tool use
WI
ML4SE23 G1 WizardCoder SCoT 1B V1.0
Wizardcoder · tensorblock
Params1.24B
Context8K
Smallest0.6 GB
Coding
XD
xddd
Xddd · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Tool use
MB
MBX 7B v2
Mbx · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
YU
YuE s1 7B anneal zh icl
Yue · tensorblock
Params6.22B
Context16K
Smallest2.4 GB
GGUF
QW
Lmstudio Community Qwen3 0.6B MLX Bf16
Qwen · tensorblock
Params596M
Context40K
Smallest0.3 GB
ReasoningTool use
SK
Skywork Skywork SWE 32B
Skywork · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
Tool use
LA
Lxcorp Lambda 1v 1B
Lambda · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
CO
Yongchao98 R1 Code Interpreter 14B
Code · tensorblock
Params14.8B
Context986K
Smallest5.8 GB
CodingReasoningTool use
QW
OpenR1-Qwen-7B
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
ReasoningTool use
OP
Open R1 OpenR1 Distill 7B
Openr · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Reasoning
GE
Tiger Gemma 9B v1
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
QW
Lihengma Qwen 2.5 7B Instruct_2wiki_text_sfted
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
LL
Llama3 SFT v2.0 epoch3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
mesolitica llama 2b hf 32768 fpf
Llama · tensorblock
Params1.91B
Context32K
Smallest0.8 GB
GGUF
YA
EEVE Korean 10.8B v1.0
Yanoljanext · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
OP
OpenCodeInterpreter DS 6.7B
Opencodeinterpreter · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding

Keep browsing