GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
GP
Gpt2 Medium
Gpt · tensorblock
Params406M
Context1K
Smallest0.2 GB
SU
Hardlyworking Sugma4B
Sugma · tensorblock
Params4.02B
Context32K
Smallest1.7 GB
LL
Wide Sheared LLaMA 290M
Llama · tensorblock
Params465M
Context4K
Smallest0.2 GB
LL
Llama 3 Taiwan 8B Instruct Rc2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
BA
Barcenas 2x10.7b Korean
Barcenas · tensorblock
Params7.24B
Context4K
Smallest2.7 GB
LL
Beomi Open Llama 2 Ko 7b
Llama · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
LL
awaisakhtar Llama 2 7b summarization finetuned on xsum
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
PY
Pythia 1b
Pythia · tensorblock
Params1.01B
Context2K
Smallest0.4 GB
LL
Llama 3 Base 8B SFT DPO
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
QI mistral 7B slerp
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
Minitron 4B Base
Minitron · tensorblock
Params4.19B
Context4K
Smallest1.9 GB
MI
Mistral 7B Instruct v0.2
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
PH
calme-2.1-phi3.5-4b
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
QW
lambda qwen2.5 32b dpo test
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
WI
ML4SE23 G1 WizardCoder SCoT 1B V1.0
Wizardcoder · tensorblock
Params1.24B
Context8K
Smallest0.6 GB
XD
xddd
Xddd · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
MB
MBX 7B v2
Mbx · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
YU
YuE s1 7B anneal zh icl
Yue · tensorblock
Params6.22B
Context16K
Smallest2.4 GB
QW
Lmstudio Community Qwen3 0.6B MLX Bf16
Qwen · tensorblock
Params596M
Context40K
Smallest0.3 GB
SK
Skywork Skywork SWE 32B
Skywork · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
LA
Lxcorp Lambda 1v 1B
Lambda · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
CO
Yongchao98 R1 Code Interpreter 14B
Code · tensorblock
Params14.8B
Context986K
Smallest5.8 GB
QW
OpenR1-Qwen-7B
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
OP
Open R1 OpenR1 Distill 7B
Openr · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
GE
Tiger Gemma 9B v1
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
QW
Lihengma Qwen 2.5 7B Instruct_2wiki_text_sfted
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
LL
Llama3 SFT v2.0 epoch3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
mesolitica llama 2b hf 32768 fpf
Llama · tensorblock
Params1.91B
Context32K
Smallest0.8 GB
YA
EEVE Korean 10.8B v1.0
Yanoljanext · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
OP
OpenCodeInterpreter DS 6.7B
Opencodeinterpreter · tensorblock
Params6.74B
Context16K
Smallest2.5 GB