GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
EZO Llama 3.2 3B Instruct dpoE
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
QW
prithivMLmods Ophiuchi Qwen3 14B Instruct
Qwen · tensorblock
Params14.8B
Context40K
Smallest5.8 GB
DA
DataVortexS 10.7B Dpo v1.2
Datavortexs · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
MA
State Spaces Mamba 1.4b Hf
Mamba · tensorblock
Params1.37B
Context1024K
Smallest0.5 GB
LL
llama 7b finnish instruct v0.2
Llama · tensorblock
Params7B
Context2K
Smallest2.7 GB
LL
Stefanruseti Newsvibe Categories Multilingual Llama 1b
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
LL
Nvidia OpenMath2 Llama3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
QW
Qwen2 1.5B ITA Instruct
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
MI
Uukuguy Speechless Code Mistral 7b v1.0
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
PH
wafl phi3 mini 4k
Phi · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
MFANN Llama3.1 Abliterated Slerp TIES
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
NE
Neuronovo Neuronovo 9B v0.4
Neuronovo · tensorblock
Params8.99B
Context32K
Smallest3.4 GB
SM
SmolLM 360M
SmolLM · tensorblock
Params362M
Context2K
Smallest0.2 GB
QW
Qwen2-0.5B-stf-hh
Qwen · tensorblock
Params494M
Context128K
Smallest0.3 GB
LL
ModelCloud Llama3.2 1B Instruct
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
HO
Honyaku Multi Translator Swallow ms7b
Honyaku · tensorblock
Params7.33B
Context32K
Smallest2.8 GB
JU
judge eus
Judge · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
PL
Pfnet Plamo 13b Instruct
Plamo · tensorblock
Params13.1B
Context4K
Smallest4.9 GB
DO
Jarvis1111 DoctorAgent RL SFT 1k Thinking
Doctoragent · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
LL
Llama 2 13b chat dutch
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
Llama 3.1 70B Japanese Instruct 2407
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
OP
OpenHermes 2.5 neural chat v3 3 Slerp
Openhermes · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
PY
pythia 1.4b sft policy
Pythia · tensorblock
Params1.41B
Context2K
Smallest0.6 GB
PH
Samantha2.0 Phi3 Medium ita 16bit
Phi · tensorblock
Params14B
Context4K
Smallest5.2 GB
ET
futurehouse ether0
Ether · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
BI
Speakleash Bielik 11B v2.2 Instruct
Bielik · tensorblock
Params11.2B
Context32K
Smallest4.2 GB
LL
TheBloke CodeLlama 34B Python Fp16
Llama · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
LL
Norquinal llama 2 7b claude chat
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB