GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
WI
WizardLMTeam WizardCoder 33B V1.1
Wizardcoder · tensorblock
Params33.3B
Context16K
Smallest12.4 GB
L1
L100MT
tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GE
Yam Peleg Hebrew Gemma 11B Instruct
Gemma · tensorblock
Params10.5B
Context8K
Smallest4.2 GB
CI
cicero 3 0
Cicero · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
Misted 7B
Misted · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LE
LDCC SOLAR 10.7B
Leaderboard · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
AI
Bhenrym14 Airoboros 33b Gpt4 1.4.1 Lxctx PI 16384 Fp16
Airoboros · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
SO
SOLARC MOE 10.7Bx4
Solarc · tensorblock
Params36.1B
Context4K
Smallest13.2 GB
HI
HikariBloom v0.3 RP
Hikaribloom · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
AT
Atlas Chat 2B
Atlas · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
LL
Llama2.C stories15M
Llama · tensorblock
Params15M
Context256
Smallest0.0 GB
JS
JSL MedPhi2 2.7B
Jsl · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
LL
Llama 3 Instruct 8B SimPO v0.2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
NE
NeuralPizza 7B V0.1
Neuralpizza · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GR
Ibm Granite Granite 20b Code Base R1.1
Granite · tensorblock
Params20.1B
Context8K
Smallest7.9 GB
LL
Kyujinpy PlatYi 34B Llama Q
Llama · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
NE
Uukuguy Neural Chat 7b v3 1 Dare 0.85
Neural · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SO
Sonya 7B
Sonya · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
NO
KBNIT Nox Solar 10.7b v4 Kolon ITD 5 v2.2
Nox · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
MU
MultiLora drop sharegpt
Multilora · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
HE
Healix 1.1B V1 Chat
Healix · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
LA
HiTZ Latxa 7b v1.2
Latxa · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
NE
NemoMix Unleashed 12B
Nemomix · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
KI
AI MO Kimina Prover Distill 1.7B
Kimi · tensorblock
Params2.03B
Context40K
Smallest0.9 GB
MI
mistral 7b instruct ko test v0.3
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
DO
QuyXuan Documents Master 3B
Documents · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
DA
DataVortexS dpov3
Datavortexs · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
QW
Jan Hq Qwen3 4B v0.3 Deepresearch 100 Step
Qwen · tensorblock
Params4.02B
Context40K
Smallest1.7 GB
ET
EtherealAurora 12B
Etherealaurora · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB