GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
QW
Wwwwwwz MARC_QWEN3_4B
Qwen · tensorblock
Params4.02B
Context40K
Smallest1.7 GB
LL
MiniThinky v2 1B Llama 3.2
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
ME
T3Q Merge SOLAR12
Merge · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
MA
mahiatlinux MasherAI v6.1 7B checkpoint3 code3
Masherai · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
OR
Orca Hermes 7B slerp
Orca · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SO
Tanitan2 SOLAR 10.7B Instruct T3Q Ko Solar Dpo Ties
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
QW
Alibaba Pai Pai Qwen1_5 7b Doc2Qa
Qwen · tensorblock
Params7.72B
Context32K
Smallest3.1 GB
DE
Deepseek Ai Deepseek Math 7b Instruct
DeepSeek · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
LL
Dampfinchen Llama 3 8B Ultra Instruct SaltSprinkle
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
DA
Kooten DaringMaid 13B
Daringmaid · tensorblock
Params13B
Context4K
Smallest4.9 GB
MI
Mistral Pygmalion 7b
Mistral · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
CO
ConfigurableHermes 7B
Configurablehermes · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
CO
01 Ai Yi Coder 9B
Coder · tensorblock
Params8.83B
Context128K
Smallest3.4 GB
MI
MixtureofMerges MoE 4x7b v4
Mixtureofmerges · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
LL
VMware Open Llama 7b v2 Open Instruct
Llama · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GE
Gemma 2 9b It
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
LL
SELM Llama 3 8B Instruct iter 1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
Mrfakename Mistral Small 3.1 24b Base 2503 Hf
Mistral · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
PA
redrix patricide 12B Unslop Mell
Patricide · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
MO
Morfoz Aigap Morfoz LLM 8b v1.0
Morfoz · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SM
SmolLM prompt generator
SmolLM · tensorblock
Params135M
Context2K
Smallest0.1 GB
EV
Evac Opus 14B Exp
Evac · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
DE
KnutJaegersberg Deacon 1b
Deacon · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
DI
dictalm2.0 instruct fine tuned alpaca gpt4 hebrew
Dictalm · tensorblock
Params7.25B
Context32K
Smallest2.7 GB
SY
maywell Synatra 7B Instruct v0.3 pre2
Synatra · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Etri Xainlp Llama2 12.8b_lora Dpo_V1
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
S1
s1k
tensorblock
Params32.8B
Context32K
Smallest12.3 GB
LL
AISquare Instruct llama2 koen 13b v0.9.20
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
MA
magnum v4 27b
Magnum · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
PS
Psyfighter2 Noromaid Ties 13B
Psyfighter · tensorblock
Params13B
Context4K
Smallest4.9 GB