GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Wwwwwwz MARC_QWEN3_4B
Qwen · tensorblock
Params4.02B
Context40K
Smallest1.7 GB
GGUF
LL
MiniThinky v2 1B Llama 3.2
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
GGUF
ME
T3Q Merge SOLAR12
Merge · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
MA
mahiatlinux MasherAI v6.1 7B checkpoint3 code3
Masherai · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
OR
Orca Hermes 7B slerp
Orca · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Tool use
SO
Tanitan2 SOLAR 10.7B Instruct T3Q Ko Solar Dpo Ties
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
QW
Alibaba Pai Pai Qwen1_5 7b Doc2Qa
Qwen · tensorblock
Params7.72B
Context32K
Smallest3.1 GB
GGUF
DE
Deepseek Ai Deepseek Math 7b Instruct
DeepSeek · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
GGUF
LL
Dampfinchen Llama 3 8B Ultra Instruct SaltSprinkle
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
DA
Kooten DaringMaid 13B
Daringmaid · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
MI
Mistral Pygmalion 7b
Mistral · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
CO
ConfigurableHermes 7B
Configurablehermes · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Tool use
CO
01 Ai Yi Coder 9B
Coder · tensorblock
Params8.83B
Context128K
Smallest3.4 GB
Coding
MI
MixtureofMerges MoE 4x7b v4
Mixtureofmerges · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
GGUF
LL
VMware Open Llama 7b v2 Open Instruct
Llama · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
GE
Gemma 2 9b It
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
LL
SELM Llama 3 8B Instruct iter 1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MI
Mrfakename Mistral Small 3.1 24b Base 2503 Hf
Mistral · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
GGUF
PA
redrix patricide 12B Unslop Mell
Patricide · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
Roleplay
MO
Morfoz Aigap Morfoz LLM 8b v1.0
Morfoz · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
SM
SmolLM prompt generator
SmolLM · tensorblock
Params135M
Context2K
Smallest0.1 GB
Vision
EV
Evac Opus 14B Exp
Evac · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
Tool use
DE
KnutJaegersberg Deacon 1b
Deacon · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
DI
dictalm2.0 instruct fine tuned alpaca gpt4 hebrew
Dictalm · tensorblock
Params7.25B
Context32K
Smallest2.7 GB
GGUF
SY
maywell Synatra 7B Instruct v0.3 pre2
Synatra · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Etri Xainlp Llama2 12.8b_lora Dpo_V1
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
S1
s1k
tensorblock
Params32.8B
Context32K
Smallest12.3 GB
Tool use
LL
AISquare Instruct llama2 koen 13b v0.9.20
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
MA
magnum v4 27b
Magnum · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
GGUF
PS
Psyfighter2 Noromaid Ties 13B
Psyfighter · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF

Keep browsing