GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llama 2 13b FINETUNE5 4w r4 q k v o
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
NU
NuExtract Tiny v1.5
Nuextract · tensorblock
Params494M
Context32K
Smallest0.3 GB
Tool use
AG
AgentGym AgentEvol 7B
Agentevol · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
DE
Delexa 7b
Delexa · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Mixtral 7Bx4 MOE 24B
Mistral · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
GGUF
HE
LTC AI Labs L2 7b Hermes WVG Test
Hermes · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
Tool use
QW
Qwen Qwen2.5 Math 72B Instruct
Qwen · tensorblock
Params72.7B
Context4K
Smallest29.8 GB
Tool use
AP
FreedomIntelligence Apollo 6B
Apollo · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
GGUF
PO
Ibm PowerLM 3b
Powerlm · tensorblock
Params3.51B
Context4K
Smallest1.3 GB
GGUF
LL
Ytu Ce Cosmos Turkish Llama 8b Instruct v0.1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
VI
Vicuna Mmlu Val Only Correct Mcq 7b Ep2
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Llama 3.2 1B IELTS Eval Finetuned
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
Tool use
RM
H4rmoniousAnthea
Rmoniousanthea · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Mistral 7B with EOT token
Mistral · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
LL
Llama 8B Distill CoT
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
MA
MathLLMs MathCoder L 13B
Mathcoder · tensorblock
Params13B
Context4K
Smallest4.9 GB
Coding
KA
Karakuri Lm 8x7b Chat v0.1
Karakuri · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
GGUF
NE
OpenReasoning Nemotron 1.5B
Nemotron · tensorblock
Params1.54B
Context128K
Smallest0.7 GB
CodingReasoning
LL
Riddickz Llama 3.1 8B Instruct_kg3.5k_2e5
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
MA
MarcDareBeagle 7B
Marcdarebeagle · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
NE
NeuralQuant 9B
Neuralquant · tensorblock
Params8.99B
Context32K
Smallest3.4 GB
GGUF
LL
ArindamSingh Llama 3.2 3B Instruct FineTome100k 16bit
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
GGUF
DE
August4293 DeepSeek R1 Distill Qwen 1.5B With Output Tokens
DeepSeek · tensorblock
Params1.78B
Context128K
Smallest0.8 GB
ReasoningTool use
TO
Unbabel Tower Plus 9B
Tower · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv02.08
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
Reasoning
QW
calme-2.4-qwen2-7b
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
Tool use
PH
Phi3 ITA mini 4K instruct
Phi · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
GGUF
SE
Suhaibrashid17 Sexting
Sexting · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
MI
Mistralopithecus v1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Llama3 beomi Open Ko 8B Instruct preview test6
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF

Keep browsing