GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
llama 2 13b FINETUNE5 4w r4 q k v o
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
NU
NuExtract Tiny v1.5
Nuextract · tensorblock
Params494M
Context32K
Smallest0.3 GB
AG
AgentGym AgentEvol 7B
Agentevol · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
DE
Delexa 7b
Delexa · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
Mixtral 7Bx4 MOE 24B
Mistral · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
HE
LTC AI Labs L2 7b Hermes WVG Test
Hermes · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
QW
Qwen Qwen2.5 Math 72B Instruct
Qwen · tensorblock
Params72.7B
Context4K
Smallest29.8 GB
AP
FreedomIntelligence Apollo 6B
Apollo · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
PO
Ibm PowerLM 3b
Powerlm · tensorblock
Params3.51B
Context4K
Smallest1.3 GB
LL
Ytu Ce Cosmos Turkish Llama 8b Instruct v0.1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
VI
Vicuna Mmlu Val Only Correct Mcq 7b Ep2
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
Llama 3.2 1B IELTS Eval Finetuned
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
RM
H4rmoniousAnthea
Rmoniousanthea · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
Mistral 7B with EOT token
Mistral · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
LL
Llama 8B Distill CoT
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
MA
MathLLMs MathCoder L 13B
Mathcoder · tensorblock
Params13B
Context4K
Smallest4.9 GB
KA
Karakuri Lm 8x7b Chat v0.1
Karakuri · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · tensorblock
Params1.54B
Context128K
Smallest0.7 GB
LL
Riddickz Llama 3.1 8B Instruct_kg3.5k_2e5
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
MA
MarcDareBeagle 7B
Marcdarebeagle · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
NE
NeuralQuant 9B
Neuralquant · tensorblock
Params8.99B
Context32K
Smallest3.4 GB
LL
ArindamSingh Llama 3.2 3B Instruct FineTome100k 16bit
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
DE
August4293 DeepSeek R1 Distill Qwen 1.5B With Output Tokens
DeepSeek · tensorblock
Params1.78B
Context128K
Smallest0.8 GB
TO
Unbabel Tower Plus 9B
Tower · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.08
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
QW
calme-2.4-qwen2-7b
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
PH
Phi3 ITA mini 4K instruct
Phi · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
SE
Suhaibrashid17 Sexting
Sexting · tensorblock
Params163M
Context1K
Smallest0.1 GB
MI
Mistralopithecus v1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama3 beomi Open Ko 8B Instruct preview test6
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB