GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
Stabilityai StableBeluga 7B
Stablebeluga · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
QW
TIGER Lab Qwen2.5 32B Instruct CFT
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
ReasoningTool use
SO
SOLAR DUS implement
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
Vivian12300 Meta Llama 3 8B Instruct_gsm8k_English
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Dolphin 2.9 Llama3 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
DE
Tianqiao DeepSeek 7B Math Compare Answer
DeepSeek · tensorblock
Params6.89B
Context4K
Smallest2.7 GB
GGUF
PH
Xenova Tiny Random Phi3ForCausalLM
Phi · tensorblock
Params2M
Context4K
Smallest0.0 GB
GGUF
AC
Asas Ai AceGPT v2 32B
Acegpt · tensorblock
Params32.5B
Context32K
Smallest12.2 GB
GGUF
SA
Sarvamai Sarvam M
Sarvam · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
Reasoning
MI
OpenLLM France Claire Mistral 7B 0.1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
ELYZA Japanese Llama 2 7b Fast
Llama · tensorblock
Params6.85B
Context4K
Smallest2.6 GB
GGUF
LL
mohammedbriman llama 2 7b chat turkish instructions
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
MU
MultiverseEx26 7B slerp
Multiverseex · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AI
airoboros 33b gpt4 1.4.1 PI 8192 fp16
Airoboros · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
GGUF
SE
SeaLLMs SeaLLMs v3 1.5B Chat
Seallms · tensorblock
Params1.54B
Context128K
Smallest0.7 GB
GGUF
LL
Meta Llama CodeLlama 13b Hf
Llama · tensorblock
Params13B
Context16K
Smallest4.9 GB
Coding
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
QW
Vikhr-Qwen-2.5-1.5B-Instruct
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
Tool use
LL
Llama 3.1 Storm 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
GP
Rhysjones Gpt2 774M Fineweb 150B
Gpt · tensorblock
Params838M
Context1K
Smallest0.3 GB
GGUF
SO
T3Q SOLAR SLERP v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
GE
gemma ko 7b instruct v0.52
Gemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
GGUF
PY
EleutherAI Pythia 70m Deduped
Pythia · tensorblock
Params70M
Context2K
Smallest0.0 GB
GGUF
SO
M SOLAR 10.7B v1.0 DPO
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
CR
Croissantllm CroissantCool v0.2
Croissantcool · tensorblock
Params1.35B
Context2K
Smallest0.6 GB
Coding
YI
Hyperion 3.0 Yi 34B
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
Coding
NE
NeuralPipe 7B slerp
Neuralpipe · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Tool use
PH
Phi 3 Mini 128k Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
GR
Ibm Granite Granite 3.1 3b A800M Instruct
Granite · tensorblock
Params3.3B
Context128K
Smallest1.2 GB
Tool use
MI
MiniMA 3B
Minima · tensorblock
Params3.02B
Context4K
Smallest1.2 GB
GGUF

Keep browsing