GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
ST
Stabilityai StableBeluga 7B
Stablebeluga · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
QW
TIGER Lab Qwen2.5 32B Instruct CFT
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
SO
SOLAR DUS implement
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
Vivian12300 Meta Llama 3 8B Instruct_gsm8k_English
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Dolphin 2.9 Llama3 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
DE
Tianqiao DeepSeek 7B Math Compare Answer
DeepSeek · tensorblock
Params6.89B
Context4K
Smallest2.7 GB
PH
Xenova Tiny Random Phi3ForCausalLM
Phi · tensorblock
Params2M
Context4K
Smallest0.0 GB
AC
Asas Ai AceGPT v2 32B
Acegpt · tensorblock
Params32.5B
Context32K
Smallest12.2 GB
SA
Sarvamai Sarvam M
Sarvam · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
MI
OpenLLM France Claire Mistral 7B 0.1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
ELYZA Japanese Llama 2 7b Fast
Llama · tensorblock
Params6.85B
Context4K
Smallest2.6 GB
LL
mohammedbriman llama 2 7b chat turkish instructions
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
MU
MultiverseEx26 7B slerp
Multiverseex · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
AI
airoboros 33b gpt4 1.4.1 PI 8192 fp16
Airoboros · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
SE
SeaLLMs SeaLLMs v3 1.5B Chat
Seallms · tensorblock
Params1.54B
Context128K
Smallest0.7 GB
LL
Meta Llama CodeLlama 13b Hf
Llama · tensorblock
Params13B
Context16K
Smallest4.9 GB
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
QW
Vikhr-Qwen-2.5-1.5B-Instruct
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
LL
Llama 3.1 Storm 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GP
Rhysjones Gpt2 774M Fineweb 150B
Gpt · tensorblock
Params838M
Context1K
Smallest0.3 GB
SO
T3Q SOLAR SLERP v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GE
gemma ko 7b instruct v0.52
Gemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
PY
EleutherAI Pythia 70m Deduped
Pythia · tensorblock
Params70M
Context2K
Smallest0.0 GB
SO
M SOLAR 10.7B v1.0 DPO
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
CR
Croissantllm CroissantCool v0.2
Croissantcool · tensorblock
Params1.35B
Context2K
Smallest0.6 GB
YI
Hyperion 3.0 Yi 34B
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
NE
NeuralPipe 7B slerp
Neuralpipe · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
PH
Phi 3 Mini 128k Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GR
Ibm Granite Granite 3.1 3b A800M Instruct
Granite · tensorblock
Params3.3B
Context128K
Smallest1.2 GB
MI
MiniMA 3B
Minima · tensorblock
Params3.02B
Context4K
Smallest1.2 GB