GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
SO
solar ko common merged
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
Llama2.C stories110M
Llama · tensorblock
Params134M
Context1K
Smallest0.1 GB
LL
Llama 3 8B Orpo v0.1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
QW
Qwen2.5 32B
Qwen · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
LL
Dart Math Llama3 8b Prop2Diff
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
Mistral RAG
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama 3 8B Instruct abliterated v2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
AS
L3 MS Astoria 70b
Astoria · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
AP
FreedomIntelligence Apollo 2B
Apollo · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
PO
POLAR 14B DPO v1.3
Polar · tensorblock
Params14.2B
Context4K
Smallest5.3 GB
MI
Minitron 8B Base
Minitron · tensorblock
Params8.27B
Context4K
Smallest3.6 GB
QW
Qwen Qwen1.5 0.5B
Qwen · tensorblock
Params620M
Context32K
Smallest0.3 GB
LL
Llama3 2B Base
Llama · tensorblock
Params2.36B
Context8K
Smallest1.1 GB
LL
Wons Llama2 13b Dpo Test v0.2
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
AM
Amber
Amber · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
MI
Hermes 2 Pro Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
DA
DataVortexS 10.7B Dpo v1.8
Datavortexs · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
FA
Falcon 7b
Falcon · tensorblock
Params7.22B
Context2K
Smallest3.9 GB
LL
LongWriter Llama3.1 8b
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
FI
Fimbulvetr 11B v2
Fimbulvetr · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
DE
RoguePlanet DeepSeek R1 Qwen 32B
DeepSeek · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
LL
Medical Llama3 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SW
Swallow MS 7b Instruct v0.1
Swallow · tensorblock
Params7.33B
Context4K
Smallest2.8 GB
LL
SKY Ko Llama3 8B lora
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
OL
Allenai OLMo 7B Hf
OLMo · tensorblock
Params6.89B
Context2K
Smallest2.6 GB
LL
Easy Ko Llama3 8b Instruct v1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
ST
Starling LM 7B beta ExPO
Starling · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
PH
Phi 3 Medium 4k Instruct
Phi · tensorblock
Params14B
Context4K
Smallest5.1 GB
GE
Genstruct
Genstruct · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SA
Sambanovasystems SambaLingo Arabic Base
Sambalingo · tensorblock
Params6.95B
Context4K
Smallest2.7 GB