GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
BL
Reeducator Bluemoonrp 13b
Bluemoonrp · tensorblock
Params13B
Context2K
Smallest0.0 GB
QW
Asap7772 Qwen3_4Blrablation_Filtered_0503_Lr1E6
Qwen · tensorblock
Params4.02B
Context32K
Smallest1.7 GB
KO
KoSOLAR 10.7B DPO Adapter Attach
Kosolar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
SK
Sky T1 32B Flash
Sky · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
LL
pgurazada1 llama2 7b conversation summarizer
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
MI
Changgil K2S3 Mistral 7b v1.1
Mistral · tensorblock
Params7.37B
Context32K
Smallest2.8 GB
MA
marin community marin 8b base
Marin · tensorblock
Params8.03B
Context4K
Smallest3.2 GB
MI
mistral7b lora multi turn v2
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
DP
yi ko 6b dpo further
Dpo · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
WI
BarryFutureman WildMarcoroni Variant1 7B
Wildmarcoroni · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
TO
TopEvolution
Topevolutionwiz · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SO
M SOLAR 10.7B v1.4
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
NE
NeuralMathChat 7B V0.2
Neuralmathchat · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Nkpz Llama2 22b Chat Wizard Uncensored
Llama · tensorblock
Params21.8B
Context2K
Smallest8.1 GB
MN
Sophiargh MNLP_M2_mcqa_model
Mnlp · tensorblock
Params596M
Context32K
Smallest0.3 GB
AF
Alphatao Affine 5956831
Affine · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
UH
uhhtest
Uhhtest · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
MI
Mlx Community Magistral Small 2506 Bf16
Mistral · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
LL
Llama 3 8B Jonathan aLLM Instruct v1.0
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
ME
mergekit v2
Mergekit · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
al baka llama3 8b experimental
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
ME
Klyang MentaLLaMA Chat 13B
Mentallama · tensorblock
Params13B
Context4K
Smallest4.9 GB
NO
Gwonny Nox Solar 10.7b v4 Kolon All 10
Nox · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
YI
Yi 34b 200K AEZAKMI RAW 1701
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
QW
Qwen Qwen3 8B MLX Bf16
Qwen · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
MI
DaewonChoi Mistral 160m Instruct
Mistral · tensorblock
Params162M
Context32K
Smallest0.1 GB
OP
open bio med merge
Open · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SI
StatPan SinGung7B DPO v0.1 12600c
Singung · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
BAAI Infinity Instruct 3M 0625 Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.09
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB