GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
OR
Orca Platypus kiwi 1epoch
Orca · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
MI
Mistral 7B Base SFT RDPO
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
TI
Tiny Cowboy 1.1b v0.1
Tiny · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
PH
Danielbrdz Barcenas 14b Phi 3 Medium ORPO
Phi · tensorblock
Params14B
Context4K
Smallest5.2 GB
GE
Google Gemma 2 27b It
Gemma · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
LL
Felladrin Smol Llama 101M Chat v1
Llama · tensorblock
Params101M
Context1K
Smallest0.0 GB
LL
LLaMAntino 2 Chat 13b Hf UltraChat ITA
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
MA
VishnuPJ MalayaLLM_7B_Instruct_v0.2
Malayallm · tensorblock
Params6.88B
Context4K
Smallest2.6 GB
MO
Mtgv MobileLLaMA 1.4B Base
Mobilellama · tensorblock
Params1.36B
Context2K
Smallest0.5 GB
GR
Ibm Granite Granite 3.1 2b Instruct
Granite · tensorblock
Params2.53B
Context128K
Smallest1.0 GB
BL
Bigscience Bloom 1b1
Bloom · tensorblock
Params1.45B
Context2K
Smallest0.7 GB
ZE
zeta
Zeta · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
QW
Mlx Community Qwen3 4B Bf16
Qwen · tensorblock
Params4.02B
Context40K
Smallest1.7 GB
QW
Goekdeniz Guelmez Josiefied Qwen3 8B Abliterated v1
Qwen · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
QW
Qwen Qwen1.5 32B
Qwen · tensorblock
Params32.5B
Context32K
Smallest12.2 GB
FA
falcon mamba 7b
Falcon · tensorblock
Params7.27B
Context1024K
Smallest2.6 GB
GP
Openai Community Gpt2 Xl
Gpt · tensorblock
Params1.64B
Context1K
Smallest0.9 GB
LL
Llama 3 uncensored Dare 1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GE
Gemma 2 27b It
Gemma · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
QW
Qwen QwQ 32B
Qwen · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
LL
Abacusai Llama 3 Smaug 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
TI
TinyLlama 1.1B Chat v0.3
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
MI
Malhajar Mistral 7B v0.1 Arabic
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
OR
Abacusai MM Orc Vic Bagel 34b C1000
Orc · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
MI
beowolx MistralHermes CodePro 7B v1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
NE
Monarch 7B
Neuralmonarch · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
ystemsrx Qwen2 Boundless
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
MN
NaykinYT MNLP_M2_dpo_model
Mnlp · tensorblock
Params596M
Context32K
Smallest0.3 GB
CH
chinese text correction 7b
Chinese · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
MI
Mncai Mistral 7B CollectiveCognition
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB