GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
EX
LGAI EXAONE EXAONE Deep 2.4B
Exaone · tensorblock
Params2.41B
Context32K
Smallest1.0 GB
GGUF
IN
Internlm SWE Fixer Retriever 7B
InternLM · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
CodingTool use
MU
multi verse model
Multi · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Llama3 instrucTrans Enko 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Trendmicro Ailab Llama Primus Merged
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
QW
Duchao1210 Qwen_2.5_Sft_1K_R16
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Tool use
OR
OrionStarAI Orion 14B Chat Plugin
Orion · tensorblock
Params14.5B
Context4K
Smallest5.5 GB
Coding
MI
PiVoT 10.7B Mistral v0.2
Mistral · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
GGUF
GP
gpt2 guanaco dolly platypus
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
SQ
defog sqlcoder2
Sqlcoder · tensorblock
Params15.8B
Context8K
Smallest6.3 GB
Coding
ME
Meditron 7b
Meditron · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
HY
Hyperspaceai hyperEngine_8B_vars_2
Hyperengine · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
PL
Lukamac PlayPart AI Personal Trainer
Playpart · tensorblock
Params124M
Context1K
Smallest0.1 GB
GGUF
LL
Krevas LDCC Instruct Llama 2 Ko 13B v4.1.12
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
LL
Llama 2 7b Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
GR
GritLM 7B
Gritlm · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ST
Storytime 13b
Storytime · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
Llama3 Med42 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Felladrin Llama 68M Chat v1
Llama · tensorblock
Params68M
Context2K
Smallest0.0 GB
GGUF
BL
blockchainlabs_7B_merged_test2_4
Blockchainlabs · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QR
Qra 13B chat
Qra · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
AL
Alpaca spin gpt2 e0 se1
Alpaca · tensorblock
Params838M
Context1K
Smallest0.3 GB
GGUF
YA
EEVE Korean Instruct 10.8B v1.0
Yanoljanext · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
LL
Llama3 merge biomed 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
GE
Gemma 2 9b
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
WI
wiroai turkish llm 8b
Wiroai · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
AH
Finnish NLP Ahma 7B
Ahma · tensorblock
Params7B
Context2K
Smallest2.7 GB
GGUF
AL
MARIO Math Reasoning AlphaMath 7B
Alphamath · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
Reasoning
KW
Kwaipilot KwaiCoder 23B A4B v1
Kwaicoder · tensorblock
Params23.3B
Context4K
Smallest9.5 GB
Coding

Keep browsing