GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
EX
LGAI EXAONE EXAONE Deep 2.4B
Exaone · tensorblock
Params2.41B
Context32K
Smallest1.0 GB
IN
Internlm SWE Fixer Retriever 7B
InternLM · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
MU
multi verse model
Multi · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama3 instrucTrans Enko 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Trendmicro Ailab Llama Primus Merged
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
QW
Duchao1210 Qwen_2.5_Sft_1K_R16
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
OR
OrionStarAI Orion 14B Chat Plugin
Orion · tensorblock
Params14.5B
Context4K
Smallest5.5 GB
MI
PiVoT 10.7B Mistral v0.2
Mistral · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
GP
gpt2 guanaco dolly platypus
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
SQ
defog sqlcoder2
Sqlcoder · tensorblock
Params15.8B
Context8K
Smallest6.3 GB
ME
Meditron 7b
Meditron · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
HY
Hyperspaceai hyperEngine_8B_vars_2
Hyperengine · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
PL
Lukamac PlayPart AI Personal Trainer
Playpart · tensorblock
Params124M
Context1K
Smallest0.1 GB
LL
Krevas LDCC Instruct Llama 2 Ko 13B v4.1.12
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
LL
Llama 2 7b Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GR
GritLM 7B
Gritlm · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
ST
Storytime 13b
Storytime · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
Llama3 Med42 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Felladrin Llama 68M Chat v1
Llama · tensorblock
Params68M
Context2K
Smallest0.0 GB
BL
blockchainlabs_7B_merged_test2_4
Blockchainlabs · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QR
Qra 13B chat
Qra · tensorblock
Params13B
Context4K
Smallest4.9 GB
AL
Alpaca spin gpt2 e0 se1
Alpaca · tensorblock
Params838M
Context1K
Smallest0.3 GB
YA
EEVE Korean Instruct 10.8B v1.0
Yanoljanext · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
LL
Llama3 merge biomed 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GE
Gemma 2 9b
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
WI
wiroai turkish llm 8b
Wiroai · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
AH
Finnish NLP Ahma 7B
Ahma · tensorblock
Params7B
Context2K
Smallest2.7 GB
AL
MARIO Math Reasoning AlphaMath 7B
Alphamath · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
KW
Kwaipilot KwaiCoder 23B A4B v1
Kwaicoder · tensorblock
Params23.3B
Context4K
Smallest9.5 GB