GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma 7
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
GGUF
AL
Alpaca refine gpt2 e0 se1
Alpaca · tensorblock
Params838M
Context1K
Smallest0.3 GB
GGUF
MI
Nous Hermes 2 Mixtral 8x7B DPO
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
Tool use
PH
Moxoff Phi3Mini ORPO
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
Coding
BA
Bagel Dpo 8x7b v0.2
Bagel · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
CodingRoleplay
MI
Yarn Mistral 7b 64k
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Llama medx v3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
FA
Falcon2 5.5B Polish
Falcon · tensorblock
Params5.47B
Context2K
Smallest2.2 GB
GGUF
NE
Intel Neural Chat 7b v3 2
Neural · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QW
Sunblaze Ucb Qwen2.5 3B Intuitor MATH 1EPOCH
Qwen · tensorblock
Params3.4B
Context32K
Smallest1.4 GB
Tool use
YI
Abhishekchohan Yi 9B Forest DPO v1.0
Yi · tensorblock
Params8.83B
Context4K
Smallest3.4 GB
GGUF
NE
NeuralMarcoro14 7B
Neuralmarcoro · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
OL
Stellalisy Olmo2_Math_7B
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
GGUF
GL
Arcee Ai GLM 4 32B Base 32K
GLM · tensorblock
Params32.6B
Context32K
Smallest12.3 GB
GGUF
YI
Instruct Yi 6B Dolly15K
Yi · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
GGUF
LL
Shariar076 Llama 3.1 8B Instruct DPO 0R100L PoliTune
Llama · tensorblock
Params21M
Context128K
Smallest0.0 GB
Tool use
QW
Ypwang61 One Shot RLVR Qwen2.5 Math 1.5B Pi1
Qwen · tensorblock
Params1.78B
Context4K
Smallest0.8 GB
Tool use
MI
Zyh3826 GML Mistral Merged v1
Mistral · tensorblock
Params8.99B
Context32K
Smallest3.4 GB
GGUF
LL
LLaMA O1 Supervised 1129
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
GP
Gpt2_Finetune_Alpaca
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
LL
Lyraea large llama 3.1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
ST
Stabilityai Stablelm 2 12b
Stablelm · tensorblock
Params12.1B
Context4K
Smallest4.7 GB
Coding
LL
hivaze ParaLex Llama 3 8B SFT
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
TE
k2s3 test 0002
Test · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
openbuddy llama3.1 8b v22.3 131k
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
OC
Occiglot 7b De En Instruct
Occiglot · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
PH
Failspy Phi 3 Medium 4k Instruct Abliterated v3
Phi · tensorblock
Params14B
Context4K
Smallest5.1 GB
Coding
QW
Zekunli Qwen2.5 7b Alpaca Discrim Cot
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
GGUF
DE
KnutJaegersberg Deacon 20B
Deacon · tensorblock
Params20.1B
Context4K
Smallest7.6 GB
GGUF

Keep browsing