GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
GE
gemma 7
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
AL
Alpaca refine gpt2 e0 se1
Alpaca · tensorblock
Params838M
Context1K
Smallest0.3 GB
MI
Nous Hermes 2 Mixtral 8x7B DPO
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
PH
Moxoff Phi3Mini ORPO
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
PH
Phi 3 Mini 128k Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
BA
Bagel Dpo 8x7b v0.2
Bagel · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
MI
Yarn Mistral 7b 64k
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama medx v3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
FA
Falcon2 5.5B Polish
Falcon · tensorblock
Params5.47B
Context2K
Smallest2.2 GB
NE
Intel Neural Chat 7b v3 2
Neural · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
Sunblaze Ucb Qwen2.5 3B Intuitor MATH 1EPOCH
Qwen · tensorblock
Params3.4B
Context32K
Smallest1.4 GB
YI
Abhishekchohan Yi 9B Forest DPO v1.0
Yi · tensorblock
Params8.83B
Context4K
Smallest3.4 GB
NE
NeuralMarcoro14 7B
Neuralmarcoro · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
OL
Stellalisy Olmo2_Math_7B
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
GL
Arcee Ai GLM 4 32B Base 32K
GLM · tensorblock
Params32.6B
Context32K
Smallest12.3 GB
YI
Instruct Yi 6B Dolly15K
Yi · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
LL
Shariar076 Llama 3.1 8B Instruct DPO 0R100L PoliTune
Llama · tensorblock
Params21M
Context128K
Smallest0.0 GB
QW
Ypwang61 One Shot RLVR Qwen2.5 Math 1.5B Pi1
Qwen · tensorblock
Params1.78B
Context4K
Smallest0.8 GB
MI
Zyh3826 GML Mistral Merged v1
Mistral · tensorblock
Params8.99B
Context32K
Smallest3.4 GB
LL
LLaMA O1 Supervised 1129
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GP
Gpt2_Finetune_Alpaca
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
LL
Lyraea large llama 3.1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ST
Stabilityai Stablelm 2 12b
Stablelm · tensorblock
Params12.1B
Context4K
Smallest4.7 GB
LL
hivaze ParaLex Llama 3 8B SFT
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
TE
k2s3 test 0002
Test · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
openbuddy llama3.1 8b v22.3 131k
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
OC
Occiglot 7b De En Instruct
Occiglot · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
PH
Failspy Phi 3 Medium 4k Instruct Abliterated v3
Phi · tensorblock
Params14B
Context4K
Smallest5.1 GB
QW
Zekunli Qwen2.5 7b Alpaca Discrim Cot
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
DE
KnutJaegersberg Deacon 20B
Deacon · tensorblock
Params20.1B
Context4K
Smallest7.6 GB