GGUF models by dranger003
46 GGUF models quantized by dranger003 on Hugging Face. Sizes run from 2.77B to 132B parameters. The longest trained context is 1024K tokens.
OP
OpenCodeInterpreter DS 33B iMat
Opencodeinterpreter · dranger003
Params33.3B
Context16K
Smallest12.9 GB
MI
miqu 1 70b iMat
Miqu · dranger003
Params69B
Context32K
Q4_K_M41.4 GB
MI
Snorkel Mistral PairRM DPO iMat
Mistral · dranger003
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OpenCodeInterpreter CL 70B iMat
Opencodeinterpreter · dranger003
Params69B
Context16K
Smallest18.3 GB
LL
CodeLlama 70b Instruct iMat
Llama · dranger003
Params69B
Context4K
Smallest14.5 GB
SM
Smaug 34B v0.1 iMat
Smaug · dranger003
Params34.4B
Context195K
Smallest9.3 GB
NE
NeuralMonarch 7B iMat
Neuralmonarch · dranger003
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
zephyr-7b-gemma-v0.1
Gemma · dranger003
Params8.54B
Context8K
Smallest5.3 GB
MI
Mixtral 8x7B Instruct v0.1 iMat
Mistral · dranger003
Params46.7B
Context32K
Smallest12.3 GB
UN
UNA SimpleSmaug 34b v1beta iMat
Una · dranger003
Params34.4B
Context32K
Smallest14.2 GB
LA
labradorite 13b iMat
Labradorite · dranger003
Params13B
Context4K
Smallest5.0 GB
AL
AlphaMonarch 7B iMat
Alphamonarch · dranger003
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
miqu 1 120b iMat
Miqu · dranger003
Params120B
Context32K
Smallest31.8 GB
NO
Nous Capybara 34B iMat
Nous · dranger003
Params34.4B
Context195K
Smallest13.7 GB
MI
miquliz 120b v2.0 iMat
Miquliz · dranger003
Params120B
Context32K
Smallest31.8 GB
BA
bagel dpo 8x7b v0.2 iMat
Bagel · dranger003
Params46.7B
Context32K
Q4_K_M28.4 GB