GGUF models by dranger003

46 GGUF models quantized by dranger003 on Hugging Face. Sizes run from 2.77B to 132B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
OP
OpenCodeInterpreter DS 33B iMat
Opencodeinterpreter · dranger003
Params33.3B
Context16K
Smallest12.9 GB
GGUF
MI
miqu 1 70b iMat
Miqu · dranger003
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
MI
Snorkel Mistral PairRM DPO iMat
Mistral · dranger003
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OpenCodeInterpreter CL 70B iMat
Opencodeinterpreter · dranger003
Params69B
Context16K
Smallest18.3 GB
GGUF
LL
CodeLlama 70b Instruct iMat
Llama · dranger003
Params69B
Context4K
Smallest14.5 GB
Coding
SM
Smaug 34B v0.1 iMat
Smaug · dranger003
Params34.4B
Context195K
Smallest9.3 GB
GGUF
NE
NeuralMonarch 7B iMat
Neuralmonarch · dranger003
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
zephyr-7b-gemma-v0.1
Gemma · dranger003
Params8.54B
Context8K
Smallest5.3 GB
GGUF
MI
Mixtral 8x7B Instruct v0.1 iMat
Mistral · dranger003
Params46.7B
Context32K
Smallest12.3 GB
GGUF
UN
UNA SimpleSmaug 34b v1beta iMat
Una · dranger003
Params34.4B
Context32K
Smallest14.2 GB
GGUF
LA
labradorite 13b iMat
Labradorite · dranger003
Params13B
Context4K
Smallest5.0 GB
GGUF
AL
AlphaMonarch 7B iMat
Alphamonarch · dranger003
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
miqu 1 120b iMat
Miqu · dranger003
Params120B
Context32K
Smallest31.8 GB
GGUF
NO
Nous Capybara 34B iMat
Nous · dranger003
Params34.4B
Context195K
Smallest13.7 GB
GGUF
MI
miquliz 120b v2.0 iMat
Miquliz · dranger003
Params120B
Context32K
Smallest31.8 GB
GGUF
BA
bagel dpo 8x7b v0.2 iMat
Bagel · dranger003
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF

Keep browsing