GGUF models by YorkieOH10
82 GGUF models quantized by YorkieOH10 on Hugging Face. Sizes run from 134M to 46.7B parameters. The longest trained context is 1024K tokens.
QW
Qwen2.5 Coder 3B
Qwen · YorkieOH10
Params3.09B
Context32K
Smallest3.3 GB
LL
Artificium llama3.1 8B 001 Q4 K M
Llama · YorkieOH10
Params8.03B
Context128K
Q4_K_M4.9 GB
GR
Granite 4.0 1b
Granite · YorkieOH10
Params1.63B
Context128K
Smallest1.7 GB
PH
phi 3 on mac Q6 K
Phi · YorkieOH10
Params3.82B
Context4K
Smallest3.1 GB
PH
phi 3 on mac Q4 K M
Phi · YorkieOH10
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
phi 3 on mac Q5 K M
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.8 GB
PH
phi 3 on mac Q4 0
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.2 GB
PH
phi 3 on mac Q3 K M
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.0 GB
GR
granite 20b code base Q8 0
Granite · YorkieOH10
Params20.1B
Context8K
Smallest21.4 GB
AY
Aya Expanse 8b
Aya · YorkieOH10
Params8.03B
Context8K
Smallest8.5 GB
OR
Orca Agent v0.1
Orca · YorkieOH10
Params14.8B
Context40K
Smallest15.7 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · YorkieOH10
Params34.4B
Context8K
Smallest36.5 GB
YI
Yi-1.5-34B-Chat
Yi · YorkieOH10
Params34.4B
Context4K
Smallest36.5 GB
PH
phi 3 on mac Q5 0
Phi · YorkieOH10
Params3.82B
Context4K
Smallest2.6 GB
AL
AlchemistCoder-DS-6.7B
Alchemistcoder · YorkieOH10
Params6.74B
Context16K
Q4_K_M4.1 GB
PH
phi 3 on mac Q8 0
Phi · YorkieOH10
Params3.82B
Context4K
Smallest4.1 GB
CO
CodeQwen1.5-7B-Chat
Codeqwen · YorkieOH10
Params7.25B
Context64K
Smallest7.7 GB
GR
granite-8b-code-base
Granite · YorkieOH10
Params8.05B
Context4K
Smallest8.6 GB
MA
Marco o1 Q4 K M
Marco · YorkieOH10
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Llama-3-Instruct-8B-SimPO
Llama · YorkieOH10
Params8.03B
Context8K
Smallest8.5 GB
GR
granite-3b-code-base
Granite · YorkieOH10
Params3.48B
Context2K
Smallest3.7 GB
LL
Llama-3-8B-Instruct-Coder-v2
Llama · YorkieOH10
Params8.03B
Context8K
Smallest8.5 GB
GE
Gemma 2b
Gemma · YorkieOH10
Params2.51B
Context8K
Smallest2.7 GB
MI
Mistral-7B-Base-SFT-SimPO
Mistral · YorkieOH10
Params7.24B
Context32K
Smallest7.7 GB
MI
Mixtral-Instruct-ITR-8x7B
Mistral · YorkieOH10
Params46.7B
Context32K
Q4_K_M28.4 GB
UN
UNA-ThePitbull-21.4-v1
Una · YorkieOH10
Params21.4B
Context32K
Q4_K_M12.9 GB
QW
Qwen2-7B-Multilingual-RP
Qwen · YorkieOH10
Params7.62B
Context32K
Smallest5.4 GB
AR
Arcanum 12b
Arcanum · YorkieOH10
Params12.2B
Context1000K
Smallest13.0 GB
LL
LongWriter Llama3.1 8b
Llama · YorkieOH10
Params8.03B
Context128K
Smallest8.5 GB
MI
Mistral Small Instruct 2409
Mistral · YorkieOH10
Params22.2B
Context128K
Q4_K_M13.3 GB