GGUF models by MoMonir
42 GGUF models quantized by MoMonir on Hugging Face. Sizes run from 2.51B to 14B parameters. The longest trained context is 1024K tokens.
GE
gemma 2b zephyr dpo
Gemma · MoMonir
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
Llama-3-8B-Instruct-262k
Llama · MoMonir
Params8.03B
Context256K
Q4_K_M4.9 GB
TR
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B
Truthful · MoMonir
Params12.9B
Context32K
Q4_K_M7.8 GB
LL
Llama3 OpenBioLLM 8B
Llama · MoMonir
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · MoMonir
Params8.03B
Context1024K
Smallest5.7 GB
LL
Sehty360-llama-3-8b-arabic-health-instruct
Llama · MoMonir
Params8.03B
Context8K
Smallest5.7 GB
LL
Meta-Llama-Guard-2-8B
Llama · MoMonir
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
phi 2 orange v2
Phi · MoMonir
Params2.78B
Context2K
Smallest2.0 GB
YI
Yi-1.5-9B-Chat
Yi · MoMonir
Params8.83B
Context4K
Q4_K_M5.3 GB
LL
Meta-Llama-3-8B-Instruct
Llama · MoMonir
Params8.03B
Context8K
Smallest5.7 GB
NE
NeuralBeagle14 7B
Neuralbeagle · MoMonir
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiniChat 2 3B
Minichat · MoMonir
Params3.02B
Context4K
Smallest3.2 GB