GGUF models by MoMonir

42 GGUF models quantized by MoMonir on Hugging Face. Sizes run from 2.51B to 14B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma 2b zephyr dpo
Gemma · MoMonir
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
Llama-3-8B-Instruct-262k
Llama · MoMonir
Params8.03B
Context256K
Q4_K_M4.9 GB
GGUF
TR
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B
Truthful · MoMonir
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
LL
Llama3 OpenBioLLM 8B
Llama · MoMonir
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-8B-Instruct-Gradient-1048k
Llama · MoMonir
Params8.03B
Context1024K
Smallest5.7 GB
GGUF
LL
Sehty360-llama-3-8b-arabic-health-instruct
Llama · MoMonir
Params8.03B
Context8K
Smallest5.7 GB
GGUF
LL
Meta-Llama-Guard-2-8B
Llama · MoMonir
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
phi 2 orange v2
Phi · MoMonir
Params2.78B
Context2K
Smallest2.0 GB
GGUF
YI
Yi-1.5-9B-Chat
Yi · MoMonir
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · MoMonir
Params8.03B
Context8K
Smallest5.7 GB
GGUF
NE
NeuralBeagle14 7B
Neuralbeagle · MoMonir
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MiniChat 2 3B
Minichat · MoMonir
Params3.02B
Context4K
Smallest3.2 GB
GGUF

Keep browsing