GGUF models by keisuke-miyako

302 GGUF models quantized by keisuke-miyako on Hugging Face. Sizes run from 23M to 14.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
JI
Jina Reranker v2 Base Multilingual
Jina · keisuke-miyako
Params278M
Context1K
Smallest0.3 GB
Embedding
PH
Phi 4 Mini Instruct
Phi · keisuke-miyako
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
MM
mmBERT Small
Mmbert · keisuke-miyako
Params140M
Context8K
Smallest0.2 GB
GGUF
LL
Llama 3 Karamaru v1 gguf q4 k m
Llama · keisuke-miyako
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
Phi 4 reasoning gguf q4 k m
Phi · keisuke-miyako
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
HA
Harrier Oss v1 0.6b
Harrier · keisuke-miyako
Params596M
Context32K
Q4_K_M0.4 GB
ReasoningTool use
MA
ms marco MiniLM L6 v2 gguf f16
Marco · keisuke-miyako
Params23M
Context512
Smallest0.0 GB
Coding
SN
snowflake arctic embed l
Snowflake · keisuke-miyako
Params334M
Context512
Smallest0.4 GB
Embedding
QW
Qwen2.5 1.5B Instruct gguf q4 k m
Qwen · keisuke-miyako
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
QW
Qwen3 0.6B gguf q8 0
Qwen · keisuke-miyako
Params752M
Context40K
Smallest0.8 GB
ReasoningTool use
BG
bge m3 lemur r4
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
Embedding
SN
snowflake arctic embed m v1.5
Snowflake · keisuke-miyako
Params109M
Context512
Smallest0.1 GB
Embedding
BG
bge m3 doc r1
BGE · keisuke-miyako
Params567M
Context8K
Smallest0.6 GB
EmbeddingReasoning
GR
Granite Embedding 278m Multilingual
Granite · keisuke-miyako
Params277M
Context512
Q4_K_M0.2 GB
Embedding
MM
mmBERT Small
Mmbert · keisuke-miyako
Params140M
Context8K
Smallest0.3 GB
GGUF
BG
bge m3 gguf q4 k m
BGE · keisuke-miyako
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
SM
SmolLM3 3B gguf q8 0
SmolLM · keisuke-miyako
Params3.08B
Context64K
Smallest3.3 GB
ReasoningTool use
SA
sarashina2.2 1b instruct v0.1 gguf q4 k m
Sarashina · keisuke-miyako
Params1.41B
Context8K
Q4_K_M0.9 GB
Tool use
SN
snowflake arctic embed m long
Snowflake · keisuke-miyako
Params137M
Context2K
Smallest0.1 GB
Embedding
MX
Mxbai Rerank Base v2
Mxbai · keisuke-miyako
Params494M
Context32K
Q4_K_M0.4 GB
EmbeddingTool use
GR
granite embedding reranker english r2 gguf q4 k m
Granite · keisuke-miyako
Params150M
Context8K
Q4_K_M0.1 GB
Embedding
JA
AI21 Jamba Reasoning 3B
Jamba · keisuke-miyako
Params3.2B
Context256K
Q4_K_M1.9 GB
ReasoningTool use
JI
Jina Reranker v2 Base Multilingual
Jina · keisuke-miyako
Params278M
Context1K
Q4_K_M0.2 GB
Embedding
GR
granite embedding reranker english r2 gguf q8 0
Granite · keisuke-miyako
Params150M
Context8K
Smallest0.2 GB
Embedding
LF
LFM2.5 1.2B JP gguf q8 0
Lfm · keisuke-miyako
Params1.17B
Context125K
Smallest1.2 GB
Tool use
MX
mxbai-rerank-large-v2
Mxbai · keisuke-miyako
Params1.54B
Context32K
Smallest1.6 GB
EmbeddingTool use
BC
Bce Embedding Base_V1
Bce · keisuke-miyako
Params277M
Context512
Q4_K_M0.2 GB
Embedding
LF
LFM2.5 1.2B JP q4 k m
Lfm · keisuke-miyako
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
GR
granite 4.0 h micro gguf q8 0
Granite · keisuke-miyako
Params3.19B
Context1024K
Smallest3.4 GB
Tool use
TI
TinySwallow 1.5B Instruct gguf q4 k m
Tinyswallow · keisuke-miyako
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use

Keep browsing