GGUF models by transitionGap
45 GGUF models quantized by transitionGap on Hugging Face. Sizes run from 362M to 9.24B parameters. The longest trained context is 128K tokens.
GE
RTIACT IN gemma2 9B smallset
Gemma · transitionGap
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
FARMSUBSIDY IN Qwen2.5 0.5B smallset
Qwen · transitionGap
Params494M
Context32K
Q4_K_M0.4 GB
QW
PANCARD IN Qwen2.5 0.5B smallset
Qwen · transitionGap
Params494M
Context32K
Q4_K_M0.4 GB
GE
ROAD TRANSPORT IN gemma2 9B smallset
Gemma · transitionGap
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
PANCARD IN gemma2 9B smallset
Gemma · transitionGap
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
PENSION IN Llama3.1 8B smallset
Llama · transitionGap
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
PROPERTYREG IN Qwen2.5 0.5B smallset
Qwen · transitionGap
Params494M
Context32K
Q4_K_M0.4 GB
LL
HEALTHINSURANCE IN Llama3.1 8B smallset
Llama · transitionGap
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
RATIONCARD IN Llama3.1 8B smallset
Llama · transitionGap
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
BIRTHCERT IN Qwen2.5 0.5B smallset
Qwen · transitionGap
Params494M
Context32K
Q4_K_M0.4 GB
QW
ROAD TRANSPORT IN Qwen2.5 0.5B smallset
Qwen · transitionGap
Params494M
Context32K
Q4_K_M0.4 GB
LL
MARRAIGELAW IN Llama3.1 8B smallset
Llama · transitionGap
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
ADHAR IN Qwen2.5 0.5B smallset
Qwen · transitionGap
Params494M
Context32K
Q4_K_M0.4 GB
LL
COURTPROCEDDING IN Llama3.1 8B smallset
Llama · transitionGap
Params8.03B
Context128K
Smallest16.1 GB
QW
RERA IN Qwen2.5 0.5B smallset
Qwen · transitionGap
Params494M
Context32K
Q4_K_M0.4 GB