GGUF models by Sleem247
61 GGUF models quantized by Sleem247 on Hugging Face. Sizes run from 2M to 8.03B parameters. The longest trained context is 128K tokens.
DE
roberta deepseek r1 70b 0212 Q8 0
DeepSeek · Sleem247
Params125M
Context512
Smallest0.1 GB
BE
BERT_LegalAnalyzer
Bert · Sleem247
Params109M
Context512
Smallest0.1 GB
MI
Hermes Mistral Saul Slerp Q8 0
Mistral · Sleem247
Params7.24B
Context32K
Smallest7.7 GB
LE
legal bert chatbot Q8 0
Legal · Sleem247
Params223M
Context512
Smallest0.2 GB
BG
bge large en Q8 0
BGE · Sleem247
Params334M
Context512
Smallest0.4 GB
IN
industry bert contracts v0.1 Q8 0
Industry · Sleem247
Params109M
Context512
Smallest0.1 GB
DE
DeepSeek R1 Legal COT Q8 0
DeepSeek · Sleem247
Params8.03B
Context128K
Smallest8.5 GB
RE
reasoning rag eval 3.2b merged model Q8 0
Reasoning · Sleem247
Params3.21B
Context128K
Smallest3.4 GB
BG
Bge m3_RAG Conversational IR
BGE · Sleem247
Params567M
Context8K
Smallest0.6 GB
DE
Gm3 270m TinyGSM Deepseek R1
DeepSeek · Sleem247
Params268M
Context32K
Smallest0.3 GB
ZE
Zephyr Finetuned Legal
Zephyr · Sleem247
Params7M
Context—
Smallest0.0 GB
DE
DeepSeek R1
DeepSeek · Sleem247
Params494M
Context32K
Smallest0.5 GB
LL
LEGAL LLAMA
Llama · Sleem247
Params8M
Context—
Smallest0.0 GB
LE
LegalDialo Small
Legaldialo · Sleem247
Params124M
Context1K
Smallest0.1 GB
BE
BERT_Contracts_LegalAnalyzer
Bert · Sleem247
Params109M
Context512
Q4_K_M0.1 GB
DE
DeepSeek R1 Distill Qwen 1.5B Checkpoint 600 Reasoning Embedding
DeepSeek · Sleem247
Params1.54B
Context128K
Smallest1.6 GB
MI
Mistral Conversational
Mistral · Sleem247
Params84M
Context—
Smallest0.1 GB
CO
Contracts FinetuneLlama3.18b
Contracts · Sleem247
Params22M
Context—
Smallest0.1 GB
SN
snowflake finetuned semantic Q8 0
Snowflake · Sleem247
Params109M
Context512
Smallest0.1 GB
MI
Legal Mistral Finetuned
Mistral · Sleem247
Params355M
Context1K
Smallest0.4 GB
DE
DeepSeek R1 Distill Qwen 32B Ragbench All A96C2C25 F3B1 45ca B89C E9Cb60F8C929
DeepSeek · Sleem247
Params1.07B
Context—
Smallest4.3 GB
DI
Distilroberta Base
Distilroberta · Sleem247
Params82M
Context512
Smallest0.1 GB
SE
SeaLLMs v3 7B Chat Legalqa
Seallms · Sleem247
Params81M
Context—
Smallest0.3 GB
LE
Legal Document 05
Legal · Sleem247
Params248M
Context512
Smallest0.3 GB
MI
Mistral Conversational
Mistral · Sleem247
Params84M
Context—
Smallest0.2 GB
BE
BERT_Contracts_LegalAnalyzer
Bert · Sleem247
Params109M
Context512
Smallest0.1 GB
IN
industry bert contracts ov Q8 0
Industry · Sleem247
Params—
Context512
Smallest0.0 GB
RO
roberta cnn legal Q8 0
Roberta · Sleem247
Params354M
Context512
Smallest0.4 GB
DE
DeepSeek R1 Distill Qwen 32B Ragbench All A96C2C25 F3B1 45ca B89C E9Cb60F8C929
DeepSeek · Sleem247
Params1.07B
Context—
Smallest4.3 GB
RO
RoBERTa Trained Oct29 Q8 0
Roberta · Sleem247
Params125M
Context512
Smallest0.1 GB