GGUF models by Sleem247

61 GGUF models quantized by Sleem247 on Hugging Face. Sizes run from 2M to 8.03B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
roberta deepseek r1 70b 0212 Q8 0
DeepSeek · Sleem247
Params125M
Context512
Smallest0.1 GB
Reasoning
BE
BERT_LegalAnalyzer
Bert · Sleem247
Params109M
Context512
Smallest0.1 GB
GGUF
MI
Hermes Mistral Saul Slerp Q8 0
Mistral · Sleem247
Params7.24B
Context32K
Smallest7.7 GB
Tool use
LE
legal bert chatbot Q8 0
Legal · Sleem247
Params223M
Context512
Smallest0.2 GB
GGUF
BG
bge large en Q8 0
BGE · Sleem247
Params334M
Context512
Smallest0.4 GB
Embedding
IN
industry bert contracts v0.1 Q8 0
Industry · Sleem247
Params109M
Context512
Smallest0.1 GB
GGUF
DE
DeepSeek R1 Legal COT Q8 0
DeepSeek · Sleem247
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
RE
reasoning rag eval 3.2b merged model Q8 0
Reasoning · Sleem247
Params3.21B
Context128K
Smallest3.4 GB
ReasoningTool use
BG
Bge m3_RAG Conversational IR
BGE · Sleem247
Params567M
Context8K
Smallest0.6 GB
Embedding
DE
Gm3 270m TinyGSM Deepseek R1
DeepSeek · Sleem247
Params268M
Context32K
Smallest0.3 GB
Reasoning
ZE
Zephyr Finetuned Legal
Zephyr · Sleem247
Params7M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek R1
DeepSeek · Sleem247
Params494M
Context32K
Smallest0.5 GB
ReasoningTool use
LL
LEGAL LLAMA
Llama · Sleem247
Params8M
Context—
Smallest0.0 GB
GGUF
LE
LegalDialo Small
Legaldialo · Sleem247
Params124M
Context1K
Smallest0.1 GB
GGUF
BE
BERT_Contracts_LegalAnalyzer
Bert · Sleem247
Params109M
Context512
Q4_K_M0.1 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B Checkpoint 600 Reasoning Embedding
DeepSeek · Sleem247
Params1.54B
Context128K
Smallest1.6 GB
EmbeddingReasoning
MI
Mistral Conversational
Mistral · Sleem247
Params84M
Context—
Smallest0.1 GB
GGUF
CO
Contracts FinetuneLlama3.18b
Contracts · Sleem247
Params22M
Context—
Smallest0.1 GB
GGUF
SN
snowflake finetuned semantic Q8 0
Snowflake · Sleem247
Params109M
Context512
Smallest0.1 GB
Embedding
MI
Legal Mistral Finetuned
Mistral · Sleem247
Params355M
Context1K
Smallest0.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Ragbench All A96C2C25 F3B1 45ca B89C E9Cb60F8C929
DeepSeek · Sleem247
Params1.07B
Context—
Smallest4.3 GB
GGUF
DI
Distilroberta Base
Distilroberta · Sleem247
Params82M
Context512
Smallest0.1 GB
Embedding
SE
SeaLLMs v3 7B Chat Legalqa
Seallms · Sleem247
Params81M
Context—
Smallest0.3 GB
GGUF
LE
Legal Document 05
Legal · Sleem247
Params248M
Context512
Smallest0.3 GB
GGUF
MI
Mistral Conversational
Mistral · Sleem247
Params84M
Context—
Smallest0.2 GB
GGUF
BE
BERT_Contracts_LegalAnalyzer
Bert · Sleem247
Params109M
Context512
Smallest0.1 GB
GGUF
IN
industry bert contracts ov Q8 0
Industry · Sleem247
Params—
Context512
Smallest0.0 GB
Coding
RO
roberta cnn legal Q8 0
Roberta · Sleem247
Params354M
Context512
Smallest0.4 GB
Embedding
DE
DeepSeek R1 Distill Qwen 32B Ragbench All A96C2C25 F3B1 45ca B89C E9Cb60F8C929
DeepSeek · Sleem247
Params1.07B
Context—
Smallest4.3 GB
GGUF
RO
RoBERTa Trained Oct29 Q8 0
Roberta · Sleem247
Params125M
Context512
Smallest0.1 GB
GGUF

Keep browsing