ML

A notes about ML, still ongoing!

Goals

• Collection of ML knowledge base I like.

Generative AI

• Large Language Model
• Stable Diffusion
• Chat_with_MultiplePDFs_Mistral_7B_Instruct1

Frameworks

• Hugging Face - Candle
• Hugging Face - AutoTrain
• Apple - MLX

Inferences

• Text Generation Inference (TGI)
• TabbyML: For locally code completion.
• LlamaEdge: Wasm base chat/embeddings/api.

Embedding

• Text Embeddings Inference (TEI)
• LlamaEdge: Wasm base chat/embeddings/api.

RAG

• Retrieval Augmented Generation
• Vector Database - Qdrant

Tools

• Create your own GGUF Quants
• Convert any model to Safetensors and open a PR

MCP

• Rust MCP
• Clouflare Remote MCP Server + Github OAuth

Agents

• Agents

• https://github.com/chatchat-space/Langchain-Chatchat

• https://github.com/flows-network/demo-RAG-embeddings

TOREAD

• Optimizing Text Embeddings with HuggingFace’s text-embeddings-inference Server and LlamaIndex: https://levelup.gitconnected.com/optimizing-text-embeddings-with-huggingfaces-text-embeddings-inference-server-and-llamaindex-ef7df35882a4

• Demystifying Advanced RAG Pipelines: https://github.com/pchunduri6/rag-demystified

• Try Kalosm: https://github.com/floneum/floneum/tree/main/interfaces/kalosm