This blog series is for beginners and young Entrepreneurs who want to build Gen AI RAG driven applications.
Author: Amit Shukla
Connect
click here to access YouTube, X playlists.
Hands on experience to build Gen AI RAG based Pro Apps, running 100% locally/hosted or API based, using API / tools of your choice.
Vector DB: FAISS, Chroma, SQLLite or any VectorDB of your choice
Programming: Python 3.12+
Application: Ollama WebUI, TAIPY or Flutter
IDE: Jupyter Lab, Ollama
LLM: Deepseek-R1 | Gemini | llama 3.3 | OpenAI ChatGPT | Anthropic | Local models
AI Agents: Microsoft AutoGen 0.4
# | Lesson | video |
---|---|---|
1 | Learning to setup and use LLM | link |
2 | working with data loader | link |
3 | Tokenizer, Embeddings, Vector DB and LLM | link |
4 | Tools/Function calling | link |
5 | building a functioning web app | link |
6 | Pro APP: Face Recognition AI | link |
7 | Pro APP: Local OCR Vision AI | link |
8 | Pro APP: AI Agents | link |
9 | building with Grok 3.0 | link |
10 | Pro APP: Time Expense monitoring automation | link |
11 | Pro APP: HR Help Desk automation | link |
12 | Pro APP: Auto Responder, IT Ticker Handler | link |
13 | Pro APP: Duplicate Document Finder | link |
14 | Pro APP: Smart Supply | link |
15 | Pro APP: Supply Chain monitoring AI | link |
16 | Appendix - Other use cases | link |
Here is a high level process flow diagram
---
config:
sankey:
showValues: false
---
sankey-beta
%% source,target,value
Data, Lake, 20
Data, Cleanse, 40
Data, Wrangle, 40
Data, scrape, 40
Data, Images, 40
Data, PDFs, 40
Data, SQL, 40
Data, Files, 40
Cleanse, Lake, 40
Wrangle,Lake, 40
scrape, Lake,40
Images,Lake, 40
PDFs, Lake,40
SQL, Lake,40
Files, Lake,40
Lake, RAG, 30
Lake, Tokenizer, 10
RAG, ai.Engine, 40
Tokenizer, ai.Engine, 30
VectorDB, ai.Engine, 30
LLM, ai.Engine, 10
Embedding, ai.Engine, 10
Code, ai.Engine, 10
models, ai.Engine, 10
prompt templates, ai.Engine, 10
query translations, ai.Engine, 10
route, ai.Engine, 10
SQLs, ai.Engine, 10
ai.Engine, ai.App, 100
ai.App, manual, 10
ai.App, knowledge store, 10
ai.App, chatbot, 10
ai.App, ticket handling, 10
ai.App, assistant, 10
ai.App, help desk, 10
ai.App, Account Payables, 10
ai.App, Supply chain, 10
ai.App, Finance, 10
ai.App, Time Expense, 10
ai.App, HR, 10
ai.App, CRM, 10
ai.App, Fraud Alert, 10
ai.App, Inventory, 10
ai.App, Auto Replenish, 10
ai.App, Invoice Match, 10
This blog series covers every step of building, deploying, and launching a basic app from scratch. Later, we'll apply these skills to more complex projects.
-
Manualify.ai
: is a Smart AI for Answering Questions from Tutorials: Harnessing the Power of RAG LLMs and Documents, knowledge store chatbot assistant -
HelpDesk.ai
: Revolutionizing Customer Support through Automation -
AutoResponder.ai
: Streamlining Interactions: An Exploration of Automated Chat Moderation and Command Response Systems, automated ticket handling using Service Now -
Supply chain assistant
:Auto Invoicing, Duplicate Invoice Match
:- DocumentBot.ai:
- Auto reader
- Payables, Receivables, Voucher, Invoice, Payment,
- Receipts, Guided buying, purchase recommendations, anomaly detection
- bought together, optimum qty, payment monitoring system - 3 way match, match exception analysis, AI interceptor invoice monitoring
- vendor monitoring and analysis
- ordering supplies - auto replenishment inventory
Spend Classifier
Smart Supplier:
Contract Reader, Validator, Recommender Engine
- contractual vs non-contractual spending
Sourcing Procurement Contracts Engine
:SavingsFinder.ai | Guidedbuying.ai
:Taxonomy
:ML4GL
- Finance Statement, Security filings RAGTime & Expense
: audit time, expense and monitoring for employees
-
Embeddings :
Anomaly Detection
- Identify Fat Finger Purchases, Invoices and transactionsRecommendation engine
: create a local version of "purchased together" items recommendation engine based on internal customer purchase history and promotions.Fraud Alerts
: Identify and Alert Fat Finger Purchases, Invoices and transactions
-
Other Ideas: (Pro Applications)
-
RxPathology.ai | Lab.ai
-
AutoGrader
: School paper grading, self-study assignment grader -
LawDocs.ai
case applied , case reference , state vs federal law applied to situation -
ParliamentReferences.ai
-
KitchenKing.ai
-
Namastemovie.ai
- movie reviews -
Dreamify.ai
-
Astrologify.ai
-
TradingAlerts.ai | Tradesmart.ai
- using Fundamental and Technical Analysis, generate leads based on in-house RAG Sec Filings database, Trading alerts news etc.
-