Project Overview
Meet Tagi, the friendly AI secretary designed to keep Tago So's life running smoothly—all without requiring a fancy GPU or cloud setup. Powered by the lightweight Mistral 7B model, Tagi operates entirely on a laptop running macOS, making it both humble and efficient.
Tagi’s focus? Keeping responses clear and concise while minimizing hallucinations. It’s practical, lightweight, and embraces the occasional harmless mistake with charm! 😉
I’ve uploaded the source code and instructions—host your own AI on your laptop today!
Key Components
Backend
- Built with Node.js and Express.js.
- Provides a secure API endpoint for processing queries and communicating with the AI model.
- Features strong security measures:
- Helmet for secure HTTP headers.
- CORS restrictions to control domain access.
- Rate limiting to prevent misuse.
- Logs user requests for monitoring and debugging.
Frontend
- An interactive web interface built with HTML/CSS/JavaScript.
- Includes a chat-based UI for submitting queries and receiving responses in real-time.
AI Model Integration
- Runs on the Mistral 7B language model, ensuring lightweight and formal responses.
- A custom Modelfile defines behavior, rules, and parameters to guide AI interactions.
Deployment
- Runs locally on macOS with Apache as the web server.
- Both backend and frontend are hosted on the laptop and are designed for potential production extensions.
- Communicates with the AI model server via API.