🤖 AI copilot for data analytics, data engineering, and ML science. 🤖

🔗 Short link   •   🐦 Twitter

DataGPT is AI copilot for data analytics, data engineering, and ML science. 🚀.

This platform is currently in alpha, we are currently working on:

• Long term memory via a vector DB 🧠
• Web browsing capabilities via LangChain 🌐
• Interaction with websites and people 👨‍👩‍👦
• Writing capabilities via a document API 📄
• Saving run sessions 💾
• Users and authentication 🔐

More Coming soon...

• ✅ Bootstrapping: create-t3-app.
• ✅ Framework: Nextjs 13 + Typescript.
• ✅ Auth: Next-Auth.js
• ✅ ORM: Prisma.
• ✅ Database: Supabase.
• ✅ Styling: TailwindCSS + HeadlessUI.
• ✅ Typescript Schema Validation: Zod.
• ✅ End-to-end typesafe API: tRPC.

The easiest way to run DataGPT locally is by using docker. A convenient setup script is provided to help you get started.

./setup.sh --docker

If you wish to develop DataGPT locally, the easiest way is to use the provided setup script.

./setup.sh --local

🚧 You will need Nodejs +18 (LTS recommended) installed.

1. Clone the repository:

git clone git@github.com:aurorain-ai/DataGPT.git

2. Install dependencies:

cd DataGPT
npm install

3. Create a .env file with the following content:

🚧 The environment variables must match the following schema.

# Deployment Environment:
NODE_ENV=development

# Next Auth config:
# Generate a secret with `openssl rand -base64 32`
NEXTAUTH_SECRET=changeme
NEXTAUTH_URL=http://localhost:3000
DATABASE_URL=file:./db.sqlite

# Your open api key
OPENAI_API_KEY=changeme

# Snowflake account info
SNOWFLAKE_ACCOUNT=changeme
SNOWFLAKE_USERNAME=changeme
SNOWFLAKE_PASSWORD=changeme
SNOWFLAKE_REGION=changeme
SNOWFLAKE_WAREHOUSE=changeme
SNOWFLAKE_DATABASE=changeme
SNOWFLAKE_SCHEMA=changeme

4. Modify prisma schema to use sqlite:

./prisma/useSqlite.sh

Note: This only needs to be done if you wish to use sqlite.

5. Ready 🥳, now run:

# Create database migrations
npx prisma db push
npm run dev:all

Set up AgentGPT in the cloud immediately by using GitHub Codespaces.

1. From the GitHub repo, click the green "Code" button and select "Codespaces".
2. Create a new Codespace or select a previous one you've already created.
3. Codespaces opens in a separate tab in your browser.
4. In terminal, run bash ./setup.sh --local
5. When prompted in terminal, add your OpenAI API key.
6. Click "Open in browser" when the build process completes.

• To shut AgentGPT down, enter Ctrl+C in Terminal.
• To restart AgentGPT, run npm run dev in Terminal.

Run the project 🥳

npm run dev:all