dataagents

Data Agents is a platform that orchestrates multiple AI agents to help automate data engineering tasks. The stack is designed to work with multiple backends (OpenAI, Claude, Gemini, and Ollama) and integrates with n8n for workflow orchestration. You can deploy it with Docker Compose and then access the frontend to interact with agents such as Data Architect, Pipeline Engineer, Data Analyst, Data Scientist, and Governance Specialist. Start by launching the docker-compose setup, then use the n8n instance for building and managing agent workflows, and finally use the frontend to chat with agents and run data tasks.

To use the tools effectively, begin by bringing the full environment online with docker-compose up. Open the n8n instance at http://localhost:5678 to upload or customize your agent workflows (agents/n8n/conversations contains sample workflows). Configure your AI provider keys in the n8n workflow blocks or via environment variables in your deployment. Then visit http://localhost:3000 to interact with the agents through the UI. The platform supports switching between providers (OpenAI, Claude, Gemini, Ollama) for private deployments and can be extended with additional connectors as needed.

Prerequisites:

• Docker and Docker Compose installed on your machine
• Git installed
• Optional: Node.js and pnpm if you plan to run the frontend locally instead of via Docker

Installation steps:

1. Clone the repository

git clone https://github.com/HotTechStack/dataagents.git
cd dataagents

2. If using Docker Compose (recommended):

# Start all services in detached mode
docker-compose up -d

3. If you prefer running locally (frontend):

# Install dependencies
pnpm install

# Start the development server
pnpm run dev

4. Verify access:

• n8n: http://localhost:5678
• Frontend: http://localhost:3000

Note: If you customize keys for OpenAI, Claude, Gemini, or Ollama, update the environment variables in your deployment (or the n8n credentials) accordingly.

Environment variables and configuration tips:

• OPENAI_API_KEY, CLAUDE_API_KEY, GEMINI_API_KEY should be set for corresponding providers when using Docker Compose or your hosting environment.
• OLLAMA_HOST may be needed if you run local Ollama; adjust the host/port if you deploy Ollama separately.
• If you encounter connectivity issues with the AI providers, verify network access from your container to the provider endpoints and ensure API keys are valid.
• The Docker Compose setup expects to expose ports 3000 (frontend) and 5678 (n8n). If these ports are in use, update the docker-compose.yml accordingly.
• For persistent workflow or conversation history, consider integrating a vector database back-end as described in the upcoming features.