Agent Cloud- The Ultimate Open Source Platform for Private AI App Development


Agent Cloud is a versatile open source platform that enables companies to host their own AI application platform, much like having a self-hosted GPT builder but with additional features.

It allows for the creation of both conversational chat apps and process apps that can automate tasks and processes.

This platform is especially beneficial for organizations that require strict data privacy as it can be deployed fully on-premises or within a private cloud environment.

Here’s what Agent Cloud offers:

  • Flexibility and Control: AgentCloud provides the tools necessary to build and deploy AI apps that can interact through conversational interfaces or manage processes, all while ensuring data remains secure and private within the company’s controlled environment.
Agent Cloud-RAG
  • Types of Applications: The platform supports two main types of apps: conversational chat apps for tasks like customer support and data analysis, and process apps aimed at automating workflows such as document approvals or employee onboarding.
  • Customizable and Scalable: The platform supports integration with various large language models and external tools, offering the ability to sync data from numerous data sources (Big Query, SQL, Salesforce, Notion, Airtable, Postgres, HubSpot and many more ) and provide good integrations among external apps.
Built-in RAG service
  • Community and Support: AgentCloud is in early stage of development and encourages open source community contributions, offering resources like tutorials and guides to help users get started and optimize their use of the platform.

I’ve written a complete tutorial on how to build a RAG Chat App with Agent Cloud and BigQuery. This tutorial provides step-by-step instructions to help you quickly set up and deploy your first AI app using AgentCloud, leveraging the power of BigQuery for data handling.

How to build a RAG with Agent Cloud and Google BigQuery

Importance of Privacy in AI app development

The importance of privacy in AI app development cannot be overstated, especially in an era where data breaches and privacy concerns are on the rise.

Privacy in the Age of AI: Risks, Challenges and Solutions

Here are some key reasons why privacy is crucial:

  • Trust and User Confidence: Privacy is fundamental in building trust with users. If users believe that their data is safe and used responsibly, they are more likely to engage with an AI app.

Ensuring privacy helps in retaining users.

  • Regulatory Compliance: With the advent of strict regulations like the General Data Protection Regulation (GDPR) in EU, the California Consumer Privacy Act (CCPA), and others globally, compliance is mandatory.
  • Competitive Advantage: Companies that prioritize privacy in their AI development can differentiate themselves from competitors.
  • Risk Management: By incorporating strong privacy measures, devs can mitigate risks associated with data breaches and cyber attacks.
  • Innovation and Public Benefit: When privacy is ensured, it opens the door for more people to safely contribute their data for AI training purposes, leading to more innovative and effective solutions.

What Sets AgentCloud Apart from other AI Platforms?

Agent Cloud distinguishes itself from other AI platforms with its open source framework, focusing on privacy and customization for corporate environments.

Private-GPT-RAG-Agent Cloud

They allows companies to host their own AI app platforms, ensuring that sensitive data is processed within the safety of a private infrastructure.

Agent Cloud

The platform supports two types of apps.

  • Conversational chat apps:

These are similar to Open AI GPTs enabling you to build single agent chat apps except they can use any LLM, can access a library of tools as well as retrieve knowledge from hundreds of data sources.

  • Process automation apps:

These enable you to automate processes by allocating goals and tasks for agents to complete.

These apps leverage large language models (LLMs) and a suite of tools to access a wide array of data sources, offering flexibility and control.

if you’re interested in a comparative analysis, here are links to two of the detailed comparison blogs that highlight how Agent Cloud stands out:

  • AgentCloud vs OpenAI: This blog offers an in-depth look at how AgentCloud’s open source approach provides additional customization and privacy features over OpenAI’s offerings. Read the comparison.
  • AgentCloud vs CrewAI: Here, the comparison is drawn between AgentCloud’s broader app-building capabilities and CrewAI’s focused AI solutions. Explore the differences.

Core Features of AgentCloud

AgentCloud equips you with a robust, open-source AI app development environment, enhancing privacy and control for your internal projects.

Here’s a concise list of its core capabilities:

  • Data-Rich RAG Pipeline: Seamlessly incorporate over 260 data sources.
  • GPT-like Conversational Apps: Easily create AI-driven conversational interfaces.
  • ‘Crewai’ Process Automation: Automate workflows with multi-agent coordination.
  • Comprehensive Toolset: Access a suite of development and deployment tools.
  • Detailed Access Permissions: Manage user permissions with precision.
  • Simple Initialization: Get up and running quickly with Docker and setup scripts.
  • Community-Driven Growth: Support and contribute to the platform on GitHub.
Open Source-RAG-Private ChatGPT

For an in-depth look at these features, visit AgentCloud’s official docs.

How Agent Cloud Works

This is the is high level architecture of agentcloud.


Here’s a full breakdown:

  • Web App: Developed with Node.js, React, and Tailwind CSS for a responsive and modern user interface.
  • Backend: Utilizes Python for robust server-side logic and operations.
  • Agent Framework: A fork of CrewAI for managing AI agent behavior.
  • ELT Platform: Powered by Airbyte for data extraction, loading, and transformation.
  • Message Buses: Includes Bull MQ for job and message queuing, and RabbitMQ for cross-service message passing.
  • Databases: Uses Redis as an in-memory data structure store and MongoDB for NoSQL storage capabilities.
  • Infrastructure Components: Consists of a Vector Proxy built in Rust for efficient data indexing and retrieval, and Qdrant as the vector database for storing and querying high-dimensional data vectors.

How to Build Chat Apps with Agent Cloud

Agent Cloud is a flexible platform and lets you decide how you want to build your apps and using their quickstart guide is the simplest way to getting started with Agent Cloud.


I’ve written a 3 step-by-step guide on setting up and starting a project on Agent Cloud and build a RAG with leveraging different data sources.

How to Build a RAG Chat App With Agent Cloud and BigQuery

How to Build a RAG Chatbot with Agent Cloud and MongoDB.

How to Build a Chat App with Your Postgres Data using Agent Cloud.

Now let’s see some examples of AI applications that can be developed using AgentCloud.

App Type Use Cases

Agent Cloud offers flexibility in app types, allowing for various use cases across industries:

Agent Cloud- UseCases
  1. Customer Support: Deploy conversational chat apps to handle customer inquiries and support tickets efficiently.
  2. Internal Knowledge Base: Create process apps to automate internal workflows, such as employee onboarding or document approval processes.
  3. Data Analysis: Utilize conversational chat apps to analyze and query data from multiple sources, empowering teams to make data-driven decisions.
  4. Fully Local Deployment: Deploy Agent Cloud entirely on-premises or within a private cloud environment to ensure maximum control over data privacy and sovereignty. This deployment option is ideal for organizations with strict regulatory requirements or sensitive data handling policies.
  5. Education and Training: Create interactive learning experiences using conversational chat apps powered by Agent Cloud. Educators can leverage AI to deliver personalized tutoring, simulate real-world scenarios, and facilitate collaborative learning environments.
  6. Financial Services: Implement AI-driven solutions in the financial services sector to enhance customer service, automate routine tasks, and mitigate risks. Agent Cloud can power chatbots for banking inquiries, fraud detection algorithms, and personalized financial advisory services, improving operational efficiency and customer satisfaction.
  7. Healthcare Solutions: Develop AI-powered healthcare applications to streamline patient care, medical diagnostics, and administrative processes. Agent Cloud can support virtual healthcare assistants, medical chatbots, and remote patient monitoring systems, improving access to healthcare services and optimizing workflows for healthcare providers.

Community and Support

AgentCloud’s support community is really welcoming and helpful. If you’re tinkering with the platform and hit a snag, or just want to chat with fellow users, their Discord server is the place to be. It’s like a virtual coffee shop for AI enthusiasts—you can swap stories, tips, and get a hand when you need it.

Agent Cloud- Discord-Community

They’re open source, too, which is great for peeking under the hood or even pitching in on their GitHub.

Plus, they keep everyone in the loop with a public roadmap, so you can see what’s next and share your own ideas.

Check out their roadmap to see what they’re cooking up next, and if you’re up for it, give a star or contribute on GitHub.

How to contribute to the agentcloud development if you’re an open source dev.

  • Get Started: Search for issues labeled good first issue to find beginner-friendly tasks.
  • Make an Impact: Look for issues tagged with enhancement to contribute to significant features.
  • Find Your Fit: Use filters on the open issues for specific criteria like difficulty:high or priority:medium.
  • Share Ideas: Propose new features by opening an issue or discuss it on Discord in the #feature-request channel.
  • Join the Discussion: Engage with the community on Discord to collaborate and get support.

also whether you’re just starting out or you’re looking to expand your knowledge, I’ve added some solid tutorials and docs links to guide you.

They’re packed with all the info you need to make the most out of the platform.

  • Explore Documentation: For a deep dive into how to use the platform, check out the AgentCloud Docs.
  • Read Blog Posts: Gain insights and tips from the community with AgentCloud blog posts.
  • Watch Tutorials: Visual learner? There’s a tutorial waiting for you here.


AgentCloud is your toolkit for building AI apps while keeping your data snug and private.

It’s kind of a DIY for AI, with lots of help if you need it.

If you’ve ever thought about creating your own AI app but worried about privacy, give AgentCloud a try. They’ve got all the instructions laid out, plus a bunch of folks ready to help on Discord.

And hey, if you dig what they’re doing, why not zip over to their GitHub and drop a star⭐️? It’s like a high-five for the devs.

Agent Cloud- Github

We’ve reached the end of our chat today, and I hope you’ve picked up some new insights.

If you found it helpful, feel free to spread the word so others might benefit too.

Big thanks for joining me on this journey—it’s the community that fuels this exchange of ideas and experiences.

For the latest on developer tools and insights into software engineering, keep up with me on Twitter.

Want to read more interesting blog posts

✅ Here are some of my most popular posts that you might be interested in.