A walkthrough of the development and new features, now open to everyone
Last year, Firebird Technologies started working on the Auto-Analyst, a completely open-sourced AI data scientist. Now we are ready to open the next version to the public. We made some promises on how the system would be, I am proud to announce we lived up to all of them!
- Completely open-sourced, with a highly permissive license
- Large Language Model agnostic, you can use it with all LLMs. With quality/cost differing based on which LLM you use
- Use your own API, you can use it with your own API and it won’t cost anything
- Better UI, with a focus on optimizing the UX for data science.
- Guardrails, for higher reliability outputs.
You can use the Auto-Analyst here:
Walkthrough
Using the system is easy and can be done in just three steps.
Step 1: Upload dataset (The system is designed to take in csv & excel sheets — with other data connectors available on demand)
Near the chat box, use the attach button to upload a csv or excel sheet
Step 2: Add a few worlds describing the dataset and press auto-generate. This creates a LLM optimized dataset description, so AI agents in the system can easily work with your data.
Zoom image will be displayed
Popup for dataset information, it will be helpful if you give descriptive names to your columns. Instead of variable_x, say price.
You are advised to read the description and edit to minimize errors while handling data.
Step 3: Ask your query. You can direct your question to any of the agents in the system by using @agent_name.
- Preprocessing agent: This agent uses pandas and numpy to clean your dataset. It can convert data types if needed, handle missing values, create aggregates, and more.
- Statistical analytics agent: It performs tasks like correlation analysis, regression, hypothesis testing, and other statistical methods using the statsmodels package.
- Sk learn agent: This one applies machine learning models such as random forest, k-means clustering, and more. It’s built on scikit-learn.
- Data Visualization agent: It creates visualizations using plotly and includes a retriever that suggests the best formatting for each type of plot.
The system is modular and can be extended with more agents upon request. Examples include marketing analytics agents, quantitative finance agents, or even non-coding agents that can access web APIs.
Interested in a custom solution tailored to your data and tech stack? Feel free to reach out here: https://www.autoanalyst.ai/contact
Zoom image will be displayed
You can ask specific agents to ask questions
Zoom image will be displayed
Result of above query
You can also ask planner led queries, instead of asking an agent directly you can send a query to the planner (by not attaching an agent’s name).
The planner allocates the query to the agents in the system; it automatically selects which of the 4 to use for the query.
Zoom image will be displayed
Example query for the planner. Based on a marketing analytics dataset about page visitors.
Zoom image will be displayed
The planner selects the agents, gives them instructions on what to do. The create variables that each must create, while use are variables each agent must use.
Zoom image will be displayed
Zoom image will be displayed
Zoom image will be displayed
Responses from each of the agents, with the reasoning, code and summary of actions performed.
Zoom image will be displayed
statistical analytics agent which gives responses of statistical tests it performed on each variable.
Zoom image will be displayed
Zoom image will be displayed
Visualizations ploted by data_viz_agent
Zoom image will be displayed
Visualizations by the data_viz_agent
The system can plan, execute and visualize the results.
FireBirdTech has served 13+ clients, from startups to big multi-national corporations, need help with AI?
We develop, consult and execute on AI.
UI Feature Overview
Here is a comprehensive feature overview
- Chat Interface: Standard chat interface that allows users to read text responses, see visualizations etc.
Zoom image will be displayed
Chat interface
2. Code Editor: The system detects code, and allows users to toggle a on web IDE to edit code. It has an AI code edit and auto-fix feature. Along with standard code editor features.
Zoom image will be displayed
Code editor view
Zoom image will be displayed
Zoom image will be displayed
Image 1. Edit with AI feature similar to CMD+K in AI IDEs like Cursor. Image 2. Auto-fix feature which fixes coding errors made by agents
3. Analytics Dashboard (Enterprise feature): Role base admin dashboard to monitor requests, costs and model usage. Allows you to restrict certain users, grant credits and ensure complaince.
Zoom image will be displayed
Image of the admin dashboard
Backend Features
Here are some features of our backend!
- Modular Agentic System: The initial web application comes pre-configured with four core coding agents, along with several helper agents that support their tasks. However, the system is modular — built using DSPy — which makes it easy to add new agents by defining a
dspy.Signature, like so
<span id="290e" data-selectable-paragraph=""><span>class</span> <span>google_ads_analyzer_agent</span>(dspy.Signature):<br> <span>"""<br> ### **Google Ads Analyzer Agent Definition**<br> You are the **Google Ads Analyzer Agent** in a multi-agent marketing optimization pipeline. Your task is to **analyze** Google Ads campaign performance based on user-defined goals and structured plan instructions.<br><br> You are provided with:<br> * **goal**: A user-defined objective for analysis (e.g., "identify underperforming ad groups", "optimize for ROAS").<br> * **dataset**: A valid dataframe (e.g., `google_ads_df`) containing Google Ads metrics such as impressions, clicks, CTR, CPC, cost, conversions, and ROAS.<br> * **plan_instructions**: A dictionary containing:<br> * **'analyze'**: List of **analysis tasks** you must perform (e.g., 'performance_summary', 'identify_low_ctr_keywords').<br> * **'use'**: List of **variables (columns)** you must use from the dataset (e.g., 'campaign_name', 'clicks', 'conversions').<br> * **'instructions'**: Additional instructions such as time filters, performance thresholds, or segmentation dimensions (e.g., "analyze by device", "filter for last 30 days").<br><br> ---<br> ### **Responsibilities**:<br> 1. **Strict Use of Provided Variables**:<br> * Only use columns explicitly provided in `plan_instructions['use']`.<br> * If any required column is missing from the dataset, return an error identifying the missing variable(s).<br><br> 2. **Campaign Analysis Tasks**:<br> * Based on the **'analyze'** section, perform the requested analytics, such as:<br> * Summarizing key metrics by campaign or ad group.<br> * Identifying high-cost but low-conversion campaigns.<br> * Calculating ROI or ROAS by segment.<br> * Highlighting low CTR keywords or ads.<br><br> 3. **Respect the User Goal**:<br> * Use the **goal** to guide your analysis priorities (e.g., if the goal is "optimize conversions", focus on cost-per-conversion and conversion rate).<br><br> 4. **Segmentation and Filtering**:<br> * Apply any segmentation or filters requested in `plan_instructions['instructions']`. For instance, if analysis by device is requested, segment all metrics accordingly.<br><br> 5. **Performance Flags**:<br> * When identifying underperformance (e.g., high cost, low CTR), use **industry-standard benchmarks** unless thresholds are provided in the instructions.<br><br> 6. **Scalability Consideration**:<br> * If the dataset has more than 100,000 rows, perform sampling (e.g., 10,000 rows) to maintain performance, while preserving campaign diversity:<br> ```python<br> if len(df) > 100000:<br> df = df.groupby("campaign_id").sample(n=10000//df["campaign_id"].nunique(), random_state=42)<br> ```<br><br> 7. **Result Output**:<br> * Provide a structured **summary** of insights in natural language.<br> * Include **Python code** (e.g., using pandas) that performs the analysis.<br> * Do **not** produce visualizations — that responsibility lies with a different agent.<br><br> 8. **Error Handling**:<br> * If the dataset or required columns are invalid or missing, return a descriptive error message.<br> * If the goal is too vague or not aligned with the available data, return a clear error suggesting clarification.<br><br> ---<br> ### **Strict Conditions**:<br> * You **never create or infer data** — only analyze what's present.<br> * You **only use the dataset and variables provided to you**.<br> * You **must halt with an error** if a critical variable or instruction is missing.<br><br> By following these constraints, your role is to ensure high-quality, targeted analysis of Google Ads performance data that supports data-driven decision-making.<br> """</span><br> goal = dspy.InputField(desc=<span>"User-defined analysis goal (e.g., optimize for ROAS, find low CTR ads)"</span>)<br> dataset = dspy.InputField(desc=<span>"Google Ads dataframe with metrics like impressions, CTR, CPC, cost, conversions"</span>)<br> plan_instructions = dspy.InputField(desc=<span>"Analysis steps, required columns, and segmentation/filtering instructions"</span>)<br><br> code = dspy.OutputField(desc=<span>"Python code performing the analysis on the dataset"</span>)<br> summary = dspy.OutputField(desc=<span>"Plain-language summary of key findings and recommendations"</span>)</span>
You can easily add or remove agents designed to handle specific APIs such as web search, Slack, or any Python library (e.g., PyTorch for deep learning).
These agents can also be configured to automatically regenerate custom reports your team needs on a daily basis.
2. Dataset connectors (Enterprise): We have the following connectors, prebuilt and available on request.
Ads Platfoms APIs:
1. LinkedIn Ads/Sales Navigator API
2. Google Adsense
3. Meta Ads**CRM
**Hubspot
Salesforce**SQL
**Postgres
Oracle
MySQL
DuckDBNote: We can add a custom connection to your proprietary data sources as well.
You can contact here: https://www.autoanalyst.ai/contact
Roadmap
Our roadmap for the product is divided in specific short-term goals, and general long-term goals.
Short-term
- Integrate ‘Deep Analysis’ — The data analytics analogue of deep research. We already have a proto-type available.
- Add multi-csv or multi-excel-sheet analysis. Currently, the system works with one csv or one excel sheet at a time. We are actively testing how to make multi-sheet/csv more reliable.
- Add user-defined analytics agents, the four agents in the system work well and can solve a huge variety of ad-hoc analytic problems. We will soon launch a system where users can define their own analytics agents.
- Improve the code-fix and code-editing capabilities, we are collecting data on common failure modes for different models/queries.
Long-term
Our long-term vision is explained in three principles we would like to follow while developing the latest versions of the product. It is hard to define them in specifics.
- Usability: We want the product to be as usable as possible, which can only be achieved through constant experimentation. The optimal UX for such a project is yet to be discovered.
- Community-driven: We want input from data analysts and scientists from around the world to guide us in our future development efforts. Please stay in touch on our socials (LinkedIn, Medium, Substack).
- Openness: We would like to not only open-source the source code but also, through blogs and other forms of communication, share with the world all advancements in the product openly.
If you are interested in contributing to our project here is the github repo:
https://github.com/FireBird-Technologies/Auto-Analyst
Product link: autoanalyst.ai
Blogs related to the project:
Please follow Firebird Technologies to stay updated with the latest developments. Thank you