Bias detection and contextual evaluation tool for your AI projects

Find bias, select data, evaluate models

Bias detection

DebiAI offers a large and expending set of graphical tools making the detection of bias in the data of your projects easier.

Model results comparison

Find which model is better on the contexts that matters the most for your project.

Data selection

With the DebiAi graphical tools and high-level filters, select data for training purpose or for additional exploration.

DebiAI is an open-source web application that aims to facilitate the process of developing Machine Learning models, especially in the stage of the project data analysis and the model performance comparison.

DebiAI provides data scientists with features to:

Identify biases and errors in your input, results, contextual or ground truth project data
Make a comparison of the performance of your ML models according to their contextual results
Select and create sets of data graphically for further analysis or (re-)training purposes
Quickly create and share statistical visualizations of your project data for your team or client

Bias detection

Bias in data can lead to unfair or inaccurate predictions, it is important to detect and mitigate bias in your data before training any model.
With DebiAI, you can easily detect bias in your data. Our analysis page provides a wide range of tools to help you identify bias in your data.

Bias detection widgets documentation →

Outliers detection

Outliers can have a significant impact on the results of your model. Searching for outliers in your data is an important and time-consuming task.
DebiAI provides a set of tools to help you identify outliers in your data. Our analysis page provides a wide range of tools to help you identify outliers in your data.

Outliers detection widgets documentation →

Contextual model comparison

Selecting the best model for your project can be a difficult task and is often based on the global performance of the model. Being able to compare the performance of your models according to the contexts that matter the most for your project is a key feature of DebiAI.

Model evaluation widgets documentation →

Data selection

Selecting specific data for your project can be challenging with the existing tools. DebiAI widgets are designed to help you select data graphically to do in depth analysis, for training purposes, for cleaning, sharing or any other purpose.

Data selection widgets documentation →

Efficient data visualization

Generating the same visualization every time the project data changes or when new models are trained is a time-consuming task. DebiAI provides features to help you quickly create and share statistical visualizations. By saving your dashboard layout, you can easily generate the same visualization every time you need it.

More about the DebiAI dashboard features →

DebiAI intervenes during the data exploration stage and the contextual comparison stage of AI project models. It helps provide intelligence on incomplete or biased data and on model performance, thereby accelerating the resolution of feedback loops.

# Data

DebiAI is designed to be used for any kind projects and data, it is particularly useful for projects that involve many contextual data.

DebiAI provide two main ways to import your data, to learn more about them, check out the data insertion documentation.

# Installation

DebiAI is available as a Docker image. To install it, you can follow the installation guide.

# Use cases

As part of the Confiance.ai (opens new window) program, we (the IRT SystemX (opens new window)) are using and developing DebiAI for a wide range of use cases.

One of them is the Valeo - WoodScape project, where we are using DebiAI to help us analyze the data and the results of the project.

# Who is DebiAI for?

DebiAI is a high level data exploration tool for data scientists and machine learning experts. It is designed to be easily integrated in your project workflow.

Get started

DebiAI Architecture

Project environment:
Project Data: This is the source of data that the user intends to analyze. It may originate from various sources and formats, such as CSV or JSON. Data-Providers: These are the services created by the project members to enable DebiAI to fetch data and model results directly from the project's sources. Python Scripts and DebiAI Python Module: Using the DebiAI Python module, users can adapt their existing scripts and workflows to create selections and insert data and model's results into DebiAI. Algo-Providers: These services are used to provide the specific algorithms required by projects. Once an algorithm is provided to DebiAI, it can be called from the analysis dashboard with the project's data. Application environment: Backend and API: This is a Python-powered backend that provides an API and serves the Web dashboard. DebiAI Web Dashboard: This is the user interface of DebiAI, developed using VueJs. It provides users with an interactive platform to manage and view their data, and is hosted and served by the DebiAI backend. Data storage: This data store supports the DebiAI backend by retaining projects created by the Python module and some specific dashboard elements.

More about the DebiAI architecture →

# Scientific publications

# Citation

If you use DebiAI in your research, please cite the following paper:

@inproceedings{mansion2024debiai,
  title={DebiAI: Open-Source Toolkit for Data Analysis, Visualisation and Evaluation in Machine Learning},
  author={Mansion, Tom and Braud, Rapha{\"e}l and Amrani, Ahmed and Chaouche, Sabrina and Adjed, Faouzi and Cantat, Lo{\"\i}c},
  booktitle={ICAS 2024},
  year={2024}
}