Bias detection and contextual evaluation tool for your AI projects

Find bias, select data, evaluate models

hero

DebiAI is an open-source web application that aims to facilitate the process of developing Machine Learning models, especially in the stage of the project data analysis and the model performance comparison.


DebiAI provides data scientists with features to:

  • Identify biases and errors in your input, results, contextual or ground truth project data
  • Make a comparison of the performance of your ML models according to their contextual results
  • Select and create sets of data graphically for further analysis or (re-)training purposes
  • Quickly create and share statistical visualizations of your project data for your team or client



Bias detection

Bias in data can lead to unfair or inaccurate predictions, it is important to detect and mitigate bias in your data before training any model. With DebiAI, you can easily detect bias in your data. Our analysis page provides a wide range of tools to help you identify bias in your data.

Bias detection widgets documentation →

Outliers detection

Outliers can have a significant impact on the results of your model. Searching for outliers in your data is an important and time-consuming task. DebiAI provides a set of tools to help you identify outliers in your data. Our analysis page provides a wide range of tools to help you identify outliers in your data.

Outliers detection widgets documentation →

Contextual model comparison

Selecting the best model for your project can be a difficult task and is often based on the global performance of the model. Being able to compare the performance of your models according to the contexts that matter the most for your project is a key feature of DebiAI.

Model evaluation widgets documentation →

Data selection

Selecting specific data for your project can be challenging with the existing tools. DebiAI widgets are designed to help you select data graphically to do in depth analysis, for training purposes, for cleaning, sharing or any other purpose.

Data selection widgets documentation →

Efficient data visualization

Generating the same visualization every time the project data changes or when new models are trained is a time-consuming task. DebiAI provides features to help you quickly create and share statistical visualizations. By saving your dashboard layout, you can easily generate the same visualization every time you need it.

More about the DebiAI dashboard features →

# Data

DebiAI is designed to be used for any kind projects and data, it is particularly useful for projects that involve many contextual data.

DebiAI provide two main ways to import your data, to learn more about them, check out the data insertion documentation.



# Installation

DebiAI is available as a Docker image. To install it, you can follow the installation guide.



# Use cases

As part of the Confiance.ai (opens new window) program, we (the IRT SystemX (opens new window)) are using and developing DebiAI for a wide range of use cases.

One of them is the Valeo - WoodScape project, where we are using DebiAI to help us analyze the data and the results of the project.



# Who is DebiAI for?

DebiAI is a high level data exploration tool for data scientists and machine learning experts. It is designed to be easily integrated in your project workflow.

Get started



# Scientific publications



# Citation

If you use DebiAI in your research, please cite the following paper:

@inproceedings{mansion2024debiai,
  title={DebiAI: Open-Source Toolkit for Data Analysis, Visualisation and Evaluation in Machine Learning},
  author={Mansion, Tom and Braud, Rapha{\"e}l and Amrani, Ahmed and Chaouche, Sabrina and Adjed, Faouzi and Cantat, Lo{\"\i}c},
  booktitle={ICAS 2024},
  year={2024}
}