AI Monitoring Open Source

AI Monitoring (OSS)

Radicalbit AI Monitoring is the open-source platform that empowers you to simply measure the effectiveness and reliability of LLM and Machine Learning Models, driving trust and optimal performance in AI applications.

Available under the Apache 2.0 license, Radicalbit AI Monitoring offers advanced metrics and data visualization, enhancing situational awareness and fostering proactive decision making.

Github Repository

Data and Model Quality

Maintain data integrity by identifying anomalies, missing values, outliers, in both numerical and categorical data that may distort AI model results. Track metrics over time to detect any degradation or improvement.
Monitor and analyze performance across LLMs, Classification, and Regression models to drive smarter decisions.
Measure industry-standard performance metrics for LLMs, Classification and Regression such as Precision, Accuracy, Recall, F1 Score, MSE, MAE, Perplexity and Probability.

Drift Detection

Preemptively identify modifications in the statistical properties of data that lead to sub-par predictions, and take corrective action before your model’s performance suffers.
Leverage a whole range of drift detection algorithms for numericals and categoricals, including Two-Sample Kolmogorov-Smirnov, PSI, Wasserstein Distance, Jensen Shannon Divergence, Chi-Square Test, Jensen Shannon Divergence, Kullback Leibler Divergence, Hellinger Distance.

LLM Application Tracing

Supercharge analysis and debugging by tracking every individual request, prompt and tool invoked by the AI agent.
Access an intuitive dashboard with complete views of sessions, traces and spans, including information such as hierarchy, duration and metadata attributes. Collect insights into the behavior of the LLM-powered applications.

Why Radicalbit AI Monitoring?

Open-Source Flexibility

Adopt a transparent, customizable and free solution for your AI monitoring.

Integration in the AI Workflow

Seamlessly integrate Radicalbit into your LLM and ML toolchains.

Easy to Use and Adopt

Leverage presets and preconfigured dashboards for the most relevant model tasks.

Join the Radicalbit Community!

The Radicalbit open-source platform exists and thrives thanks to the community.

This collaborative approach accelerates the platform’s advancement and benefits all users.

Join discord channel

Are you curious to learn more?

Please fill out the form below for more information about the AI Monitoring (OSS)

A comprehensive open-source AI monitoring platform for transparency, flexibility