nicetoolbox.evaluation.metrics.categorical.roc_auc.RocAucMetric

class nicetoolbox.evaluation.metrics.categorical.roc_auc.RocAucMetric(metrics_config: BaseMetricConfig, config_handler: ConfigHandler)

Bases: BaseMetric

ROC curve and AUC score per pre-compute group.

Predictions must be float confidence scores; ground truth must be bool. AUC is computed once per group by pooling all frames — same rationale as ConfusionMatrixMetric (avoids averaging per-pair scores across groups with different support and class balance).

Parameters:

• metrics_config – Metric-specific configuration.

• config_handler – Shared config handler with project and evaluation configs.

Methods

compute

Execute the metric end-to-end: load data, compute, return results.

Attributes

metric_config
metric_name
config_handler

compute() → MetricResult

Execute the metric end-to-end: load data, compute, return results.

Returns:

MetricResult containing summary tables, per-frame arrays, and plots.