nicetoolbox.evaluation

Evaluation module of the NICE Toolbox.

nicetoolbox.evaluation.auto_summaries

Creates automatic summaries from pre computed evaluation results given aggregation configurations from the evaluation config.

nicetoolbox.evaluation.config_handler

Parsing and handling of configuration files for evaluation.

nicetoolbox.evaluation.config_schema

Data models for evaluation configuration files and final evaluation config.

nicetoolbox.evaluation.data

Discovery and loading of evaluation data.

nicetoolbox.evaluation.engine

Evaluation engine to manage the evaluation process across multiple datasets.

nicetoolbox.evaluation.in_out

Input and Output management for the evaluation module.

nicetoolbox.evaluation.main

Main script to run the NICE Toolbox evaluation.

nicetoolbox.evaluation.metrics

Metric processing and evaluation framework.

nicetoolbox.evaluation.results_wrapper

nicetoolbox.evaluation.runner

Dataset runner for executing evaluations on a single dataset.