nicetoolbox.evaluation.data.discovery.DiscoveryEngine¶

class nicetoolbox.evaluation.data.discovery.DiscoveryEngine(io_manager: IO, run_config: DetectorsRunConfig, dataset_properties: DatasetConfig, evaluation_config: FinalEvaluationConfig)[source]¶

Bases: object

Scans file structures and configs to generate a flat list of all WorkItems. Crucially, it reconciles the per-clip prediction structure with the dataset-wide annotation structure.

Methods

discover_work_items

Discover all chunk work items based on the run configuration, dataset properties, and evaluation configuration.

discover_work_items() → List[ChunkWorkItem][source]¶

Discover all chunk work items based on the run configuration, dataset properties, and evaluation configuration. This method scans the file structure for predictions and creates reconciliation plans for the ground truth annotations if required, i.e. when pred and GT labels like joints are not aligned.

Returns:: A list of all discovered chunk work items.
Return type:: List[ChunkWorkItem]