polaris.Step.validate_baselines

Step.validate_baselines()

Compare variables between output files in this step and in the same step from a baseline run if one was provided.

Writes out either a baseline_passed.log or baseline_failed.log file in the work directory depending on whether all variables passed the comparison. The maximum l1, l2 and l_infinity norm differences found for each variable are stored in self.baseline_diff_summary and written to baseline_diff_summary.json in the work directory so that they can be summarized by the suite runner.

Returns:

• compared (bool) – Whether a baseline comparison was performed

• success (bool) – Whether the outputs were successfully validated against a baseline