As of 18/09 2021 the new version 2.24.0 is out
Standardization Improvements
- #1887 Default time zone used during Standardization can now be overridden/configured for each raw format type. The configuration name is then
standardization.defaultTimestampTimeZone.[format]
and takes precedence over the global setting ofstandardization.defaultTimestampTimeZone.default
. (defaultTimestampTimeZone
was made obsolete, but still supported as a fallback) - #172 The applied default time zones are written into _INFO file.
Standardization and Conformance Improvements
- #172 Upgrade of Atum to version 3.6 and Absa Commons to 0.0.27.
- #1894 Enceladus can write Spline’s
_LINEAGE
file in an S3 location.
Menas Improvements
- #1843 Added Properties button on home page that leads to side panel with list of all properties. It’s possible to display information of each property including a clickable list of datasets that don’t have the property defined.
- #1903 Added function to allow importing of mapping tables with complex default values with more levels.
- #1909 Increased limit of columns shown in the selector for Coalesce and Concatenation conformance rules to 5000. This should fit most needs.
HyperConformance Plugin Improvements
- #1881 New way of having HyperConformance
info_version_column
from an existing dataframe column by specifyingreport.version.column
New Standardization Configuration
standardization.defaultTimestampTimeZone.default
(replaces obsoletedefaultTimestampTimeZone
)standardization.defaultTimestampTimeZone.[format]
Obsolete Standardization Configuration
defaultTimestampTimeZone