rialto.metadata.data_classes package
Submodules
rialto.metadata.data_classes.feature_metadata module
- class rialto.metadata.data_classes.feature_metadata.FeatureMetadata(value_type: ValueType, name: str, description: str, group: GroupMetadata | None = None)[source]
Bases:
object
A dataclass to hold all information about a feature
- add_group(group: GroupMetadata) Self [source]
Add group information to metadata
- Parameters:
group – Group name
- Returns:
self
- description: str
- classmethod from_spark(record: Row) Self [source]
Create new instance from spark row
- Parameters:
record – spark row
- Returns:
new instance
- group: GroupMetadata = None
- name: str
rialto.metadata.data_classes.group_metadata module
- class rialto.metadata.data_classes.group_metadata.GroupMetadata(name: str, frequency: Schedule, description: str, key: List[str], fs_name: str | None = None, features: List[str] | None = None)[source]
Bases:
object
A dataclass to hold all information about a feature group
- add_features(features: List[str]) Self [source]
Add feature list belonging to the group
- Parameters:
group – list of feature names
- Returns:
self
- description: str
- features: List[str] = None
- classmethod from_spark(schema: Row) Self [source]
Create new instance from spark row
- Parameters:
record – spark row
- Returns:
new instance
- fs_name: str = None
- key: List[str]
- name: str