Is there an existing issue for this?
Current Behavior
- Documentation is not clear on how to disable operational Metadata.
- Disabling Operational Metadata for MV's does currently does not work.
Expected Behavior
Disabling Operational Metadata is clearly documented and you can disable Operational Metadata for MV's by either of the following methods:
-
Disabling the feature at Spec Level:
{
"dataFlowId": "feature_materialized_views",
"dataFlowGroup": "feature_samples",
"dataFlowType": "materialized_view",
"features": {
"operationalMetadataEnabled": false
}
}
-
Disable at MV level using the configFlags setting:
"targetDetails": {
"table": "customer_address",
"tableProperties": {
"delta.autoOptimize.optimizeWrite": "true",
"delta.autoOptimize.autoCompact": "true"
},
"partitionColumns": ["country_code"],
"schemaPath": "schemas/customer_address.json",
"configFlags": ["disableOperationalMetadata"]
},
Steps To Reproduce
No response
Channel
CURRENT
Relevant log output
Is there an existing issue for this?
Current Behavior
Expected Behavior
Disabling Operational Metadata is clearly documented and you can disable Operational Metadata for MV's by either of the following methods:
Disabling the feature at Spec Level:
{
"dataFlowId": "feature_materialized_views",
"dataFlowGroup": "feature_samples",
"dataFlowType": "materialized_view",
"features": {
"operationalMetadataEnabled": false
}
}
Disable at MV level using the configFlags setting:
"targetDetails": {
"table": "customer_address",
"tableProperties": {
"delta.autoOptimize.optimizeWrite": "true",
"delta.autoOptimize.autoCompact": "true"
},
"partitionColumns": ["country_code"],
"schemaPath": "schemas/customer_address.json",
"configFlags": ["disableOperationalMetadata"]
},
Steps To Reproduce
No response
Channel
CURRENT
Relevant log output