Version 0.1.6
Apache Iceberg support:
- Better node naming
- Read metrics and reading small files alerts
- Write metrics and overwriting most of table alerts
Write metrics require enabling an iceberg metric reporter, can be done for you by enabling spark.dataflint.iceberg.autoCatalogDiscovery to true, or setting the iceberg metric reporter manually for each catalog, for example:
spark.sql.catalog.[catalog name].metrics-reporter-impl org.apache.spark.dataflint.iceberg.DataflintIcebergMetricsReporter