Releases: xavierguihot/spark_helper
Releases · xavierguihot/spark_helper
Add option to live store the monitoring report for each update during the job run
v1.0.7 Add option to live store the monitoring report for each update during…
Improve the method which writes small contents to HDFS by enabling the usage of any sequence of strings instead of a '\n'-joined string
v1.0.6 Improve the method which writes small contents to HDFS by enabling th…
Print monitor updates to standard output in order to have them in yarn logs as well
v1.0.5 Print monitor updates to standard output in order to have them in yar…
Switch from Float to Double for KPI threshold and value compariso
v1.0.4 Switch from Float to Double for KPI threshold and value comparison
Add a method which creates an empty file on hdfs
v1.0.3 Add method to create an empty file on hdfs
Add compressing function for a file on HDFS which keeps lines order
v1.0.2 Add function which compresses an Hdfs file without loosing the order …
Fix zone to UTC for diffs of dates
Fix timezone to utc for diffs of dates in order to keep tests deterministic for downstream projects when built on env with different local time zones.
Initial commit
v1.0.0 Initial Commit