* #88: Add some files to configure the project (#89) * #88: Add some files configure the project * Git configuration * Scalastyle support * Ensured no Scalastyle errors * Added CRLF for Windows *.bat and *.cmd files to .editorconfig * Added Spark 3.1 build into the `build-all.sh` script * Created Windows `build-all.cmd` script * Upgrade from Spark 3.1.1 to 3.1.2 (fixes several issues of the previous version) * `--no-transfer-progress` added to build.yml * #97 Aggregate control type strategy (#107) * #97 AggregateControlTypeStrategy suggested API for ControlMeasureBuilder usage * #97 ControlMeasureBuilder.withAggregateColumn(s) implementations. Todo needs testing, cleanup & documentation update MeasurementProcessor split into object/class to offer generic processing methods to be reusable. * #97 ControlMeasureBuilder.withAggregateColumn(s) unit tests added (regression guard) * #97 ControlMeasureBuilder.withAggregateColumn(s) in README.md, original only-default `cmBuilder.calculateMeasurement` removed * [maven-release-plugin] prepare release v3.6.0 * [maven-release-plugin] prepare for next development iteration * #97 readme update - ControlMeasureBuilder API (#110) * #97 readme update (related to #97, too) * #97 maven central version badge added * Feature/113 info permissions config (#114) * #113 atum info file permissions for hdfs loaded from `atum.hdfs.info.file.permissions` config value - tests use MiniDfsCluster to assert controlled correct behavior - test update (custom MiniDfsCluster with umask 000 allows max permissions) - HdfsFileUtils.DefaultFilePermissions is now publicly exposed; the user is expected to call compose the default and configured value it on his own by e.g.: `HdfsFileUtils.getInfoFilePermissionsFromConfig().getOrElse(HdfsFileUtils.DefaultFilePermissions)` * #77 Fix parameter handling bug in CreateInfoFileToolCSV (#78) * #121 sbt cross comptilation * #121 multiversion build (scala, spark, json4s). * #121 hadoop3 used for Spark3/Scala2.12 * #121 sbt github autobuild * #125 publish, pgp/gpg plugin added; sbt-sonatype howto referenced; model, parent prefixed by `atum-` to conform to the mvn publish, cleanup * Upgrade dependencies and remove MiniDFSCluster * GH Action fix * Remove pom.xml files * Add licence header and header check * Fix examples Co-authored-by: David Benedeki <14905969+benedeki@users.noreply.github.com> Co-authored-by: Daniel K <dk1844@gmail.com> Co-authored-by: Jan Scherbaum <kmoj02@gmail.com>

Fix parameter handling bug in CreateInfoFileToolCSV #77

Description

Metadata

Metadata

Assignees

Labels

Type

Fields

Projects

Milestone

Relationships

Development

Issue actions