Skip to content

Releases: AbsaOSS/cobrix

v2.6.2

03 Jan 13:57
5c6c2e5
Compare
Choose a tag to compare

What's Changed

  • #537 Found unit test with empty name by @miroslavpojer in #538
  • #516 Add support for packed unsigned by @yruslan in #546
  • #543 Improve performance of basic ASCII processing. by @yruslan in #548
  • #545 Add support for 'string' debug columns for ASCII file format by @yruslan in #549
  • #542 Implement filler naming strategies and previous fields based strategy. by @yruslan in #554
  • #553 Fix a regression bug introduced in #543 concerning variable OCCURS. by @yruslan in #555
  • #544 Added an extension option 'data_paths' that replaces 'paths' for multi path load. by @yruslan in #557
  • #556 Fix the option 'file_end_offset' truncates records of each parti… by @yruslan in #558
  • Update Scala 2.13 to 2.13.10, Spark 3.2.3 and 3.3.1 for CI and publish builds by @yruslan in #551
  • Update Scalatest to 3.2.14. by @yruslan in #552

Full Changelog: v2.6.1...v2.6.2

v2.6.1

02 Dec 07:48
5cb9e08
Compare
Choose a tag to compare

What's Changed

Full Changelog: v2.6.0...v2.6.1

v2.6.0

14 Oct 07:51
8c2a71b
Compare
Choose a tag to compare

What's Changed

Full Changelog: v2.5.1...v2.6.0

Minor bugfix release

24 Aug 07:41
ecb7e2b
Compare
Choose a tag to compare

What's Changed

  • Fix FILLERs being dropped for a FILLER with OCCURS GROUP. by @yruslan in #511

Full Changelog: v2.5.0...v2.5.1

Feature Release

28 Jun 08:44
8343170
Compare
Choose a tag to compare

What's Changed

Full Changelog: v2.4.10...v2.5.0

Minor bugfix release

11 Apr 06:08
10e135a
Compare
Choose a tag to compare
  • #481 ASCII control characters are now ignored instead of being replaced with spaces.
    A new string trimming policy (keep_all) allows keeping all control characters in strings (including 0x00).
  • #484 Fix parsing of ASCII files so that only full records are parsed. The old behavior
    can be restored with .option("allow_partial_records", "true").

Minor bugfix release

04 Mar 12:25
92bc156
Compare
Choose a tag to compare
  • #474 Fix numeric decoder of unsigned DISPLAY format. The decoder made more strict and does not allow sign
    overpunching for unsigned numbers.
  • #477 Fixed NotSerializableException when using non-default logger implementations
    (Thanks @joaquin021).

Minor feature release

04 Feb 10:05
fae87b9
Compare
Choose a tag to compare
  • Improved schema flattening method SparkUtils.flattenSchema() for dataframes that have arrays. Array size metadata is used to determine maximum array elements, making it much faster for dataframes produced from mainframe files.
  • #324 Allow removing of FILLERs from AST when parsing using 'parseSimple()'. The signature of the method has
    changed. The boolean arguments now reflect more clearly what they do.
  • #466 Added maxElements and minElements to Spark schema metadata for
    array fields created from fields with OCCURS. This allows knowing the maximum number of elements in arrays when flattening the schema.

Minor bugfix release

11 Jan 07:27
172eee2
Compare
Choose a tag to compare

Minor bugfix release

22 Dec 09:28
816fad3
Compare
Choose a tag to compare
  • #451 Fixed COMP-9 (Cobrix extension for little-endian binary fields).