6.6.1 Release

This release has following fixes and improvements over 6.6.0

Fixes:
#898 Bugfix: Use backslash on Windows OS in no profile output
#900 Bugfix: Failure to consistently output HASH column in CSV
#886 Bugfix: Terminology corrected on the preferences dialog

Improvements:
Updated to use latest version of Java 11 bundled JRE

6.6.0 Release

Improvements

• Updated to use newer version of Java 11 as bundled JRE
• Improvement to ?? signature pattern
• Ability to specify columns to export with the -co option, e.g. -co NAME PUID
• Configure CSV to only quote if there is a comma in a field, use the -qc option
• The GUI export dialog also includes column and quoting configuration options.
• Write a profile straight to a CSV file, not writing to a database, using the -o output option, e.g. -o "/home/user/results.csv"
• Write a profile straight to the console, by not specifying an output file or a profile to write to.
• Ability to filter profiles written to CSV file or console just as for an export.
• Ability to filter a more than one extensions, e.g. -F "file_ext any doc docx xls xlsx".
• Filter files before they are identified on file metadata (name, extension, last modified, size), using the -ff and -FF filter options.
• Set both binary and container signature files to use to override profile defaults.
• Update profile defaults for both binary and container signature files
• Fix for inverted syntax when the bytes or ranges are inverted
• Introduced semantic versioning
• Improved consistency across profile and no profile mode
• Introduced internal API for making droid easier to use as a dependency
• Code refactoring
• Bug fixes

Known Issues

• On Windows, in no profile mode, the path inside an archive uses forward slash instead of backslash

6.5 Release

⭐ Enhancements

• Only log hikari errors. #373
• Manage opening of WARC 1.1 and update identification of WARC 1.0 #367
• Ability to cherry pick types of archival container to be scanned in CLI #364
• prevent creation of rubbish files during unit tests #346
• Only parse container sigs once #338
• Shrink dependencies #337
• Ability to cherry pick types of archival container to be scanned in GUI #334
• add comment in pom about hotfix on org-netbeans-swing-outline #333
• Constructors #330
• adds drag drop support for files into a profile GUI window, #324
• Compiles all the binary signatures after parsing them. #323
• match signatures in OLE2 sub folders #321
• binary bundle without jre now works for windows too #317
• sort the PUID values in the filter dialog. #315
• Only output exception stack traces when in debug mode. #311
• Full implementation of standard signature syntax in container signatures #305
• bundle jre with windows #289
• Faster xml parsing #238
• Let archive files be embedded in any other archive file. #223
• Add support for Java 11 #220
• FatFile support #214
• Cleaned up loadAllFormats #212
• Cache maven artifacts in travis builds. #211
• Formatting proposals #203
• Make getSigFile() public. #199 #202
• Cleanup build. #201
• Exclude appveyor.yml from licence header check. #190
• Adds support for Appveyor CI which runs on Windows #189
• Add support for Java 9 #188

Solve issues:

• manage warc 1.1 #365
• Container signature file is parsed multiple times. #339
• DROID objects extremely hard to instantiate #329
• AntiPattern: Use of enum.ordinal() in DROID code #325
• full implementation of standard signature syntax in container signatures #237
• Nested folders in OLE2 container #229
• Add support for Java 11 #218
• Ability to drag and drop files into DROID (inc Mac) #204
• Make the getSigFile method in BinarySignatureIdentifier public #199
• Status of Java 9 support? #186

🪲 Bugs

• nio File based POIFS is optimized for memory #448
• fix: put back LF (unix) line separators in csv exports #447
• Fix filter button on windows on java8 #436
• fix: iso prefix in CLI when expanding ISO archives #435
• Removed the recursion into folders for getting size as it was causing… #432
• Fix graphical glitches on Windows 10 #431
• Filter by extension should work when recursing folders #428
• Fix support for siard 2.1 issue418 #421
• fix: .bat script in jre bundle to enable running from network drive #417
• Manage special folders (forbidden, shortcuts) #404
• fix .bat file in bundle without jre #394
• fix export dialog #393
• fix: processing of the quiet parameter on CLI #392
• minor fixes on GUI help: broken images and copyright year #391
• Fix skeleton issue #378
• fix: CLI can browse again folders recursively #376
• fix: format version and name was not given anymore in exports #372
• Ensure only a single object is created. #369
• fix logging #366
• Introduced the jUnit TemporaryFolder rule for automatic cleanup of fi… #358
• Corrected email-id in the copyright header across all files #357
• fix: checkbox filter icon display on main screen #335
• Fix Travis CI build for MacOS #326
• Fix folders messed up in UI #319
• FIX: NullPointerException on Report / Export... button click. #312
• FIX: exception on setting enum based filter. #310
• added lastmodified for files inside ziparchive #303
• Fix display jdk 11 #293
• fix: NPE on export when extension mismatch filters turned on #287
• Fix the Travis CI builds #244
• Changed apache logging/java utils logging to slf4j api #207
• Fix bugs from #167 #191

Solve issues:

• profiles produced now have Windows ends (CR+Newline) rather than just Unix (Newline) #440
• Command line errors in testing #439
• iso archive expanded: wrong prefix in CLI outputs #433
• graphical glitches on Windows 10 #427
• OPEN LOCATION OF FILES IN WINDOWS FILE SYSTEM doesn't work on Centos and Raspbian #426
• filter on extension in CLI does not work if -R is set #425
• Filtering for extension and choosing a single file does not restrict to that file #424
• fmt-1196 SIARD 2.1 is wrongly identified as ZIP #418
• cannot open forbidden folders #406
• cannot open folder shortcuts on Windows #395
• --quiet option in CLI does not work fully as expected #387
• couple of broken images in help #385
• GUI gets stuck forever while trying to browse sub archives in fake archives from skeleton suite #371
• CLI does not browse recursively #363
• DROID opens multiple connection pools to the same database. #362
• CSV export incorrect #360
• UI fails to expand / collapse node in warc after a leaf node is clicked #359
• BUG: NullPointerException when clicking Export button on a report. [#309](https://github.com/digital-preservation/droid/iss...

6.5 Release Candidate 3

⭐ Enhancements

• Only log hikari errors. #373
• Manage opening of WARC 1.1 and update identification of WARC 1.0 #367
• Ability to cherry pick types of archival container to be scanned in CLI #364
• prevent creation of rubbish files during unit tests #346
• Only parse container sigs once #338
• Shrink dependencies #337
• Ability to cherry pick types of archival container to be scanned in GUI #334
• add comment in pom about hotfix on org-netbeans-swing-outline #333
• Constructors #330
• adds drag drop support for files into a profile GUI window, #324
• Compiles all the binary signatures after parsing them. #323
• match signatures in OLE2 sub folders #321
• binary bundle without jre now works for windows too #317
• sort the PUID values in the filter dialog. #315
• Only output exception stack traces when in debug mode. #311
• Full implementation of standard signature syntax in container signatures #305
• bundle jre with windows #289
• Faster xml parsing #238
• Let archive files be embedded in any other archive file. #223
• Add support for Java 11 #220
• FatFile support #214
• Cleaned up loadAllFormats #212
• Cache maven artifacts in travis builds. #211
• Formatting proposals #203
• Make getSigFile() public. #199 #202
• Cleanup build. #201
• Exclude appveyor.yml from licence header check. #190
• Adds support for Appveyor CI which runs on Windows #189
• Add support for Java 9 #188

Solve issues:

• manage warc 1.1 #365
• Container signature file is parsed multiple times. #339
• DROID objects extremely hard to instantiate #329
• AntiPattern: Use of enum.ordinal() in DROID code #325
• full implementation of standard signature syntax in container signatures #237
• Nested folders in OLE2 container #229
• Add support for Java 11 #218
• Ability to drag and drop files into DROID (inc Mac) #204
• Make the getSigFile method in BinarySignatureIdentifier public #199
• Status of Java 9 support? #186

🪲 Bugs

• Fix filter button on windows on java8 #436
• fix: iso prefix in CLI when expanding ISO archives #435
• Removed the recursion into folders for getting size as it was causing… #432
• Fix graphical glitches on Windows 10 #431
• Filter by extension should work when recursing folders #428
• Fix support for siard 2.1 issue418 #421
• fix: .bat script in jre bundle to enable running from network drive #417
• Manage special folders (forbidden, shortcuts) #404
• fix .bat file in bundle without jre #394
• fix export dialog #393
• fix: processing of the quiet parameter on CLI #392
• minor fixes on GUI help: broken images and copyright year #391
• Fix skeleton issue #378
• fix: CLI can browse again folders recursively #376
• fix: format version and name was not given anymore in exports #372
• Ensure only a single object is created. #369
• fix logging #366
• Introduced the jUnit TemporaryFolder rule for automatic cleanup of fi… #358
• Corrected email-id in the copyright header across all files #357
• fix: checkbox filter icon display on main screen #335
• Fix Travis CI build for MacOS #326
• Fix folders messed up in UI #319
• FIX: NullPointerException on Report / Export... button click. #312
• FIX: exception on setting enum based filter. #310
• added lastmodified for files inside ziparchive #303
• Fix display jdk 11 #293
• fix: NPE on export when extension mismatch filters turned on #287
• Fix the Travis CI builds #244
• Changed apache logging/java utils logging to slf4j api #207
• Fix bugs from #167 #191

Solve issues:

• iso archive expanded: wrong prefix in CLI outputs #433
• graphical glitches on Windows 10 #427
• OPEN LOCATION OF FILES IN WINDOWS FILE SYSTEM doesn't work on Centos and Raspbian #426
• filter on extension in CLI does not work if -R is set #425
• Filtering for extension and choosing a single file does not restrict to that file #424
• fmt-1196 SIARD 2.1 is wrongly identified as ZIP #418
• cannot open forbidden folders #406
• cannot open folder shortcuts on Windows #395
• --quiet option in CLI does not work fully as expected #387
• couple of broken images in help #385
• GUI gets stuck forever while trying to browse sub archives in fake archives from skeleton suite #371
• CLI does not browse recursively #363
• DROID opens multiple connection pools to the same database. #362
• CSV export incorrect #360
• UI fails to expand / collapse node in warc after a leaf node is clicked #359
• BUG: NullPointerException when clicking Export button on a report. #309
• BUG: setting IdentificationMethod filter results in exception. #308
• BUG: Concurrency in prepareForUse() in container signature ByteSequences. #307
• BUG: folders are messed up in UI on latest master. #306
• Update email address [#286](https://github.com/digital-preservation/droid/issu...

6.5 Release Candidate 2

Hot fixes

Update 18/03

• include #416 Changed such that the DirStream filter ignores folders if non-recursive
• #411 error message when i tried to open JRE version from .bat file on network drive

Update 21/02

• binary files include hot fix from #394 to test on windows without JRE bundled

Update 6/3

• include hot fix from #404

RC2 20/02

see below

⭐ Enhancements

• Only log hikari errors. #373
• Manage opening of WARC 1.1 and update identification of WARC 1.0 #367
• Ability to cherry pick types of archival container to be scanned in CLI #364
• prevent creation of rubbish files during unit tests #346
• Only parse container sigs once #338
• Shrink dependencies #337
• Ability to cherry pick types of archival container to be scanned in GUI #334
• add comment in pom about hotfix on org-netbeans-swing-outline #333
• Constructors #330
• adds drag drop support for files into a profile GUI window, #324
• Compiles all the binary signatures after parsing them. #323
• match signatures in OLE2 sub folders #321
• binary bundle without jre now works for windows too #317
• sort the PUID values in the filter dialog. #315
• Only output exception stack traces when in debug mode. #311
• Full implementation of standard signature syntax in container signatures #305
• bundle jre with windows #289
• Faster xml parsing #238
• Let archive files be embedded in any other archive file. #223
• Add support for Java 11 #220
• FatFile support #214
• Cleaned up loadAllFormats #212
• Cache maven artifacts in travis builds. #211
• Formatting proposals #203
• Make getSigFile() public. #199 #202
• Cleanup build. #201
• Exclude appveyor.yml from licence header check. #190
• Adds support for Appveyor CI which runs on Windows #189
• Add support for Java 9 #188

Solve issues:

• manage warc 1.1 #365
• Container signature file is parsed multiple times. #339
• DROID objects extremely hard to instantiate #329
• AntiPattern: Use of enum.ordinal() in DROID code #325
• full implementation of standard signature syntax in container signatures #237
• Nested folders in OLE2 container #229
• Add support for Java 11 #218
• Ability to drag and drop files into DROID (inc Mac) #204
• Make the getSigFile method in BinarySignatureIdentifier public #199
• Status of Java 9 support? #186

🪲 Bugs

• fix: processing of the quiet parameter on CLI #392
• minor fixes on GUI help: broken images and copyright year #391
• fix export dialog #393
• Fix skeleton issue #378
• fix: CLI can browse again folders recursively #376
• fix: format version and name was not given anymore in exports #372
• Ensure only a single object is created. #369
• fix logging #366
• Introduced the jUnit TemporaryFolder rule for automatic cleanup of fi… #358
• Corrected email-id in the copyright header across all files #357
• fix: checkbox filter icon display on main screen #335
• Fix Travis CI build for MacOS #326
• Fix folders messed up in UI #319
• FIX: NullPointerException on Report / Export... button click. #312
• FIX: exception on setting enum based filter. #310
• added lastmodified for files inside ziparchive #303
• Fix display jdk 11 #293
• fix: NPE on export when extension mismatch filters turned on #287
• Fix the Travis CI builds #244
• Changed apache logging/java utils logging to slf4j api #207
• Fix bugs from #167 #191

Solve issues:

• --quiet option in CLI does not work fully as expected #387
• couple of broken images in help #385
• Copyright in the help should be updated to 2020 #382
• Unable to select any option other than UTF-8 for encoding in the 'Export profiles' dialog #386
• GUI gets stuck forever while trying to browse sub archives in fake archives from skeleton suite #371
• CLI does not browse recursively #363
• CSV export incorrect #360
• UI fails to expand / collapse node in warc after a leaf node is clicked #359
• BUG: NullPointerException when clicking Export button on a report. #309
• BUG: setting IdentificationMethod filter results in exception. #308
• BUG: Concurrency in prepareForUse() in container signature ByteSequences. #307
• BUG: folders are messed up in UI on latest master. #306
• Update email address #286
• Null Pointer exception when exporting profile with extension mismatch filters turned on #231
• Last modified dates inside a 7zip file #219
• Another localisation problem make mvn install fail #198
• Localisation problem in number format make mvn install fail #197
• Remove log4j.properties from droid-core-interface #176
• Image scaling issues on high resolution screens or Surface Pro specific? #166

💻 Security, Test

• Removed the 2 test files that are identified as TROJAN #380
• [SECURITY] Use HTTPS to resolve dependencies in Maven Build #379
• upd: migrate log4j to log4j2 to fix vulnerability on log4j 1 #352
• Fix unix permission in zip file. [#192...

6.5 Release Candidate 1

⭐ Enhancements

• Only log hikari errors. #373
• Manage opening of WARC 1.1 and update identification of WARC 1.0 #367
• Ability to cherry pick types of archival container to be scanned in CLI #364
• prevent creation of rubbish files during unit tests #346
• Only parse container sigs once #338
• Shrink dependencies #337
• Ability to cherry pick types of archival container to be scanned in GUI #334
• add comment in pom about hotfix on org-netbeans-swing-outline #333
• Constructors #330
• adds drag drop support for files into a profile GUI window, #324
• Compiles all the binary signatures after parsing them. #323
• match signatures in OLE2 sub folders #321
• binary bundle without jre now works for windows too #317
• sort the PUID values in the filter dialog. #315
• Only output exception stack traces when in debug mode. #311
• Full implementation of standard signature syntax in container signatures #305
• bundle jre with windows #289
• Faster xml parsing #238
• Let archive files be embedded in any other archive file. #223
• Add support for Java 11 #220
• FatFile support #214
• Cleaned up loadAllFormats #212
• Cache maven artifacts in travis builds. #211
• Formatting proposals #203
• Make getSigFile() public. #199 #202
• Cleanup build. #201
• Exclude appveyor.yml from licence header check. #190
• Adds support for Appveyor CI which runs on Windows #189
• Add support for Java 9 #188

Solve issues:

• manage warc 1.1 #365
• Container signature file is parsed multiple times. #339
• DROID objects extremely hard to instantiate #329
• AntiPattern: Use of enum.ordinal() in DROID code #325
• full implementation of standard signature syntax in container signatures #237
• Nested folders in OLE2 container #229
• Add support for Java 11 #218
• Ability to drag and drop files into DROID (inc Mac) #204
• Make the getSigFile method in BinarySignatureIdentifier public #199
• Status of Java 9 support? #186

🪲 Bugs

• Fix skeleton issue #378
• fix: CLI can browse again folders recursively #376
• fix: format version and name was not given anymore in exports #372
• Ensure only a single object is created. #369
• fix logging #366
• Introduced the jUnit TemporaryFolder rule for automatic cleanup of fi… #358
• Corrected email-id in the copyright header across all files #357
• fix: checkbox filter icon display on main screen #335
• Fix Travis CI build for MacOS #326
• Fix folders messed up in UI #319
• FIX: NullPointerException on Report / Export... button click. #312
• FIX: exception on setting enum based filter. #310
• added lastmodified for files inside ziparchive #303
• Fix display jdk 11 #293
• fix: NPE on export when extension mismatch filters turned on #287
• Fix the Travis CI builds #244
• Changed apache logging/java utils logging to slf4j api #207
• Fix bugs from #167 #191

Solve issues:

• GUI gets stuck forever while trying to browse sub archives in fake archives from skeleton suite #371
• CLI does not browse recursively #363
• CSV export incorrect #360
• UI fails to expand / collapse node in warc after a leaf node is clicked #359
• BUG: NullPointerException when clicking Export button on a report. #309
• BUG: setting IdentificationMethod filter results in exception. #308
• BUG: Concurrency in prepareForUse() in container signature ByteSequences. #307
• BUG: folders are messed up in UI on latest master. #306
• Update email address #286
• Null Pointer exception when exporting profile with extension mismatch filters turned on #231
• Last modified dates inside a 7zip file #219
• Another localisation problem make mvn install fail #198
• Localisation problem in number format make mvn install fail #197
• Remove log4j.properties from droid-core-interface #176
• Image scaling issues on high resolution screens or Surface Pro specific? #166

💻 Security, Test

• Removed the 2 test files that are identified as TROJAN #380
• [SECURITY] Use HTTPS to resolve dependencies in Maven Build #379
• upd: migrate log4j to log4j2 to fix vulnerability on log4j 1 #352
• Fix unix permission in zip file. #192
• Add explanation for test failures #250
• Fix: test not convenient when building in non english environment #235
• Fixes broken test when built on non-english locale #210

Solve issues:

• Unusual Unix permissions on unzipped lib directory #175

⬆️ Dependency updates

• shifting support forward to Java 11 and fix/update dependencies #283
• upd: signature files to latest DROID_SignatureFile_V96 and container-signature-20200121 #377
• upd: skeleton suite to latest for integration test #320
• End of support for oracle jdk 9 and 10 #225
• Java 8 and Java 9 updates for droid #200
• Minor fixes #179
• upd documentation for new release #381

automated updates:
...

6.4

• DROID can now scan contents of RAR, ISO, 7Zip and BZip2 files
• Will highlight empty folders in GUI display and CSV export
• CSV export will sort on the URI column for persistent ordering
• Added custom URI encoder to correctly encode reserved characters
• Additional option for export CSV with UTF8 BOM
• Bug fix for errors when using filters
• ZIP library has been upgraded to allow profiling of zip64 files
• Increase in memory for DROID when scanning larger files
• Improved error messages for when DROID is trying to download signatures from the wrong URL
• Bug fix for issues saving reports as text in Mac OS.

The previous tag should have been converted to a release on 1 August 2017.

v6.3

*Fixed issue #116 with DROID creating reports with non-valid UTF-8 characters
*Fixed an issue where some PRONOM signatures with multiple fragments were not identifying correctly
*Fixed an issue of when new signatures were downloaded the first profile ran did not always pick up all files and folders
*Fixed an issue with incorrect multiple identifiers in container formats.
*Integrated Github pull request #131 sent to us by David Russo allowing DROID to be used outside of the installation directory