Change Log

All notable changes to the Hindsight collection of projects will be documented in this wiki page. This individual packages adhere to Semantic Versioning. The sprint dates below indicate when the changes landed or will land in the master branch. The full details and road map are here Real Time Data Platform (2018) but unfortunately GitHub does not have a way to make it read-only public accessible.

Key

🆕 == new
⚠️ == breaking change
🚫 == deprecated

2018-08-29 Sprint Release

hindsight - 0.15.1

improve the input plugin tear down (no more orphaning)
delete the data preservation file when restoration fails and start the plugin clean
capture plugin creation errors and expose them to the UI (should reduce/eliminate the 'unknown' state)

🆕 luasandbox-xxhash - 0.0.1

🆕 luasandbox-papertrial - 0.1.0

luasandbox-aws - 0.0.5

add proper Kinesis output support ⚠️ the former test output plugin kinesis_single.lua has been removed

luasandbox-heka- 1.0.22

🆕 framed_protobuf decoder for packed Kinesis messages

luasandbox-syslog- 0.0.12

🆕 facility grammar exposed

2018-08-13 Sprint Release

lua_sandbox 1.3.1

Security fixes
- possible integer overflow in Heka protbuf parser
- deference of a NULL pointer in the message matcher
Message matcher support for NIL in optional header field comparison
- ⚠️ expressions like Type == '' will now be false when type is not set. Use Type == NIL instead.

luasandbox-lpeg - 1.0.15

🆕 escape_url function has been added
🆕 phabricator access log parser

luasandbox-gcp 0.0.3

Attribute support has been added to pub/sub
- ⚠️ the default encoder/decoder changed to payload/nil respectively

luasandbox-aws 0.0.4

Role based authentication has been added for cross IAM support

2018-07-30 Sprint Release

luasandbox-gcp 0.0.2

Reduce the required permission to read an existing topic

2018-07-13 Sprint Release

luasandbox-streaming-algorithms - 0.0.6

🆕 matrix module (2d matrix support)

2018-06-29 Sprint Release

luasandbox - 1.3.0

🆕 lsb_heka_get_state API
add support for empty array serialization (no conversion to object)

hindsight - 0.15.0

cli return code now reflects the difference between an input plugin shutdown/termination

luasandbox-cjson - 2.2.0

add support for empty array encoding

luasandbox-lpeg - 1.0.14

refactored HTML and JSON escaping into this module

2018-06-18 Sprint Release

luasandbox-rjson - 1.1.4

add schema violation reports

luasandbox-lpeg - 1.0.13

🆕 URI parsing module

🆕 luasandbox-libinjection - 0.0.1

2018-06-04 Sprint Release

luasandbox-streaming-algorithms - 0.0.4

heka_message_monitor JSON schema output and UI

luasandbox-elasticsearch - 1.0.7

don't drop messages when all status returns are 403

luasandbox-systemd - 0.0.1

🆕 journald input

luasandbox-parquet - 0.0.11

Allow top level metadata

2018-05-29 Sprint Release

luasandbox-socket - 3.0.8

⚠️ Revert the default TCP decoder to the payload decoder #314

luasandbox-streaming-algorithms - 0.0.3

🆕 time_series module with Matrix Profile support
🆕 heka_message_monitor analysis for change in behavior analysis of all message attributes

🆕 luasandbox-irc - 0.0.1

2018-05-13 Sprint Release

Build/Maintenance work
Matrix Profile design

2018-04-30 Sprint Release

Lua Sandbox - 1.2.11

Classify Uuid, Timestamp and Pid as restricted headers #223

Hindsight 0.14.13

Better handling of pruned queues when restarting analysis/output threads #162

luasandbox-heka - 1.1.18

Prune the old output from heka_inject_payload #298

luasandbox-lpeg - 1.0.12

🚫 nginx access/error decoders

2018-04-15 Sprint Release

Lua Sandbox - 1.2.10

encode_field_array should not use lua_next #221

Hindsight 0.14.12

Fix the hindsight_time_report utility/documentation #163