AWS Data Wrangler 0.0.22

Bugfixes

• Setting null date values as None for pandas.read_sql_athena() #69

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!

AWS Data Wrangler 0.0.21

Bugfixes

• Fix bug for boolean type on spark.to_redshift()

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!

AWS Data Wrangler 0.0.20

Enhancements

• Updating all dependencies #65

Bugfixes

• Fix cast for nan values #66

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!

AWS Data Wrangler 0.0.19

Bugfixes

• Fix issues for partitions with a single raw #62

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!

AWS Data Wrangler 0.0.18

Bugfixes

• Fix cast issues for partition columns #59 #60

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!

AWS Data Wrangler 0.0.17

Enhancements

• Pandas.read_sql_athena() now also accept bool columns with null values.

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!

AWS Data Wrangler 0.0.16

Enhancements

• Add tags parameter to EMR.create_cluster()

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!

AWS Data Wrangler 0.0.15

Enhancements

• spark_jars parameter of EMR.create_cluster() now expects a list of paths instead of a single string separated by comma.

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!

AWS Data Wrangler 0.0.14

Bugfixes

• Fix EMR.create_cluster() issue for empty spark_defaults parameter

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!

AWS Data Wrangler 0.0.13

Enhancements

• Documentation #54
• Add Athena.query() to receive the result as python primitives (Iterable[Dict[str, Any]) #55
• Add EMR.build_step()
• Add EMR.submit_steps()
• Add new parameters for EMR.create_cluster():
  • spark_log_level
  • spark_jars_path
  • spark_defaults
  • maximize_resource_allocation
  • steps
  • keep_cluster_alive_when_no_steps
  • termination_protected

Bugfixes

• Fix EMR.create_cluster() issue for single node clusters

P.S. Lambda Layer's bundle and Glue's wheel/egg are available below. It's just upload and run!