[hadoop] AuthenticationTokenSerializers

[Montana]

I went ahead and serialized the token in a file in HDFS, using the AuthenticationTokenSerializer and used the version of the setConnectorInfo method which accepts a file name.

Unfortunately, these methods are provided in an inner-class, to avoid breaking the interface API. The methods in question are:

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

When trying to use DelegationTokens with MapReduce, often times the Token cannot be found in cache, would anyone recommend using a Token Renewer? Something like:

dttr.expirationDate =
          UserGroupInformation.getLoginUser().doAs(
            new PrivilegedExceptionAction<Long>() {
              @Override
              public Long run() throws Exception {
                return dttr.token.renew(dttr.conf);
              }
            });

To make sure, I added the following system property to the JVM invocation:

-Dsun.security.krb5.debug=true

In turn enabling a lot of debugging. In this instance is a Token Renewer my best option?

Thank you so much,
Montana Mendy