scala – Kerberos Auth With SparkLauncher – Cannot locate KDC Error

scala – Kerberos Auth With SparkLauncher – Cannot locate KDC Error

This error does not necessarily mean that it cannot locate your krb5.conf file. It can also arise when your krb5.conf file does not contain the correct domain or realm specifications for your principal.

For example, if your principal is [email protected] but your krb5.conf file only specifies [email protected], you will also get this error.

Additionally, if your krb5.conf is located in a location other than default (/etc/krb5.conf), I was having issues with setting the javaExtraOpts. I found pointing updating the env var prior to running helped: export SPARK_SUBMIT_OPTS=-Djava.security.krb5.conf=/path/to/krb5-new.conf

Lastly, I found setting –principle and –keytab args in spark-submit actually caused issues, and removing these can help.

scala – Kerberos Auth With SparkLauncher – Cannot locate KDC Error

Leave a Reply

Your email address will not be published.