19/05/07 15:07:55 INFO InteractiveSessionManager: Registering new session 34
19/05/07 15:07:56 INFO LineBufferedStream: stdout: Warning: Master yarn-cluster is deprecated since 2.0. Please use master "yarn" with specified deploy mode instead.
19/05/07 15:07:57 INFO LineBufferedStream: stdout: 19/05/07 15:07:57 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
19/05/07 15:07:59 INFO LineBufferedStream: stdout: 19/05/07 15:07:59 INFO RMProxy: Connecting to ResourceManager at ip-*-*-*-*.ec2.internal/*.*.*.*:8032
19/05/07 15:07:59 INFO LineBufferedStream: stdout: 19/05/07 15:07:59 INFO Client: Requesting a new application from cluster with 2 NodeManagers
19/05/07 15:07:59 INFO LineBufferedStream: stdout: 19/05/07 15:07:59 INFO Client: Verifying our application has not requested more than the maximum memory capability of the cluster (6144 MB per container)
19/05/07 15:07:59 INFO LineBufferedStream: stdout: 19/05/07 15:07:59 INFO Client: Will allocate AM container, with 6143 MB memory including 558 MB overhead
19/05/07 15:07:59 INFO LineBufferedStream: stdout: 19/05/07 15:07:59 INFO Client: Setting up container launch context for our AM
19/05/07 15:07:59 INFO LineBufferedStream: stdout: 19/05/07 15:07:59 INFO Client: Setting up the launch environment for our AM container
19/05/07 15:07:59 INFO LineBufferedStream: stdout: 19/05/07 15:07:59 INFO Client: Preparing resources for our AM container
19/05/07 15:08:01 INFO LineBufferedStream: stdout: 19/05/07 15:08:01 WARN Client: Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME.
19/05/07 15:08:05 INFO LineBufferedStream: stdout: 19/05/07 15:08:05 INFO Client: Uploading resource file:/mnt/tmp/spark-0afb3548-96ba-4060-b1ba-b1bba810d34c/__spark_libs__3530807799514559153.zip -> hdfs://ip-*-*-*-*.ec2.internal:8020/user/livy/.sparkStaging/application_1557152545038_0039/__spark_libs__3530807799514559153.zip
19/05/07 15:08:06 INFO LineBufferedStream: stdout: 19/05/07 15:08:06 INFO Client: Uploading resource file:/usr/lib/livy/rsc-jars/netty-all-4.0.29.Final.jar -> hdfs://ip-*-*-*-*.ec2.internal:8020/user/livy/.sparkStaging/application_1557152545038_0039/netty-all-4.0.29.Final.jar
19/05/07 15:08:06 INFO LineBufferedStream: stdout: 19/05/07 15:08:06 INFO Client: Uploading resource file:/usr/lib/livy/rsc-jars/livy-api-0.4.0-incubating.jar -> hdfs://ip-*-*-*-*.ec2.internal:8020/user/livy/.sparkStaging/application_1557152545038_0039/livy-api-0.4.0-incubating.jar
19/05/07 15:08:06 INFO LineBufferedStream: stdout: 19/05/07 15:08:06 INFO Client: Uploading resource file:/usr/lib/livy/rsc-jars/livy-rsc-0.4.0-incubating.jar -> hdfs://ip-*-*-*-*.ec2.internal:8020/user/livy/.sparkStaging/application_1557152545038_0039/livy-rsc-0.4.0-incubating.jar
19/05/07 15:08:06 INFO LineBufferedStream: stdout: 19/05/07 15:08:06 INFO Client: Uploading resource file:/usr/lib/livy/repl_2.11-jars/livy-repl_2.11-0.4.0-incubating.jar -> hdfs://ip-*-*-*-*.ec2.internal:8020/user/livy/.sparkStaging/application_1557152545038_0039/livy-repl_2.11-0.4.0-incubating.jar
19/05/07 15:08:07 INFO LineBufferedStream: stdout: 19/05/07 15:08:07 INFO Client: Uploading resource file:/usr/lib/livy/repl_2.11-jars/commons-codec-1.9.jar -> hdfs://ip-*-*-*-*.ec2.internal:8020/user/livy/.sparkStaging/application_1557152545038_0039/commons-codec-1.9.jar
19/05/07 15:08:07 INFO LineBufferedStream: stdout: 19/05/07 15:08:07 INFO Client: Uploading resource file:/usr/lib/livy/repl_2.11-jars/livy-core_2.11-0.4.0-incubating.jar -> hdfs://ip-*-*-*-*.ec2.internal:8020/user/livy/.sparkStaging/application_1557152545038_0039/livy-core_2.11-0.4.0-incubating.jar
19/05/07 15:08:07 INFO LineBufferedStream: stdout: 19/05/07 15:08:07 INFO Client: Uploading resource file:/mnt/tmp/spark-0afb3548-96ba-4060-b1ba-b1bba810d34c/__spark_conf__7540776700308827980.zip -> hdfs://ip-*-*-*-*.ec2.internal:8020/user/livy/.sparkStaging/application_1557152545038_0039/__spark_conf__.zip
19/05/07 15:08:07 INFO LineBufferedStream: stdout: 19/05/07 15:08:07 INFO SecurityManager: Changing view acls to: livy
19/05/07 15:08:07 INFO LineBufferedStream: stdout: 19/05/07 15:08:07 INFO SecurityManager: Changing modify acls to: livy
19/05/07 15:08:07 INFO LineBufferedStream: stdout: 19/05/07 15:08:07 INFO SecurityManager: Changing view acls groups to:
19/05/07 15:08:07 INFO LineBufferedStream: stdout: 19/05/07 15:08:07 INFO SecurityManager: Changing modify acls groups to:
19/05/07 15:08:07 INFO LineBufferedStream: stdout: 19/05/07 15:08:07 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(livy); groups with view permissions: Set(); users  with modify permissions: Set(livy); groups with modify permissions: Set()
19/05/07 15:08:07 INFO LineBufferedStream: stdout: 19/05/07 15:08:07 INFO Client: Submitting application application_1557152545038_0039 to ResourceManager
19/05/07 15:08:07 INFO LineBufferedStream: stdout: 19/05/07 15:08:07 INFO YarnClientImpl: Submitted application application_1557152545038_0039
19/05/07 15:08:07 INFO LineBufferedStream: stdout: 19/05/07 15:08:07 INFO Client: Application report for application_1557152545038_0039 (state: ACCEPTED)
19/05/07 15:08:07 INFO LineBufferedStream: stdout: 19/05/07 15:08:07 INFO Client:
19/05/07 15:08:07 INFO LineBufferedStream: stdout:       client token: N/A
19/05/07 15:08:07 INFO LineBufferedStream: stdout:       diagnostics: N/A
19/05/07 15:08:07 INFO LineBufferedStream: stdout:       ApplicationMaster host: N/A
19/05/07 15:08:07 INFO LineBufferedStream: stdout:       ApplicationMaster RPC port: -1
19/05/07 15:08:07 INFO LineBufferedStream: stdout:       queue: default
19/05/07 15:08:07 INFO LineBufferedStream: stdout:       start time: 1557241687205
19/05/07 15:08:07 INFO LineBufferedStream: stdout:       final status: UNDEFINED
19/05/07 15:08:07 INFO LineBufferedStream: stdout:       tracking URL: http://ip-*-*-*-*.ec2.internal:20888/proxy/application_1557152545038_0039/
19/05/07 15:08:07 INFO LineBufferedStream: stdout:       user: livy
19/05/07 15:08:07 INFO LineBufferedStream: stdout: 19/05/07 15:08:07 INFO ShutdownHookManager: Shutdown hook called
19/05/07 15:08:07 INFO LineBufferedStream: stdout: 19/05/07 15:08:07 INFO ShutdownHookManager: Deleting directory /mnt/tmp/spark-0afb3548-96ba-4060-b1ba-b1bba810d34c
19/05/07 15:09:25 ERROR RSCClient: Failed to connect to context.
java.util.concurrent.TimeoutException: Timed out waiting for context to start.
        at org.apache.livy.rsc.ContextLauncher.connectTimeout(ContextLauncher.java:134)
        at org.apache.livy.rsc.ContextLauncher.access$300(ContextLauncher.java:63)
        at org.apache.livy.rsc.ContextLauncher$2.run(ContextLauncher.java:122)
        at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38)
        at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120)
        at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
        at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
        at java.lang.Thread.run(Thread.java:748)
19/05/07 15:09:25 INFO RSCClient: Failing pending job 8f17ad80-0e10-43fd-9e33-82286b4c8f44 due to shutdown.
19/05/07 15:09:25 INFO InteractiveSession: Failed to ping RSC driver for session 34. Killing application.
19/05/07 15:09:25 INFO InteractiveSession: Stopping InteractiveSession 34...
19/05/07 15:09:25 INFO YarnClientImpl: Killed application application_1557152545038_0039
19/05/07 15:09:25 INFO InteractiveSession: Stopped InteractiveSession 34.
19/05/07 15:09:25 WARN InteractiveSession: (Fail to get rsc uri,java.util.concurrent.ExecutionException: java.util.concurrent.TimeoutException: Timed out waiting for context to start.)