21/06/01 17:06:21 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
21/06/01 17:06:22 INFO RequestHedgingRMFailoverProxyProvider: Looking for the active RM in [rm1, rm2]...
21/06/01 17:06:22 INFO RequestHedgingRMFailoverProxyProvider: Found active RM [rm2]
21/06/01 17:06:22 INFO Client: Requesting a new application from cluster with 3 NodeManagers
21/06/01 17:06:22 INFO Client: Verifying our application has not requested more than the maximum memory capability of the cluster (131072 MB per container)
21/06/01 17:06:22 INFO Client: Will allocate AM container, with 115072 MB memory including 384 MB overhead
21/06/01 17:06:22 INFO Client: Setting up container launch context for our AM
21/06/01 17:06:22 INFO Client: Setting up the launch environment for our AM container
21/06/01 17:06:22 INFO Client: Preparing resources for our AM container
21/06/01 17:06:22 INFO MetricsConfig: loaded properties from hadoop-metrics2.properties
21/06/01 17:06:22 INFO MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s).
21/06/01 17:06:22 INFO MetricsSystemImpl: azure-file-system metrics system started
21/06/01 17:06:23 INFO Client: Distributing Spark jars
21/06/01 17:06:23 INFO Client: Distributing user jar
21/06/01 17:06:23 INFO Client: Distributing any additional resources
21/06/01 17:06:23 INFO Client: Uploading resource file:/tmp/spark-6e1da221-66d8-48bb-aa94-ddc518500276/__spark_conf__3666433072154960547.zip -> wasbs://0f06b4f1-f8d0-43a5-b468-4ae3d7316e3b@9ymeqxflz6n5zacxbczb76rq.blob.core.windows.net/user/trusted-service-user/.sparkStaging/application_1622/__spark_conf__.zip
21/06/01 17:06:23 INFO Client: Finished uploading resource file:/tmp/spark-6e1da221-66d8-48bb-aa94-ddc518500276/__spark_conf__3666433072154960547.zip -> wasbs://0f06b4f1-f8d0-43a5-b468-4ae3d7316e3b@9ymeqxflz6n5zacxbczb76rq.blob.core.windows.net/user/trusted-service-user/.sparkStaging/application_1622/__spark_conf__.zip
21/06/01 17:06:23 INFO Client: Finished setting replication for wasbs://0f06b4f1-f8d0-43a5-b468-4ae3d7316e3b@9ymeqxflz6n5zacxbczb76rq.blob.core.windows.net/user/trusted-service-user/.sparkStaging/application_1622/__spark_conf__.zip
21/06/01 17:06:23 INFO Client: Finished setting permission for wasbs://0f06b4f1-f8d0-43a5-b468-4ae3d7316e3b@9ymeqxflz6n5zacxbczb76rq.blob.core.windows.net/user/trusted-service-user/.sparkStaging/application_1622567169906_0001/__spark_conf__.zip
21/06/01 17:06:23 INFO Client: Finished preparing resources for AM container
21/06/01 17:06:23 INFO SecurityManager: Changing view acls to: trusted-service-user
21/06/01 17:06:23 INFO SecurityManager: Changing modify acls to: trusted-service-user
21/06/01 17:06:23 INFO SecurityManager: Changing view acls groups to: 
21/06/01 17:06:23 INFO SecurityManager: Changing modify acls groups to: 
21/06/01 17:06:23 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(trusted-service-user); groups with view permissions: Set(); users  with modify permissions: Set(trusted-service-user); groups with modify permissions: Set()
21/06/01 17:06:24 INFO Client: Finished setting up for AM Container
21/06/01 17:06:24 INFO Client: Submitting application application_1622 to ResourceManager
21/06/01 17:06:25 INFO YarnClientImpl: Submitted application application_1622
21/06/01 17:06:25 INFO Client: Application report for application_1622 (state: ACCEPTED)
21/06/01 17:06:25 INFO Client: 
	 client token: N/A
	 diagnostics: [Tue Jun 01 17:06:24 +0000 2021] Application is Activated, waiting for resources to be assigned for AM.  Details : AM Partition = <DEFAULT_PARTITION> ; Partition Resource = <memory:393216, vCores:48> ; Queue's Absolute capacity = 100.0 % ; Queue's Absolute used capacity = 0.0 % ; Queue's Absolute max capacity = 100.0 % ; 
	 ApplicationMaster host: N/A
	 ApplicationMaster RPC port: -1
	 queue: default
	 start time: 1622567184920
	 final status: UNDEFINED
	 tracking URL: http://6ba8dd786171:8088/proxy/application_1622/
	 user: trusted-service-user
21/06/01 17:06:25 INFO ShutdownHookManager: Shutdown hook called
21/06/01 17:06:25 INFO ShutdownHookManager: Deleting directory /tmp/spark-77781bf5-c5b5-4754-bf45-a20eafd5232a
21/06/01 17:06:25 INFO ShutdownHookManager: Deleting directory /tmp/spark-6e1da221-66d8-48bb-aa94-ddc518500276