Ivy Default Cache set to: C:\Users\mwinick\.ivy2\cache
The jars for the packages stored in: C:\Users\mwinick\.ivy2\jars
:: loading settings :: url = jar:file:/C:/bin/spark-3.0.1-bin-hadoop2.7/jars/ivy-2.4.0.jar!/org/apache/ivy/core/settings/ivysettings.xml
com.microsoft.azure#azure-eventhubs-spark_2.11 added as a dependency
:: resolving dependencies :: org.apache.spark#spark-submit-parent-b31c8fae-51d3-44d6-a01e-323e2b90e67e;1.0
        confs: [default]
        found com.microsoft.azure#azure-eventhubs-spark_2.11;2.3.21 in central
        found com.microsoft.azure#azure-eventhubs;3.3.0 in central
        found org.apache.qpid#proton-j;0.33.8 in central
        found com.microsoft.azure#qpid-proton-j-extensions;1.2.4 in central
        found org.slf4j#slf4j-api;1.7.30 in central
        found com.microsoft.azure#azure-client-authentication;1.7.3 in central
        found com.microsoft.azure#azure-client-runtime;1.7.3 in central
        found com.microsoft.rest#client-runtime;1.7.3 in central
        found com.google.guava#guava;24.1.1-jre in central
        found com.google.code.findbugs#jsr305;1.3.9 in central
        found org.checkerframework#checker-compat-qual;2.0.0 in central
        found com.google.errorprone#error_prone_annotations;2.1.3 in central
        found com.google.j2objc#j2objc-annotations;1.1 in central
        found org.codehaus.mojo#animal-sniffer-annotations;1.14 in central
        found com.squareup.retrofit2#retrofit;2.7.2 in central
        found com.squareup.okhttp3#okhttp;3.12.6 in central
        found com.squareup.okio#okio;1.15.0 in central
        found com.squareup.okhttp3#logging-interceptor;3.12.2 in central
        found com.squareup.okhttp3#okhttp-urlconnection;3.12.2 in central
        found com.squareup.retrofit2#converter-jackson;2.7.2 in central
        found com.fasterxml.jackson.core#jackson-databind;2.10.1 in central
        found com.fasterxml.jackson.core#jackson-annotations;2.10.1 in central
        found com.fasterxml.jackson.core#jackson-core;2.10.1 in central
        found com.fasterxml.jackson.datatype#jackson-datatype-joda;2.10.1 in central
        found joda-time#joda-time;2.9.9 in central
        found org.apache.commons#commons-lang3;3.4 in central
        found io.reactivex#rxjava;1.3.8 in central
        found com.squareup.retrofit2#adapter-rxjava;2.7.2 in central
        found com.microsoft.azure#azure-annotations;1.10.0 in central
        found commons-codec#commons-codec;1.11 in central
        found com.microsoft.azure#adal4j;1.6.4 in central
        found com.nimbusds#oauth2-oidc-sdk;6.5 in central
        found com.sun.mail#javax.mail;1.6.1 in central
        found javax.activation#activation;1.1 in central
        found com.github.stephenc.jcip#jcip-annotations;1.0-1 in central
        found net.minidev#json-smart;2.3 in central
        [2.3] net.minidev#json-smart;[1.3.1,2.3]
        found net.minidev#accessors-smart;1.2 in central
        found org.ow2.asm#asm;5.0.4 in central
        found com.nimbusds#lang-tag;1.5 in central
        [1.5] com.nimbusds#lang-tag;[1.4.3,)
        found com.google.code.gson#gson;2.8.0 in central
        found com.nimbusds#nimbus-jose-jwt;9.8.1 in central
        found org.scala-lang.modules#scala-java8-compat_2.11;0.9.0 in local-m2-cache
:: resolution report :: resolve 2267ms :: artifacts dl 20ms
        :: modules in use:
        com.fasterxml.jackson.core#jackson-annotations;2.10.1 from central in [default]
        com.fasterxml.jackson.core#jackson-core;2.10.1 from central in [default]
        com.fasterxml.jackson.core#jackson-databind;2.10.1 from central in [default]
        com.fasterxml.jackson.datatype#jackson-datatype-joda;2.10.1 from central in [default]
        com.github.stephenc.jcip#jcip-annotations;1.0-1 from central in [default]
        com.google.code.findbugs#jsr305;1.3.9 from central in [default]
        com.google.code.gson#gson;2.8.0 from central in [default]
        com.google.errorprone#error_prone_annotations;2.1.3 from central in [default]
        com.google.guava#guava;24.1.1-jre from central in [default]
        com.google.j2objc#j2objc-annotations;1.1 from central in [default]
        com.microsoft.azure#adal4j;1.6.4 from central in [default]
        com.microsoft.azure#azure-annotations;1.10.0 from central in [default]
        com.microsoft.azure#azure-client-authentication;1.7.3 from central in [default]
        com.microsoft.azure#azure-client-runtime;1.7.3 from central in [default]
        com.microsoft.azure#azure-eventhubs;3.3.0 from central in [default]
        com.microsoft.azure#azure-eventhubs-spark_2.11;2.3.21 from central in [default]
        com.microsoft.azure#qpid-proton-j-extensions;1.2.4 from central in [default]
        com.microsoft.rest#client-runtime;1.7.3 from central in [default]
        com.nimbusds#lang-tag;1.5 from central in [default]
        com.nimbusds#nimbus-jose-jwt;9.8.1 from central in [default]
        com.nimbusds#oauth2-oidc-sdk;6.5 from central in [default]
        com.squareup.okhttp3#logging-interceptor;3.12.2 from central in [default]
        com.squareup.okhttp3#okhttp;3.12.6 from central in [default]
        com.squareup.okhttp3#okhttp-urlconnection;3.12.2 from central in [default]
        com.squareup.okio#okio;1.15.0 from central in [default]
        com.squareup.retrofit2#adapter-rxjava;2.7.2 from central in [default]
        com.squareup.retrofit2#converter-jackson;2.7.2 from central in [default]
        com.squareup.retrofit2#retrofit;2.7.2 from central in [default]
        com.sun.mail#javax.mail;1.6.1 from central in [default]
        commons-codec#commons-codec;1.11 from central in [default]
        io.reactivex#rxjava;1.3.8 from central in [default]
        javax.activation#activation;1.1 from central in [default]
        joda-time#joda-time;2.9.9 from central in [default]
        net.minidev#accessors-smart;1.2 from central in [default]
        net.minidev#json-smart;2.3 from central in [default]
        org.apache.commons#commons-lang3;3.4 from central in [default]
        org.apache.qpid#proton-j;0.33.8 from central in [default]
        org.checkerframework#checker-compat-qual;2.0.0 from central in [default]
        org.codehaus.mojo#animal-sniffer-annotations;1.14 from central in [default]
        org.ow2.asm#asm;5.0.4 from central in [default]
        org.scala-lang.modules#scala-java8-compat_2.11;0.9.0 from local-m2-cache in [default]
        org.slf4j#slf4j-api;1.7.30 from central in [default]
        :: evicted modules:
        org.slf4j#slf4j-api;1.7.28 by [org.slf4j#slf4j-api;1.7.30] in [default]
        org.slf4j#slf4j-api;1.7.22 by [org.slf4j#slf4j-api;1.7.30] in [default]
        com.nimbusds#nimbus-jose-jwt;[6.0.1,) by [com.nimbusds#nimbus-jose-jwt;9.8.1] in [default]
        ---------------------------------------------------------------------
        |                  |            modules            ||   artifacts   |
        |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
        ---------------------------------------------------------------------
        |      default     |   45  |   2   |   0   |   3   ||   42  |   0   |
        ---------------------------------------------------------------------
:: retrieving :: org.apache.spark#spark-submit-parent-b31c8fae-51d3-44d6-a01e-323e2b90e67e
        confs: [default]
        0 artifacts copied, 42 already retrieved (0kB/19ms)
21/09/09 18:16:55 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
21/09/09 18:16:55 INFO DotnetRunner: Starting DotnetBackend with dotnet.
21/09/09 18:16:55 INFO DotnetBackend: The number of DotnetBackend threads is set to 10.
21/09/09 18:16:56 INFO DotnetRunner: Port number used by DotnetBackend is 55403
21/09/09 18:16:56 INFO DotnetRunner: Adding key=spark.jars and value=file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-eventhubs-spark_2.11-2.3.21.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-eventhubs-3.3.0.jar,file:///C:/Users/mwinick/.ivy2/jars/org.scala-lang.modules_scala-java8-compat_2.11-0.9.0.jar,file:///C:/Users/mwinick/.ivy2/jars/org.apache.qpid_proton-j-0.33.8.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_qpid-proton-j-extensions-1.2.4.jar,file:///C:/Users/mwinick/.ivy2/jars/org.slf4j_slf4j-api-1.7.30.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-client-authentication-1.7.3.jar,file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_nimbus-jose-jwt-9.8.1.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-client-runtime-1.7.3.jar,file:///C:/Users/mwinick/.ivy2/jars/commons-codec_commons-codec-1.11.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_adal4j-1.6.4.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-annotations-1.10.0.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.rest_client-runtime-1.7.3.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.guava_guava-24.1.1-jre.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_retrofit-2.7.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_okhttp-3.12.6.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_logging-interceptor-3.12.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_okhttp-urlconnection-3.12.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_converter-jackson-2.7.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.datatype_jackson-datatype-joda-2.10.1.jar,file:///C:/Users/mwinick/.ivy2/jars/org.apache.commons_commons-lang3-3.4.jar,file:///C:/Users/mwinick/.ivy2/jars/io.reactivex_rxjava-1.3.8.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_adapter-rxjava-2.7.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.code.findbugs_jsr305-1.3.9.jar,file:///C:/Users/mwinick/.ivy2/jars/org.checkerframework_checker-compat-qual-2.0.0.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.errorprone_error_prone_annotations-2.1.3.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.j2objc_j2objc-annotations-1.1.jar,file:///C:/Users/mwinick/.ivy2/jars/org.codehaus.mojo_animal-sniffer-annotations-1.14.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okio_okio-1.15.0.jar,file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-databind-2.10.1.jar,file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-annotations-2.10.1.jar,file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-core-2.10.1.jar,file:///C:/Users/mwinick/.ivy2/jars/joda-time_joda-time-2.9.9.jar,file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_oauth2-oidc-sdk-6.5.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.code.gson_gson-2.8.0.jar,file:///C:/Users/mwinick/.ivy2/jars/com.sun.mail_javax.mail-1.6.1.jar,file:///C:/Users/mwinick/.ivy2/jars/com.github.stephenc.jcip_jcip-annotations-1.0-1.jar,file:///C:/Users/mwinick/.ivy2/jars/net.minidev_json-smart-2.3.jar,file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_lang-tag-1.5.jar,file:///C:/Users/mwinick/.ivy2/jars/javax.activation_activation-1.1.jar,file:///C:/Users/mwinick/.ivy2/jars/net.minidev_accessors-smart-1.2.jar,file:///C:/Users/mwinick/.ivy2/jars/org.ow2.asm_asm-5.0.4.jar,file:/C:/arcus/mySparkApp/bin/Debug/netcoreapp3.1/microsoft-spark-3-0_2.12-1.0.0.jar to environment
21/09/09 18:16:56 INFO DotnetRunner: Adding key=spark.app.name and value=org.apache.spark.deploy.dotnet.DotnetRunner to environment
21/09/09 18:16:56 INFO DotnetRunner: Adding key=spark.submit.pyFiles and value= to environment
21/09/09 18:16:56 INFO DotnetRunner: Adding key=spark.submit.deployMode and value=client to environment
21/09/09 18:16:56 INFO DotnetRunner: Adding key=spark.master and value=local to environment
21/09/09 18:16:56 INFO DotnetRunner: Adding key=spark.repl.local.jars and value=file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-eventhubs-spark_2.11-2.3.21.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-eventhubs-3.3.0.jar,file:///C:/Users/mwinick/.ivy2/jars/org.scala-lang.modules_scala-java8-compat_2.11-0.9.0.jar,file:///C:/Users/mwinick/.ivy2/jars/org.apache.qpid_proton-j-0.33.8.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_qpid-proton-j-extensions-1.2.4.jar,file:///C:/Users/mwinick/.ivy2/jars/org.slf4j_slf4j-api-1.7.30.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-client-authentication-1.7.3.jar,file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_nimbus-jose-jwt-9.8.1.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-client-runtime-1.7.3.jar,file:///C:/Users/mwinick/.ivy2/jars/commons-codec_commons-codec-1.11.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_adal4j-1.6.4.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-annotations-1.10.0.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.rest_client-runtime-1.7.3.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.guava_guava-24.1.1-jre.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_retrofit-2.7.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_okhttp-3.12.6.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_logging-interceptor-3.12.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_okhttp-urlconnection-3.12.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_converter-jackson-2.7.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.datatype_jackson-datatype-joda-2.10.1.jar,file:///C:/Users/mwinick/.ivy2/jars/org.apache.commons_commons-lang3-3.4.jar,file:///C:/Users/mwinick/.ivy2/jars/io.reactivex_rxjava-1.3.8.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_adapter-rxjava-2.7.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.code.findbugs_jsr305-1.3.9.jar,file:///C:/Users/mwinick/.ivy2/jars/org.checkerframework_checker-compat-qual-2.0.0.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.errorprone_error_prone_annotations-2.1.3.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.j2objc_j2objc-annotations-1.1.jar,file:///C:/Users/mwinick/.ivy2/jars/org.codehaus.mojo_animal-sniffer-annotations-1.14.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okio_okio-1.15.0.jar,file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-databind-2.10.1.jar,file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-annotations-2.10.1.jar,file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-core-2.10.1.jar,file:///C:/Users/mwinick/.ivy2/jars/joda-time_joda-time-2.9.9.jar,file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_oauth2-oidc-sdk-6.5.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.code.gson_gson-2.8.0.jar,file:///C:/Users/mwinick/.ivy2/jars/com.sun.mail_javax.mail-1.6.1.jar,file:///C:/Users/mwinick/.ivy2/jars/com.github.stephenc.jcip_jcip-annotations-1.0-1.jar,file:///C:/Users/mwinick/.ivy2/jars/net.minidev_json-smart-2.3.jar,file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_lang-tag-1.5.jar,file:///C:/Users/mwinick/.ivy2/jars/javax.activation_activation-1.1.jar,file:///C:/Users/mwinick/.ivy2/jars/net.minidev_accessors-smart-1.2.jar,file:///C:/Users/mwinick/.ivy2/jars/org.ow2.asm_asm-5.0.4.jar to environment
[2021-09-10T01:16:56.3372923Z] [5CD034PMMX] [Info] [ConfigurationService] Using port 55403 for connection.
[2021-09-10T01:16:56.3413840Z] [5CD034PMMX] [Info] [JvmBridge] JvMBridge port is 55403
[2021-09-10T01:16:56.3435540Z] [5CD034PMMX] [Info] [JvmBridge] The number of JVM backend thread is set to 10. The max number of concurrent sockets in JvmBridge is set to 7.
21/09/09 18:16:56 INFO SparkContext: Running Spark version 3.0.1
21/09/09 18:16:56 INFO ResourceUtils: ==============================================================
21/09/09 18:16:56 INFO ResourceUtils: Resources for spark.driver:

21/09/09 18:16:56 INFO ResourceUtils: ==============================================================
21/09/09 18:16:56 INFO SparkContext: Submitted application: VS Telemetry processing using Spark.NET
21/09/09 18:16:56 INFO SecurityManager: Changing view acls to: mwinick
21/09/09 18:16:56 INFO SecurityManager: Changing modify acls to: mwinick
21/09/09 18:16:56 INFO SecurityManager: Changing view acls groups to:
21/09/09 18:16:56 INFO SecurityManager: Changing modify acls groups to:
21/09/09 18:16:56 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(mwinick); groups with view permissions: Set(); users  with modify permissions: Set(mwinick); groups with modify permissions: Set()
21/09/09 18:16:56 INFO Utils: Successfully started service 'sparkDriver' on port 55411.
21/09/09 18:16:56 INFO SparkEnv: Registering MapOutputTracker
21/09/09 18:16:56 INFO SparkEnv: Registering BlockManagerMaster
21/09/09 18:16:56 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
21/09/09 18:16:56 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
21/09/09 18:16:56 INFO SparkEnv: Registering BlockManagerMasterHeartbeat
21/09/09 18:16:56 INFO DiskBlockManager: Created local directory at C:\Users\mwinick\AppData\Local\Temp\blockmgr-c47cf310-3194-4af4-ab0c-cd5ed6a1d603
21/09/09 18:16:56 INFO MemoryStore: MemoryStore started with capacity 407.7 MiB
21/09/09 18:16:56 INFO SparkEnv: Registering OutputCommitCoordinator
21/09/09 18:16:57 INFO Utils: Successfully started service 'SparkUI' on port 4040.
21/09/09 18:16:57 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://5CD034PMMX.tandemdiabetes.com:4040
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-eventhubs-spark_2.11-2.3.21.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.microsoft.azure_azure-eventhubs-spark_2.11-2.3.21.jar with timestamp 1631236617111
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-eventhubs-3.3.0.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.microsoft.azure_azure-eventhubs-3.3.0.jar with timestamp 1631236617111
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/org.scala-lang.modules_scala-java8-compat_2.11-0.9.0.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/org.scala-lang.modules_scala-java8-compat_2.11-0.9.0.jar with timestamp 1631236617120
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/org.apache.qpid_proton-j-0.33.8.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/org.apache.qpid_proton-j-0.33.8.jar with timestamp 1631236617121
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_qpid-proton-j-extensions-1.2.4.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.microsoft.azure_qpid-proton-j-extensions-1.2.4.jar with timestamp 1631236617123
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/org.slf4j_slf4j-api-1.7.30.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/org.slf4j_slf4j-api-1.7.30.jar with timestamp 1631236617123
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-client-authentication-1.7.3.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.microsoft.azure_azure-client-authentication-1.7.3.jar with timestamp 1631236617127
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_nimbus-jose-jwt-9.8.1.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.nimbusds_nimbus-jose-jwt-9.8.1.jar with timestamp 1631236617135
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-client-runtime-1.7.3.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.microsoft.azure_azure-client-runtime-1.7.3.jar with timestamp 1631236617138
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/commons-codec_commons-codec-1.11.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/commons-codec_commons-codec-1.11.jar with timestamp 1631236617139
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_adal4j-1.6.4.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.microsoft.azure_adal4j-1.6.4.jar with timestamp 1631236617139
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-annotations-1.10.0.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.microsoft.azure_azure-annotations-1.10.0.jar with timestamp 1631236617140
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.rest_client-runtime-1.7.3.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.microsoft.rest_client-runtime-1.7.3.jar with timestamp 1631236617144
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.google.guava_guava-24.1.1-jre.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.google.guava_guava-24.1.1-jre.jar with timestamp 1631236617152
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_retrofit-2.7.2.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.squareup.retrofit2_retrofit-2.7.2.jar with timestamp 1631236617156
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_okhttp-3.12.6.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.squareup.okhttp3_okhttp-3.12.6.jar with timestamp 1631236617156
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_logging-interceptor-3.12.2.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.squareup.okhttp3_logging-interceptor-3.12.2.jar with timestamp 1631236617157
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_okhttp-urlconnection-3.12.2.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.squareup.okhttp3_okhttp-urlconnection-3.12.2.jar with timestamp 1631236617161
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_converter-jackson-2.7.2.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.squareup.retrofit2_converter-jackson-2.7.2.jar with timestamp 1631236617168
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.datatype_jackson-datatype-joda-2.10.1.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.fasterxml.jackson.datatype_jackson-datatype-joda-2.10.1.jar with timestamp 1631236617172
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/org.apache.commons_commons-lang3-3.4.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/org.apache.commons_commons-lang3-3.4.jar with timestamp 1631236617173
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/io.reactivex_rxjava-1.3.8.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/io.reactivex_rxjava-1.3.8.jar with timestamp 1631236617174
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_adapter-rxjava-2.7.2.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.squareup.retrofit2_adapter-rxjava-2.7.2.jar with timestamp 1631236617178
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.google.code.findbugs_jsr305-1.3.9.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.google.code.findbugs_jsr305-1.3.9.jar with timestamp 1631236617185
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/org.checkerframework_checker-compat-qual-2.0.0.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/org.checkerframework_checker-compat-qual-2.0.0.jar with timestamp 1631236617189
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.google.errorprone_error_prone_annotations-2.1.3.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.google.errorprone_error_prone_annotations-2.1.3.jar with timestamp 1631236617190
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.google.j2objc_j2objc-annotations-1.1.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.google.j2objc_j2objc-annotations-1.1.jar with timestamp 1631236617196
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/org.codehaus.mojo_animal-sniffer-annotations-1.14.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/org.codehaus.mojo_animal-sniffer-annotations-1.14.jar with timestamp 1631236617205
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okio_okio-1.15.0.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.squareup.okio_okio-1.15.0.jar with timestamp 1631236617206
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-databind-2.10.1.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.fasterxml.jackson.core_jackson-databind-2.10.1.jar with timestamp 1631236617207
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-annotations-2.10.1.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.fasterxml.jackson.core_jackson-annotations-2.10.1.jar with timestamp 1631236617211
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-core-2.10.1.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.fasterxml.jackson.core_jackson-core-2.10.1.jar with timestamp 1631236617218
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/joda-time_joda-time-2.9.9.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/joda-time_joda-time-2.9.9.jar with timestamp 1631236617221
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_oauth2-oidc-sdk-6.5.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.nimbusds_oauth2-oidc-sdk-6.5.jar with timestamp 1631236617222
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.google.code.gson_gson-2.8.0.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.google.code.gson_gson-2.8.0.jar with timestamp 1631236617227
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.sun.mail_javax.mail-1.6.1.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.sun.mail_javax.mail-1.6.1.jar with timestamp 1631236617237
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.github.stephenc.jcip_jcip-annotations-1.0-1.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.github.stephenc.jcip_jcip-annotations-1.0-1.jar with timestamp 1631236617238
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/net.minidev_json-smart-2.3.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/net.minidev_json-smart-2.3.jar with timestamp 1631236617239
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_lang-tag-1.5.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/com.nimbusds_lang-tag-1.5.jar with timestamp 1631236617239
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/javax.activation_activation-1.1.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/javax.activation_activation-1.1.jar with timestamp 1631236617244
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/net.minidev_accessors-smart-1.2.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/net.minidev_accessors-smart-1.2.jar with timestamp 1631236617255
21/09/09 18:16:57 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/org.ow2.asm_asm-5.0.4.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/org.ow2.asm_asm-5.0.4.jar with timestamp 1631236617257
21/09/09 18:16:57 INFO SparkContext: Added JAR file:/C:/arcus/mySparkApp/bin/Debug/netcoreapp3.1/microsoft-spark-3-0_2.12-1.0.0.jar at spark://5CD034PMMX.tandemdiabetes.com:55411/jars/microsoft-spark-3-0_2.12-1.0.0.jar with timestamp 1631236617257
21/09/09 18:16:57 INFO Executor: Starting executor ID driver on host 5CD034PMMX.tandemdiabetes.com
21/09/09 18:16:57 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 55434.
21/09/09 18:16:57 INFO NettyBlockTransferService: Server created on 5CD034PMMX.tandemdiabetes.com:55434
21/09/09 18:16:57 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
21/09/09 18:16:57 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 5CD034PMMX.tandemdiabetes.com, 55434, None)
21/09/09 18:16:57 INFO BlockManagerMasterEndpoint: Registering block manager 5CD034PMMX.tandemdiabetes.com:55434 with 407.7 MiB RAM, BlockManagerId(driver, 5CD034PMMX.tandemdiabetes.com, 55434, None)
21/09/09 18:16:57 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 5CD034PMMX.tandemdiabetes.com, 55434, None)
21/09/09 18:16:57 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, 5CD034PMMX.tandemdiabetes.com, 55434, None)
21/09/09 18:16:57 INFO SharedState: Setting hive.metastore.warehouse.dir ('null') to the value of spark.sql.warehouse.dir ('file:/C:/arcus/mySparkApp/spark-warehouse').
21/09/09 18:16:57 INFO SharedState: Warehouse path is 'file:/C:/arcus/mySparkApp/spark-warehouse'.
21/09/09 18:16:58 ERROR DotnetBackendHandler: Failed to execute 'load' on 'org.apache.spark.sql.streaming.DataStreamReader' with args=()
[2021-09-10T01:16:58.2227898Z] [5CD034PMMX] [Error] [JvmBridge] JVM method execution failed: Nonstatic method 'load' failed for class '7' when called with no arguments
[2021-09-10T01:16:58.2229433Z] [5CD034PMMX] [Error] [JvmBridge] java.util.ServiceConfigurationError: org.apache.spark.sql.sources.DataSourceRegister: Provider org.apache.spark.sql.eventhubs.EventHubsSourceProvider could not be instantiated
        at java.util.ServiceLoader.fail(Unknown Source)
        at java.util.ServiceLoader.access$100(Unknown Source)
        at java.util.ServiceLoader$LazyIterator.nextService(Unknown Source)
        at java.util.ServiceLoader$LazyIterator.next(Unknown Source)
        at java.util.ServiceLoader$1.next(Unknown Source)
        at scala.collection.convert.Wrappers$JIteratorWrapper.next(Wrappers.scala:44)
        at scala.collection.Iterator.foreach(Iterator.scala:941)
        at scala.collection.Iterator.foreach$(Iterator.scala:941)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1429)
        at scala.collection.IterableLike.foreach(IterableLike.scala:74)
        at scala.collection.IterableLike.foreach$(IterableLike.scala:73)
        at scala.collection.AbstractIterable.foreach(Iterable.scala:56)
        at scala.collection.TraversableLike.filterImpl(TraversableLike.scala:255)
        at scala.collection.TraversableLike.filterImpl$(TraversableLike.scala:249)
        at scala.collection.AbstractTraversable.filterImpl(Traversable.scala:108)
        at scala.collection.TraversableLike.filter(TraversableLike.scala:347)
        at scala.collection.TraversableLike.filter$(TraversableLike.scala:347)
        at scala.collection.AbstractTraversable.filter(Traversable.scala:108)
        at org.apache.spark.sql.execution.datasources.DataSource$.lookupDataSource(DataSource.scala:649)
        at org.apache.spark.sql.streaming.DataStreamReader.load(DataStreamReader.scala:194)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
        at java.lang.reflect.Method.invoke(Unknown Source)
        at org.apache.spark.api.dotnet.DotnetBackendHandler.handleMethodCall(DotnetBackendHandler.scala:159)
        at org.apache.spark.api.dotnet.DotnetBackendHandler.$anonfun$handleBackendRequest$2(DotnetBackendHandler.scala:99)
        at org.apache.spark.api.dotnet.ThreadPool$$anon$1.run(ThreadPool.scala:34)
        at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
        at java.util.concurrent.FutureTask.run(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Unknown Source)
Caused by: java.lang.NoClassDefFoundError: org/apache/spark/internal/Logging$class
        at org.apache.spark.sql.eventhubs.EventHubsSourceProvider.<init>(EventHubsSourceProvider.scala:57)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
        at java.lang.reflect.Constructor.newInstance(Unknown Source)
        at java.lang.Class.newInstance(Unknown Source)
        ... 30 more
Caused by: java.lang.ClassNotFoundException: org.apache.spark.internal.Logging$class
        at java.net.URLClassLoader.findClass(Unknown Source)
        at java.lang.ClassLoader.loadClass(Unknown Source)
        at java.lang.ClassLoader.loadClass(Unknown Source)
        ... 36 more

[2021-09-10T01:16:58.2360560Z] [5CD034PMMX] [Exception] [JvmBridge] JVM method execution failed: Nonstatic method 'load' failed for class '7' when called with no arguments
   at Microsoft.Spark.Interop.Ipc.JvmBridge.CallJavaMethod(Boolean isStatic, Object classNameOrJvmObjectReference, String methodName, Object[] args)
Unhandled exception. System.Exception: JVM method execution failed: Nonstatic method 'load' failed for class '7' when called with no arguments
 ---> Microsoft.Spark.JvmException: java.util.ServiceConfigurationError: org.apache.spark.sql.sources.DataSourceRegister: Provider org.apache.spark.sql.eventhubs.EventHubsSourceProvider could not be instantiated
        at java.util.ServiceLoader.fail(Unknown Source)
        at java.util.ServiceLoader.access$100(Unknown Source)
        at java.util.ServiceLoader$LazyIterator.nextService(Unknown Source)
        at java.util.ServiceLoader$LazyIterator.next(Unknown Source)
        at java.util.ServiceLoader$1.next(Unknown Source)
        at scala.collection.convert.Wrappers$JIteratorWrapper.next(Wrappers.scala:44)
        at scala.collection.Iterator.foreach(Iterator.scala:941)
        at scala.collection.Iterator.foreach$(Iterator.scala:941)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1429)
        at scala.collection.IterableLike.foreach(IterableLike.scala:74)
        at scala.collection.IterableLike.foreach$(IterableLike.scala:73)
        at scala.collection.AbstractIterable.foreach(Iterable.scala:56)
        at scala.collection.TraversableLike.filterImpl(TraversableLike.scala:255)
        at scala.collection.TraversableLike.filterImpl$(TraversableLike.scala:249)
        at scala.collection.AbstractTraversable.filterImpl(Traversable.scala:108)
        at scala.collection.TraversableLike.filter(TraversableLike.scala:347)
        at scala.collection.TraversableLike.filter$(TraversableLike.scala:347)
        at scala.collection.AbstractTraversable.filter(Traversable.scala:108)
        at org.apache.spark.sql.execution.datasources.DataSource$.lookupDataSource(DataSource.scala:649)
        at org.apache.spark.sql.streaming.DataStreamReader.load(DataStreamReader.scala:194)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
        at java.lang.reflect.Method.invoke(Unknown Source)
        at org.apache.spark.api.dotnet.DotnetBackendHandler.handleMethodCall(DotnetBackendHandler.scala:159)
        at org.apache.spark.api.dotnet.DotnetBackendHandler.$anonfun$handleBackendRequest$2(DotnetBackendHandler.scala:99)
        at org.apache.spark.api.dotnet.ThreadPool$$anon$1.run(ThreadPool.scala:34)
        at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
        at java.util.concurrent.FutureTask.run(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Unknown Source)
Caused by: java.lang.NoClassDefFoundError: org/apache/spark/internal/Logging$class
        at org.apache.spark.sql.eventhubs.EventHubsSourceProvider.<init>(EventHubsSourceProvider.scala:57)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
        at java.lang.reflect.Constructor.newInstance(Unknown Source)
        at java.lang.Class.newInstance(Unknown Source)
        ... 30 more
Caused by: java.lang.ClassNotFoundException: org.apache.spark.internal.Logging$class
        at java.net.URLClassLoader.findClass(Unknown Source)
        at java.lang.ClassLoader.loadClass(Unknown Source)
        at java.lang.ClassLoader.loadClass(Unknown Source)
        ... 36 more

   --- End of inner exception stack trace ---
   at Microsoft.Spark.Interop.Ipc.JvmBridge.CallJavaMethod(Boolean isStatic, Object classNameOrJvmObjectReference, String methodName, Object[] args)
   at Microsoft.Spark.Interop.Ipc.JvmBridge.CallNonStaticJavaMethod(JvmObjectReference objectId, String methodName, Object[] args)
   at Microsoft.Spark.Interop.Ipc.JvmObjectReference.Invoke(String methodName, Object[] args)
   at Microsoft.Spark.Sql.Streaming.DataStreamReader.Load()
   at Sample.Program.Main(String[] args) in C:\arcus\mySparkApp\Program.cs:line 22
21/09/09 18:16:58 INFO DotnetRunner: Closing DotnetBackend
21/09/09 18:16:58 INFO SparkContext: Invoking stop() from shutdown hook
21/09/09 18:16:58 INFO SparkUI: Stopped Spark web UI at http://5CD034PMMX.tandemdiabetes.com:4040
21/09/09 18:16:58 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
21/09/09 18:16:58 INFO MemoryStore: MemoryStore cleared
21/09/09 18:16:58 INFO BlockManager: BlockManager stopped
21/09/09 18:16:58 INFO BlockManagerMaster: BlockManagerMaster stopped
21/09/09 18:16:58 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
21/09/09 18:16:58 INFO SparkContext: Successfully stopped SparkContext
21/09/09 18:16:58 INFO ShutdownHookManager: Shutdown hook called
21/09/09 18:16:58 INFO ShutdownHookManager: Deleting directory C:\Users\mwinick\AppData\Local\Temp\spark-bfbb8194-2497-4a0e-8073-57977686b627
21/09/09 18:16:58 INFO ShutdownHookManager: Deleting directory C:\Users\mwinick\AppData\Local\Temp\spark-d84a5f02-c810-481d-8e4e-69972fd50a53