Skip to main content

Diagnostics

Troubleshooting Prophecy Fabrics is much easier with built-in diagnostics. The descriptions are designed to help users to independently identify and resolve issues. When creating or connecting to a Fabric, Prophecy automatically tests for connectivity. This feature helps users to determine whether the issue lies within Prophecy itself or in other components of the data ecosystem.

Diagnostics error codes

Error CodeSymptomProviderCauseResolution
10000Is missing from the classpathDatabricksProphecy Library(Scala) is incorrect. You're probably using thin jar.Use assembly jar(${scalaFatJarName}) in the library section of the Fabric settings
10001DRIVER_LIBRARY_INSTALLATION_FAILUREDatabricksProphecy Library(Scala/Python) is incorrect. Databricks could not install itPlease provide the valid library path in the Fabric
10002object prophecy is not a member of packageLivyProphecy Library(Scala) is incorrectPlease ensure that the library path exists and you’re using the assembly jar(${scalaFatJarName})
10003cannot be added to user sessions and prophecy_libsLivyProphecy Library(Python) is incorrectPlease ensure that the library path exists and you’re using correct file(${pythonPLibName})
10004for method and too many argumentsLivyProphecy Library(Scala) is incompatiblePlease use the correct version(${Globals.prophecyLibsVersion}) in the library section of Fabric settings
10005No module named and prophecyLivyProphecy Library(Python) is incorrectPlease provide the valid library path in the Fabric
10006illegal start of simple expressionLivyPython version in livy/hadoop is incorrectPlease make sure you have python3 there
10007IncompatibleClassChangeErrorLivyProphecy Library(Scala) is incompatible with your Spark versionPlease use the correct assembly jar(${scalaFatJarName}) in the library section of the Fabric settings.
10008"FileNotFoundException and prophecy_libs"LivyProphecy Library(Python) path does not existPlease ensure that the file exists as per the path in the library section of the Fabric settings
10009503 Service Temporarily Unavailable and LivyRestClientLivyLivy service is downPlease make sure the livy service is up before executing this command
10010SQLNonTransientConnectionException, rds.amazonaws.com or Unable to instantiate, HiveMetaStoreClientUnity CatalogDatabricks cluster can't access RDS servicePlease ensure that the cluster can access to the same region's RDS endpoint as documented here
10011UnauthorizedCommandException and This execution contained at leas and disallowed languageUnity CatalogShared cluster in unity catalog does not allow Scala commandsPlease use this cluster with Python Pipeline
10012UnauthorizedCommandException and This execution contained at leas and disallowed languageDatabricksThis cluster does not allow ${pipeline's language} commandPlease check with the Databricks workspace administrator to provide the execution access to ${pipeline's language} language
10013javax.net.ssl.SSLHandshakeException and PKIX path building failedLivy / EMRCertificates provided in EMR cluster's security configuration are wrongPlease ensure that EMR cluster's security configuration is using correct certificates