Interactive Execution
Prophecy IDE comes with an inbuilt interactive spark shell that supports both Python
and Scala
.
The shell is an easy way to quickly analyze data or test spark commands
info
Spark context
and session
are available within the shell as variables sc
and spark
respectively
Examples
note
You need to be connected to a cluster to access the interactive shell