Data tests check the validity of your SQL
About Pipeline Monitoring for Spark
About variant data types and how to update their schema