The blog post to announce the official release of new Dataproc components for Vertex AI Pipelines that simplify MLOps for Spark, Spark SQL, PySpark and Spark jobs. It also provides an end-to-end example of a loan eligibility pipeline.

Source