Skip to main content

Blog posts tagged "spark_big_data"

Migrating from Apache Spark 3 to Spark 4

The purpose of this guide is to highlight the key differences between Apache Spark 3 and Spark 4, and provide advice on how to plan a migration. Let’s get started. The biggest changes Let’s talk about the biggest changes between Apache Spark 3.x and Spark 4. Scala 2.12 no more First up, there’s no support

Apache Spark 4.0 beta release – try it now

Apache Spark is a popular framework for developing distributed, parallel data processing applications. Our solution for Apache Spark on Kubernetes has made significant progress in the past year since we launched, adding support for Apache Iceberg, a new GPU accelerated image using the NVIDIA Spark-RAPIDS plugin, and support for the Volcan