Run Apache Spark with Amazon EMR on EKS backed by Amazon FSx for Lustre storage

As shown in the following diagram, the FSx for Lustre CSI driver plugin is deployed to an Amazon EKS cluster to dynamically provision the FSx for Lustre file system with a given PVC. The Spark application driver and

Continue reading