Support for apache/spark-kubernetes-operator?

[CTCC1]

I read that the BPG uses https://github.com/kubeflow/spark-operator/ as the spark operator which has a wider established user community.

Do we have any plan to integrate with the official apache/spark-kubernetes-operator at https://github.com/apache/spark-kubernetes-operator ? It comes from an apple donation as well to OSS, and has a few advantages:

1. better performance due to using spark's native pod template (As opposed to Deprecation of webhook by moving all functionality into the pod template kubeflow/spark-operator#2502)
2. avoids the penalty of invoking spark-sumbit by using a Java based API to submit (As opposed to Enable the Spark Operator to launch applications using user-defined mechanisms beyond the default spark-submit  kubeflow/spark-operator#2337)

[yuchaoran2011]

Thanks for the suggestion. We don't have a plan of replacing Kubeflow operator with the Java-based operator at this point. But if this is important to you, we welcome contributions. It's possible to refactor the implementation in a modular way so that both operators are supported by the gateway