Service exposition with ListenerClasses
The Spark operator deploys SparkApplications, and does not offer a UI or other API, so no services are exposed.
However, the operator can also deploy HistoryServers, which do offer a UI and API.
The operator deploys a service called <name>-historyserver
(where <name>
is the name of the spark application) through which the HistoryServer can be reached.
This service can have three different types: cluster-internal
, external-unstable
and external-stable
.
Read more about the types in the service exposition documentation at platform level.
This is how the ListenerClass is configured:
spec:
clusterConfig:
listenerClass: cluster-internal (1)
1 | The default cluster-internal setting. |