Development Dashboard

This page contains information about our products and relevant links you might need during development.

Product Homepage Upstream Git Operator Git Our Dockerfile Jenkins Documentation Misc

Apache Airflow

https://airflow.apache.org/

https://github.com/apache/airflow

https://github.com/stackabletech/airflow-operator

https://github.com/stackabletech/docker-images/tree/main/airflow

https://ci.stackable.tech/job/Airflow%20Operator%20Integration%20Tests/

https://docs.stackable.tech/airflow/index.html

Apache Druid

https://druid.apache.org/

https://github.com/apache/druid

https://github.com/stackabletech/druid-operator

https://github.com/stackabletech/docker-images/tree/main/druid

https://ci.stackable.tech/job/Druid%20Operator%20Integration%20Tests/

https://docs.stackable.tech/druid/index.html

Apache HBase

https://hbase.apache.org/

https://github.com/apache/hbase

https://github.com/stackabletech/hbase-operator

https://github.com/stackabletech/docker-images/tree/main/hbase

https://ci.stackable.tech/job/HBase%20Operator%20Integration%20Tests/

https://docs.stackable.tech/hbase/index.html

Apache Hadoop (HDFS)

https://hadoop.apache.org/

https://github.com/apache/hadoop

https://github.com/stackabletech/hdfs-operator

https://github.com/stackabletech/docker-images/tree/main/hadoop

https://ci.stackable.tech/job/HDFS%20Operator%20Integration%20Tests/

https://docs.stackable.tech/hdfs/index.html

Apache Hive (Metastore)

https://hive.apache.org/

https://github.com/apache/hive

https://github.com/stackabletech/hive-operator

https://github.com/stackabletech/docker-images/tree/main/hive

https://ci.stackable.tech/job/Hive%20Operator%20Integration%20Tests/

https://docs.stackable.tech/hive/index.html

Apache Kafka

https://kafka.apache.org/

https://github.com/apache/kafka

https://github.com/stackabletech/kafka-operator

https://github.com/stackabletech/docker-images/tree/main/kafka

https://ci.stackable.tech/job/Kafka%20Operator%20Integration%20Tests/

https://docs.stackable.tech/kafka/index.html

Apache NiFi

https://nifi.apache.org/

https://github.com/apache/nifi

https://github.com/stackabletech/nifi-operator

https://github.com/stackabletech/docker-images/tree/main/nifi

https://ci.stackable.tech/job/NiFi%20Operator%20Integration%20Tests/

https://docs.stackable.tech/nifi/index.html

Apache Spark on Kubernetes

https://spark.apache.org/

https://github.com/apache/spark

https://github.com/stackabletech/spark-k8s-operator

https://github.com/stackabletech/docker-images/tree/main/spark-k8s

https://ci.stackable.tech/job/Spark%20On%20K8S%20Operator%20Integration%20Tests/

https://docs.stackable.tech/spark-k8s/index.html

Apache Superset

https://superset.apache.org/

https://github.com/apache/superset

https://github.com/stackabletech/superset-operator

https://github.com/stackabletech/docker-images/tree/main/superset

https://ci.stackable.tech/job/Superset%20Operator%20Integration%20Tests/

https://docs.stackable.tech/superset/index.html

Apache ZooKeeper

https://zookeeper.apache.org/

https://github.com/apache/zookeeper

https://github.com/stackabletech/zookeeper-operator

https://github.com/stackabletech/docker-images/tree/main/zookeeper

https://ci.stackable.tech/job/Zookeeper%20Operator%20Integration%20Tests/

https://docs.stackable.tech/zookeeper/index.html

OpenPolicyAgent

https://www.openpolicyagent.org/

https://github.com/open-policy-agent/opa

https://github.com/stackabletech/opa-operator

https://github.com/stackabletech/docker-images/tree/main/opa

https://ci.stackable.tech/job/OPA%20Operator%20Integration%20Tests/

https://docs.stackable.tech/opa/index.html

Trino

https://trino.io/

https://github.com/trinodb/trino

https://github.com/stackabletech/trino-operator

https://github.com/stackabletech/docker-images/tree/main/trino

https://ci.stackable.tech/job/Trino%20Operator%20Integration%20Tests/

https://docs.stackable.tech/trino/index.html

There are a few other important repositories that come up frequently:

Name GitHub repository Description

operator-rs

https://github.com/stackabletech/operator-rs

A Rust library with common functionality for our operators

Secret Operator

https://github.com/stackabletech/secret-operator

Manages/generates Kubernetes secrets, and mounts them into pods using CSI

Issues

https://github.com/stackabletech/issues

This repository exists solely for the purpose of tracking issues related to the Stackable Platform in general. Large topics that impact many or even all of the platform components are discussed here. There is no code in this repository.

Documentation

https://github.com/stackabletech/documentation

Platform wide documentation, such as this page, are hosted here. This repository has references to documentation that is hosted in individual operator repositories (see above). It is the main source from which the public Documentation page is generated. The documentation is written in AsciiDoc format and processed with Antora

Docker Images

https://github.com/stackabletech/docker-images

The Stackable Platform can be used to install and run up several open-source products such as Apache Kafka or Trino. Container images of these products hosted on the Stackable Repository Manager and the sources hosted in this repository.

NOTE: Operators host their Dockerfiles in their own repository.

Integration Tests

https://github.com/stackabletech/integration-tests

The Stackable Operators are tested in many environments and across cloud providers. Integration tests are currently driven by Kuttl and are hosted here.

T2

https://github.com/stackabletech/t2

Integration testing across different versions and cloud providers is being developed here.

Operator Templating

https://github.com/stackabletech/operator-templating/

Stackable develops and maintains a growing number of operators for open source software.

The high level structure of the repository is consistent across all repositories, which in the past has led to repetitive maintenance tasks in many repositories even for small changes.

This repository is intended to help with these changes by keeping common files as templates and offering tooling to roll these out to all repositories that are under management by this tool.