Docs
Platform
Getting Started
Concepts Demos Tutorials
CRD Reference
Release Notes
Operators
Overview
Apache Airflow Apache Druid Apache HBase Apache Hadoop HDFS Apache Hive Apache Kafka Apache NiFi Apache Spark on K8S Apache Superset Trino Apache ZooKeeper
OpenPolicyAgent Commons Secret Listener
Tools
Cockpit stackablectl
Policies and Licenses
Product Information Policies Licenses Export Control
Community
Homepage GitHub Discord
Contributing
    23.4
    nightly 24.11 24.7 24.3 23.11 23.7 23.4 23.1
    Platform
    Getting Started
    Concepts Demos Tutorials
    CRD Reference
    Release Notes
    Operators
    Overview
    Apache Airflow Apache Druid Apache HBase Apache Hadoop HDFS Apache Hive Apache Kafka Apache NiFi Apache Spark on K8S Apache Superset Trino Apache ZooKeeper
    OpenPolicyAgent Commons Secret Listener
    Tools
    Cockpit stackablectl
    Policies and Licenses
    Product Information Policies Licenses Export Control
    Community
    Homepage GitHub Discord
    Contributing

    Stackable Documentation

      • Quickstart
      • Getting Started
      • Concepts
        • Roles and role groups
        • Service exposition
        • Service discovery ConfigMap
        • Logging
        • Authentication
        • OPA authorization
        • Product image selection
        • PersistentVolumeClaim usage
        • Resource management
        • S3 resources
        • TLS server verification
        • Pod Placement
        • Cluster operations
      • Demos
        • airflow-scheduled-job
        • data-lakehouse-iceberg-trino-spark
        • hbase-hdfs-cycling-data
        • jupyterhub-pyspark-hdfs-anomaly-detection-taxi-data
        • logging
        • nifi-kafka-druid-earthquake-data
        • nifi-kafka-druid-water-level-data
        • spark-k8s-anomaly-detection-taxi-data
        • trino-iceberg
        • trino-taxi-data
      • Tutorials
        • Setting up an end-to-end data pipeline
        • Authentication with OpenLDAP
      • Reference
        • AuthenticationClass
        • S3 resources
      • Operators
        • Supported Product Versions
        • Monitoring
        • Apache Airflow
          • Getting started
            • Installation
            • First steps
          • Usage guide
            • Pod Placement
            • Mounting DAGs
            • Applying Custom Resources
            • Resource Requests
            • Security
            • Log aggregation
            • Monitoring
            • Configuration & Environment Overrides
            • Cluster Operation
          • Configuration
        • Apache Druid
          • Getting started
            • Installation
            • First steps
          • Usage guide
            • Pod placement
            • Ingestion
            • Deep storage configuration
            • Storage and resource configuration
            • Security
            • Discovery
            • Log aggregation
            • Monitoring
            • Configuration & Environment Overrides
            • Cluster Operation
          • Configuration
        • Apache HBase
          • Getting started
            • Installation
            • First steps
          • Configuration
          • Usage guide
            • Cluster operation
            • Pod placement
            • Resource requests
            • Using Apache Phoenix
            • Discovery
            • Log aggregation
            • Monitoring
            • Configuration overrides
        • Apache Hadoop HDFS
          • Getting started
            • Installation
            • First steps
          • Configuration
          • Concepts
            • Discovery
          • Usage guide
            • Resources
            • Logging & log aggregation
            • Monitoring
            • Scaling
            • Configuration & Environment Overrides
            • Pod Placement
            • Cluster Operation
        • Apache Hive
          • Getting started
            • Installation
            • First steps
          • Configuration
          • Usage
          • Concepts
            • Discovery
            • Cluster Operation
        • Apache Kafka
          • Getting started
            • Installation
            • First steps
          • Usage guide
            • Pod Placement
            • Storage and resource configuration
            • Security
            • Discovery
            • Monitoring
            • Log aggregation
            • Configuration & Environment Overrides
            • Cluster Operation
          • Configuration
        • Apache NiFi
          • Getting started
            • Installation
            • First steps
          • Usage guide
            • Cluster Operation
            • Pod Placement
            • Connecting NiFi to ZooKeeper
            • Adding External Files to the NiFi Servers
            • Security
            • Resource configuration
            • Log aggregation
            • Monitoring
            • Updating NiFi
            • Configuration & Environment Overrides
          • Configuration
        • Apache Spark on K8S
          • Getting started
            • Installation
            • First steps
          • Configuration
          • Usage guide
            • Pod Placement
            • Job Dependencies
            • Resource Requests
            • S3 bucket specification
            • Spark History Server
            • Examples
          • CRD reference
        • Apache Superset
          • Getting started
            • Installation
            • First steps
          • Usage guide
            • Pod Placement
            • Storage and resource configuration
            • Security
            • Connecting Apache Druid clusters
            • Monitoring
            • Log aggregation
            • Configuration & Environment Overrides
          • Configuration
          • Cluster Operation
        • Trino
          • Getting started
            • Installation
            • First steps
          • Configuration
          • Concepts
          • Usage guide
            • Pod placement
            • Cluster Operation
            • Connect to Trino
            • Configuration
            • S3 connection specification
            • Security
            • Monitoring
            • Log aggregation
            • Testing Trino with Hive and S3
            • Catalogs
              • Black Hole
              • Google sheets
              • Apache Hive
              • Apache Iceberg
              • TPC-DS
              • TPC-H
        • Apache ZooKeeper
          • Getting started
            • Installation
            • First steps
          • Configuration
          • Pod Placement
          • Concepts
            • ZNodes
            • Discovery Profiles
          • Usage guide
            • Encryption
            • Authentication
            • Storage and resource configuration
            • Monitoring
            • Log aggregation
            • Using multiple role groups
            • Isolating clients with ZNodes
            • Configuration and environment overrides
            • Cluster Operation
        • OpenPolicyAgent
          • Getting started
            • Installation
            • First steps
          • Usage
          • Configuration
          • Implementation Notes
          • Cluster Operation
          • Concepts
            • Discovery
        • Commons
          • Installation
          • Configuration
          • Usage
          • Concepts
            • Restarter
            • Pod Enricher
        • Listener
          • Building the Operator
          • Installation
          • Usage
          • Concepts
            • Listener
            • ListenerClass
            • Volume
        • Secret
          • Building the Operator
          • Installation
          • Configuration
          • Usage
          • Concepts
            • SecretClass
            • Scope
            • Volume
          • Security
      • Contributor’s Guide
        • Steps to contribute
        • Testing your Code on Kubernetes
        • Development Dashboard
        • Documentation style guide
        • Implementation guidelines
          • Service discovery implementation guidelines
          • OPA connection implementation guidelines
        • Architectural Decision Records
          • Current
            • ADR001: Use English as Documentation Language
            • ADR002: Use Multiple Repositories instead of one Large Repository
            • ADR003: Use RTC as Review Mechanism for Changes
            • ADR004: Use Rust as programming language for the agent
            • ADR005: Decide on handling and location of systemd unit files
            • ADR007: Decide if Kubernetes Components Are to be Reused for Stackable
            • ADR008: Allow Reuse of Existing Kubernetes Operators
            • ADR009: Assigning Services to Nodes
            • ADR010: Expressing one-shot commands in a Kubernetes-native way
            • ADR011: Directory Structure Used by Stackable Components on Managed Hosts
            • ADR012: Authentication token management
            • ADR013: Supported Kubernetes versions
            • ADR014: User Authentication for Products
            • ADR015: How Should Operators Use Values from ConfigMaps & Secrets
            • ADR016: Representation of S3 Buckets in CRDs
            • ADR017: TLS authentication
            • ADR018: Product Image Versioning
            • ADR019: Trino catalog definitions
            • ADR020: Trino catalog usage
            • ADR021: Initial Version of Stackable Stacks Functionality
            • ADR022: Spark history server
            • ADR023: Product image selection
            • ADR024: How to provide stable out-of-cluster access to products
            • ADR025: Logging and Log Aggregation Architecture
            • ADR026: Affinities
            • ADR027: Resource Status
          • Deprecated
            • Use xxx as storage backend for the orchestrator
          • Drafts
            • Choose Authorization Engine
      • Release Notes
      • Product information
      • Lifecycle policies
      • Licenses
    Stackable Documentation 23.4
    • SDP Management
      • nightly
    • Stackable Documentation
      • nightly
      • 24.11
      • 24.7
      • 24.3
      • 23.11
      • 23.7
      • 23.4
      • 23.1
    • Stackable Documentation
    • Operators
    • Apache Airflow
    • Usage guide
    Edit this Page

    This version of the Stackable Data Platform is no longer maintained.

    Please read the latest version of this page instead. The lifecycle policies define when a release stops receiving maintenance updates.

    Usage guide

    your data, your platform

    Company

    • About Us
    • Blog
    • Jobs

    Support

    • Contact Us
    • Imprint
    • Data Protection

    Get in touch

    • info@stackable.tech
    • +49 4103 926 3100
    © 2024 Stackable.

    Apache, Apache Kafka®, Kafka, and the Kafka logo, Apache Druid, Druid, and the Druid logo, Apache ZooKeeper™, ZooKeeper, and the Druid logo, Apache Hive™, Hive, and the Hive logo, Apache Spark™, Spark, and the Spark logo, Apache Airflow, Airflow, and the Airflow logo, Apache HBase®, HBase, and the HBase logo, Apache NiFi, NiFi, and the NiFi logo, Apache Superset, Superset, the Superset logo, Apache Hadoop® HDFS, Apache Hadoop, Hadoop and the Hadoop logo, Apache Phoenix™, Phoenix and the Phoenix-Logo, Apache Iceberg, Iceberg and the Iceberg-Logo are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. Open Policy Agent (OPA) is a Cloud Native Computing Foundation graduated project. Licensed under the Apache License, Version 2.0. Trino is open source software licensed under the Apache License 2.0 and supported by the Trino Software Foundation. MinIO is a [“registered”, if applicable] trademark of the MinIO Corporation. All other products or name brands are trademarks of their respective holders. All product and service names used in this website are for identification purposes only and do not imply endorsement.