How to customize StreamSets DC+ Platform

How to customize StreamSets DC+ Platform

You can create a new stack for StreamSets DC+ Platform by following here.

Test / Proof of Concept (POC) Stack
To create a simple test StreamSets DC+ Platform stack, set the following parameters.
On AWS & K8S component:
  • Provider Key Name: Choose the AWS Provider Key name which is assigned to you. See How to Create Provider Key Name for detail on creating a key.
  • Regions: Choose the AWS region where you want to deploy the stack.
  • VPC: Choose VPC where you want to deploy the stack into
  • Subnets: Choose at least 2 public and at least 2 private Subnets.
  • Desired Capacity: 5 nodes
  • Maximum Size: 5 nodes
  • Minimum Size: 5 nodes
  • Instance Type: t2.large
On GCP & K8S component:
  • Provider Key Name: Choose the cloud provider key name which is assigned to you. See here on creating a Provider Key Name.
  • Location Type: Choose between Regional and Zonal (Regions are independent geographic areas that consist of zones. A zone is a deployment area for Google Cloud resources within a region. Zones should be considered a single failure domain within a region.)
  • Regions: Choose the GCP region where you want to deploy the stack.
  • Node Location: Choose the Zone where nodes will be located. Recommend to select 3 or more zones for the high availability.
  • VPC Network: Choose the VPC Network where you want to deploy the Data Platform.
  • VPC Sub Network: Choose the VPC Sub Network where you want to deploy the Data Platform.
  • Desired Capacity: 5 nodes
  • Maximum Size: 5 nodes
  • Minimum Size: 5 nodes
  • Instance Type: t2.large
Other Components:
  • No changes are required.
Production Stack
[TBD] - To create a scalable and highly available StreamSets DC+ Platform stack, set each component settings accordingly.

What's Next?




    • Related Articles

    • How to configure StreamSets DC+ Platform

      You can initiate configuring a new stack from a few different places: On the Home page, "Configure stack" button on the Stacks statistics block. On the Stacks page, the "Configure new stack" button on the top page On the Projects page, select Project ...

    • What is StreamSets DC+ Platform

      StreamSets Data Collector+ Platform provides data ingestion pipelines integrated with ETL processing for streaming, batch, and change data capture (CDC). This allows a user to use snapblocs dashboard UI to create a data ingestion pipeline stack by ...

    • What are common use cases for StreamSets DC+ Platform

      Example use cases for StreamSets DC+ Platform Ingest and Transform Data in Any Cloud Modernize Data Lakes and Data Warehouses without hand-coding or special skills, and feed analytics platforms with continuous data from any source. StreamSets Data ...

    • How to customize Data Flow Platform

      After configuring a new stack of Data Flow Platform by following this, you can customize the stack. Test / Proof of Concept (POC) Stack To create a simple test Data Flow stack on cloud prividers, set the following parameters. AWS and K8S Component: ...

    • How to customize Kubernetes+ Platform

      After configuring a new stack of Kubernetes+ Platform by following this, you can customize the stack. Test / Proof of Concept (POC) Stack To create a simple test Kubernetes+ Platform stack, set the following parameters. On AWS & K8S component: ...