After configuring a new stack of Data as a Service Platform by following this, you can customize the stack. Test / Proof of Concept (POC) Stack
To create a simple test DaaS stack on AWS, set the following parameters.
AWS and K8S for DaaS Component:
Provider Key Name: Choose the AWS Provider Access name which is assigned to you. See this for creating an AWS Provider Access method.
Regions: Choose the AWS region where you want to deploy the stack.
VPC: Choose VPC where you want to deploy the stack into
Subnets: Choose at least 2 public and at least 1 private Subnets.
Kubernetes Configuration
Dremio Node Group Configuration
Desired Capacity: 3 nodes
Maximum Size: 3 nodes
Minimum Size: 3 nodes
Worker Node Volume Size: 20 GB
Instance Type: r5d.xlarge
On GCP & K8S component:
Provider Key Name: Choose the cloud provider key name which is assigned to you. See here on creating a Provider Key Name. Location Type: Choose between Regional and Zonal (Regions are independent geographic areas that consist of zones. A zone is a deployment area for Google Cloud resources within a region. Zones should be considered a single failure domain within a region.)
Regions: Choose the GCP region where you want to deploy the stack.
Node Location: Choose the Zone where nodes will be located. Recommend to select 3 or more zones for the high availability.
VPC Network: Choose the VPC Network where you want to deploy the Data Platform.
VPC Sub Network: Choose the VPC Sub Network where you want to deploy the Data Platform.
Kubernetes Configuration
Dremio Node Group Configuration
Desired Capacity: 3 nodes
Maximum Size: 3 nodes
Minimum Size: 3 nodes
Worker Node Volume Size: 20 GB
Instance Type: r5d.xlarge
Other Components:
Production Stack
[TBD] - To create a scalable and highly available Data Flow stack, set each component's settings accordingly.
What's Next?
After customizing all components, you can deploy the stack following this.