Skip to main content

AWS PrivateLink setup to expose MSK for ClickPipes

Setup steps to expose a private MSK via MSK multi-VPC connectivity to ClickPipes.

Overview

This guide will get you started with setting up a MSK multi-VPC to be used with ClickPipes reverse private endpoint.

Requirements

Your MSK cluster VPC must be located in one of our ClickPipes regions. See ClickPipes regions for the list of supported regions.

Enabling multi-VPC connectivity

  1. Navigate to the MSK cluster.
    • Choose "Clusters" from the left navigation pane in the Amazon MSK console.
    • Select the specific MSK cluster you want to configure for multi-VPC connectivity.
  2. Enable MSK multi-VPC connectivity
    • In the Connectivity tab, find the Multi-VPC connectivity section.
    • Click on Edit.
    • Enable the Turn-on MSK multi-VPC connectivity option.
    • Follow the instructions
  3. Add ClickPipes account principal into a cluster’s policy
    • Navigate to the Configuration tab.
    • Click on Edit in the Cluster policy section.
    • Include arn:aws:iam::072088201116:root in the IAM policy. Example:

Creating reverse private endpoint

Follow reverse private endpoint creation steps in the ClickPipes documentation.

· One min read