If you’re new to Unstructured, read this note first.Before you can create a destination connector, you must first sign in to your Unstructured account:
- If you do not already have an Unstructured account, sign up for free. After you sign up, you are automatically signed in to your new Unstructured Let’s Go account, at https://platform.unstructured.io. To sign up for a Business account instead, contact Unstructured Sales, or learn more.
- If you already have an Unstructured Let’s Go, Pay-As-You-Go, or Business SaaS account and are not already signed in, sign in to your account at https://platform.unstructured.io. For other types of Business accounts, see your Unstructured account administrator for sign-in instructions, or email Unstructured Support at support@unstructured.io.
-
A Kafka cluster in Confluent Cloud.
(Create a cluster.)
The following video shows how to set up a Kafka cluster in Confluent Cloud:
- The hostname and port number of the bootstrap Kafka cluster to connect to..
- The name of the topic to read messages from or write messages to on the cluster. Create a topic. Access available topics.
- For authentication, an API key and secret.
- On the sidebar, click Connectors.
- Click Destinations.
- Cick New or Create Connector.
- Give the connector some unique Name.
- In the Provider area, click Kafka.
- Click Continue.
- Follow the on-screen instructions to fill in the fields as described later on this page.
- Click Save and Test.
- Name (required): A unique name for this connector.
- Bootstrap Server (required): The hostname of the bootstrap Kafka cluster to connect to.
- Port: The port number of the cluster.
- Group ID: The ID of the consumer group, if any, that is associated with the target Kafka cluster.
(A consumer group is a way to allow a pool of consumers to divide the consumption of data
over topics and partitions.) The default is
default_group_idif not otherwise specified. - Topic (required): The unique name of the topic to read messages from and write messages to on the cluster.
- Number of messages to consume: The maximum number of messages to get from the topic. The default is
100if not otherwise specified. - Batch Size: The maximum number of messages to send in a single batch. The default is
100if not otherwise specified. - API Key (required): The Kafka API key value.
- Secret (required): The secret value for the Kafka API key.