If you’re new to Unstructured, read this note first.Before you can create a source connector, you must first sign in to your Unstructured account:
- If you do not already have an Unstructured account, sign up for free. After you sign up, you are automatically signed in to your new Unstructured Starter account, at https://platform.unstructured.io. To sign up for a Team or Enterprise account instead, contact Unstructured Sales, or learn more.
- If you already have an Unstructured Starter or Team account and are not already signed in, sign in to your account at https://platform.unstructured.io. For an Enterprise account, see your Unstructured account administrator for instructions, or email Unstructured Support at support@unstructured.io.
-
After you sign in to your Unstructured Starter account, click API Keys on the sidebar.
For a Team or Enterprise account, before you click API Keys, make sure you have selected the organizational workspace you want to create an API key for. Each API key works with one and only one organizational workspace. Learn more. -
Click Generate API Key.
-
Follow the on-screen instructions to finish generating the key.
-
Click the Copy icon next to your new key to add the key to your system’s clipboard. If you lose this key, simply return and click the Copy icon again.
- A Kafka cluster in Confluent Cloud. (Create a cluster.) The following video shows how to set up a Kafka cluster in Confluent Cloud:
- The hostname and port number of the bootstrap Kafka cluster to connect to..
- The name of the topic to read messages from or write messages to on the cluster. Create a topic. Access available topics.
- For authentication, an API key and secret.
<name>
(required) - A unique name for this connector.<bootstrap-server>
- The hostname of the bootstrap Kafka cluster to connect to.<port>
- The port number of the bootstrap Kafka cluster to connect to. The default is9092
if not otherwise specified.<group-id>
- The ID of the consumer group. A consumer group is a way to allow a pool of consumers to divide the consumption of data over topics and partitions. The default isdefault_group_id
if not otherwise specified.<kafka-api-key>
- For authentication, the API key for access to the cluster.<secret>
- For authentication, the secret for access to the cluster.<topic>
- The name of the topic to read messages from or write messages to on the cluster.<batch-size>
(destination connector only) - The maximum number of messages to send in a single batch. The default is100
if not otherwise specified.<num-messages-to-consume>
(source connector only) - The maximum number of messages that the consumer will try to consume. The default is100
if not otherwise specified.