> ## Documentation Index
> Fetch the complete documentation index at: https://docs.unstructured.io/llms.txt
> Use this file to discover all available pages before exploring further.
# Snowflake
If you're new to Unstructured, read this note first.
Before you can create a destination connector, you must first sign in to your Unstructured account:
* If you do not already have an Unstructured account, [sign up for free](https://unstructured.io/?modal=try-for-free). After you sign up, you are automatically signed in to your new Unstructured **Let's Go** account, at [https://platform.unstructured.io](https://platform.unstructured.io).
To sign up for a **Business** account instead, [contact Unstructured Sales](https://unstructured.io/?modal=contact-sales), or [learn more](/ui/overview#how-am-i-billed%3F).
* If you already have an Unstructured **Let's Go**, **Pay-As-You-Go**, or **Business SaaS** account and are not already signed in, sign in to your account at
[https://platform.unstructured.io](https://platform.unstructured.io). For other types of **Business** accounts, see your Unstructured account administrator for sign-in instructions,
or email Unstructured Support at [support@unstructured.io](mailto:support@unstructured.io).
After you sign in, the [Unstructured user interface](/ui/overview) (UI) appears, which you use to create your destination connector.
After you create the destination connector, add it along with a
[source connector](/ui/sources/overview) to a [workflow](/ui/workflows). Then run the worklow as a
[job](/ui/jobs). To learn how, try out the [hands-on UI quickstart](/ui/quickstart#remote-quickstart) or watch the 4-minute
[video tutorial](https://www.youtube.com/watch?v=Wn2FfHT6H-o).
You can also create destination connectors with the Unstructured API.
[Learn how](/api-reference/workflow/destinations/overview).
If you need help, email Unstructured Support at [support@unstructured.io](mailto:support@unstructured.io).
You are now ready to start creating a destination connector! Keep reading to learn how.
Send processed data from Unstructured to Snowflake.
The requirements are as follows.
* A Snowflake [account](https://signup.snowflake.com/) and its account identifier.
To get the identifier for the current Snowflake account:
1. Log in to [Snowsight](https://docs.snowflake.com/user-guide/ui-snowsight-homepage) with your Snowflake account.
2. In Snowsight, on the navigation menu, click your username, and then click **Account > View account details**.
3. On the **Account** tab, note the value of the **Account Identifier** field.
Alternatively, the following Snowflake query returns the current account's identifier:
```text theme={null}
SELECT CURRENT_ORGANIZATION_NAME() || '-' || CURRENT_ACCOUNT_NAME() AS "Account Identifier"
```
* A Snowflake user, which can be a service user (recommended) or a human user.
To create a service user entry and get their login name (not username):
1. Log in to [Snowsight](https://docs.snowflake.com/user-guide/ui-snowsight-homepage) with your Snowflake account.
2. In Snowsight, on the navigation menu, click **Projects > Worksheets**.
3. Click the **+** button to create a SQL worksheet.
4. In the worksheet, enter the following Snowflake query to create a service user, replacing the following placeholders:
* Replace `` with some name for the service user.
* Replace `` with the name of any default role for the service user to use.
```sql theme={null}
CREATE USER
DEFAULT_ROLE = ""
TYPE = SERVICE
```
5. Click the arrow icon to run the worksheet, which creates the service user.
6. To get their login name, on the navigation menu, click **Admin > Users & Roles**.
7. On the **Users** tab, in the list of available users, click the name of the target user.
8. In the **About** tile, note the **Login Name** for the user.
To create a human user entry and get their login name (not username):
1. Log in to [Snowsight](https://docs.snowflake.com/user-guide/ui-snowsight-homepage) with your Snowflake account.
2. In Snowsight, on the navigation menu, click **Admin > Users & roles**.
3. Click the **Users** tab.
4. Click **+ User**.
5. Follow the on-screen guidance to specify the user's settings.
6. Click **Create User**.
7. To get their login name, on the navigation menu, click **Admin > Users & Roles**.
8. On the **Users** tab, in the list of available users, click the name of the target user.
9. In the **About** tile, note the **Login Name** for the user.
* A programmatic access token (PAT) for the Snowflake user.
To create a programmatic access token (PAT) for a user:
1. Log in to [Snowsight](https://docs.snowflake.com/user-guide/ui-snowsight-homepage) with your Snowflake account.
2. In Snowsight, on the navigation menu, click **Admin > Users & Roles**.
3. On the **Users** tab, in the list of available users, click the name of the target user.
4. In the **Programmatic access tokens** tile, click the **Generate new token** button.
5. Follow the on-screen guidance to specify the PAT's settings.
You must set an expiration date for the PAT. This expiration date can be as soon as one day after the PAT is created or up to one year or even later.
Once this PAT expires, the connector will stop working.
To make sure that your connector continues to work, before your current PAT expires, you must follow this procedure again to generate a new PAT and
update your connector's settings with your new PAT's value.
Unstructured does not notify you when a PAT is about to expire or has already expired.
You are responsible for tracking your PATs' expiration dates and taking corrective action before they expire.
6. Click **Generate**.
7. Copy the generated PAT's value to a secure location, as you will not be able to access it again. If you lose this PAT's value,
you will need to repeat this procedure to generate a new, replacement one.
The PAT will not work unless the Snowflake account also has a valid
[network rule](https://docs.snowflake.com/en/user-guide/network-rules) along with a valid
[network policy](https://docs.snowflake.com/en/user-guide/network-policies) attached to that rule.
The network rule must also be activated on the Snowflake account to begin taking effect.
To create a valid network rule:
1. Log in to [Snowsight](https://docs.snowflake.com/user-guide/ui-snowsight-homepage) with your Snowflake account.
2. In Snowsight, on the navigation menu, click **Admin > Security > Network Rules**.
3. Click **+ Network Rule**.
4. Enter some name for the network rule.
5. For **Type**, select **IPv4**.
6. For **Mode**, select **Ingress**.
7. For **Identifiers**, next to the magnifying glass icon, enter `0.0.0.0/0`, and then press **Enter**.
The `0.0.0.0/0` value allows all IP addresses to access the Snowflake account.
You can specify a more specific IP address range if you prefer. However, this more specific IP address range
will apply to all users, including the user for which you created the PAT.
8. Click **Create Network Rule**.
To create a valid network policy, attaching the preceding network rule to this policy at the same time:
1. Log in to [Snowsight](https://docs.snowflake.com/user-guide/ui-snowsight-homepage) with your Snowflake account.
2. In Snowsight, on the navigation menu, click **Admin > Security > Network Policies**.
3. Click **+ Network Policy**.
4. Enter some name for the network policy.
5. Make sure **Allowed** is selected.
6. In the **Select rule** drop-down list, select the precedingnetwork rule to attach to this network policy.
7. Click **Create Network Policy**.
To activate the network rule in the account:
1. Log in to [Snowsight](https://docs.snowflake.com/user-guide/ui-snowsight-homepage) with your Snowflake account.
2. In Snowsight, on the navigation menu, click **Admin > Security > Network Policies**.
3. Click the name of the precedingnetwork policy to activate.
4. In the policy's side panel, click the ellipsis (three dots) icon, and then click **Activate On Account**.
5. Click **Activate policy**.
* (No longer recommended, as passwords are being deprecated by Snowflake—use PATs instead) The Snowflake [user's login name (not username) and the user's password](https://docs.snowflake.com/user-guide/admin-user-management#creating-users) in the account.
This user must be a human user. Passwords are not supported for service users.
* The name of the Snowflake [role](https://docs.snowflake.com/sql-reference/sql/create-role) that the user belongs to and that also has sufficient access to the Snowflake database, schema, table, and host.
* To create a database in Snowflake, the role needs to be granted `CREATE DATABASE` privilege at the current account level; and `USAGE` privilege on the warehouse that is used to create the database.
* To create a schema in a database in Snowflake, the role needs to be granted `USAGE` privilege on the database and the warehouse that is used to create the schema; and `CREATE SCHEMA` on the database.
* To create a table in a schema in Snowflake, the role needs to be granted `USAGE` privilege on the database and schema and the warehouse that is used to create the table; and `CREATE TABLE` on the schema.
* To write to a table in Snowflake, the role needs to be granted `USAGE` privilege on the database and schema and the warehouse that is used to write to the table; and `INSERT` on the table.
* To read from a table in Snowflake, the role needs to be granted `USAGE` privilege on the database and schema and the warehouse that is used to write to the table; and `SELECT` on the table.
To view a list of available roles in the current Snowflake account:
1. Log in to [Snowsight](https://docs.snowflake.com/user-guide/ui-snowsight-homepage) with your Snowflake account.
2. In Snowsight, on the navigation menu, click **Admin > Users & Roles**.
3. Click the **Roles** tab.
Alternatively, the following Snowflake query returns a list of available roles in the current account:
```text theme={null}
SHOW ROLES;
```
[Grant privileges to a role](https://docs.snowflake.com/sql-reference/sql/grant-privilege). [Learn more](https://docs.snowflake.com/user-guide/security-access-control-privileges).
* The Snowflake warehouse's [hostname and its port number](https://docs.snowflake.com/sql-reference/functions/system_allowlist) in the account.
To view a list of available warehouses in the current Snowflake account:
1. Log in to [Snowsight](https://docs.snowflake.com/user-guide/ui-snowsight-homepage) with your Snowflake account.
2. In Snowsight, on the navigation menu, click **Admin > Warehouses**. This view does not provide access to the warehouses' hostnames or port numbers. To get this information, you must run a Snowflake query.
The following Snowflake query returns a list of available warehouse types, hostnames, and port numbers in the current account. Look for the row with a `type` of `SNOWFLAKE_DEPLOYMENT`:
```text theme={null}
SELECT t.VALUE:type::VARCHAR as type,
t.VALUE:host::VARCHAR as host,
t.VALUE:port as port
FROM TABLE(FLATTEN(input => PARSE_JSON(SYSTEM$ALLOWLIST()))) AS t;
```
* The name of the Snowflake [database](https://docs.snowflake.com/sql-reference/sql/create-database) in the account.
To view a list of available databases in the current Snowflake account:
1. Log in to [Snowsight](https://docs.snowflake.com/user-guide/ui-snowsight-homepage) with your Snowflake account.
2. In Snowsight, on the navigation menu, click **Data > Databases**.
Alternatively, the following Snowflake query returns a list of available databases in the current account:
```text theme={null}
SHOW DATABASES;
```
* The name of the [schema](https://docs.snowflake.com/sql-reference/sql/create-schema) in the database.
To view a list of available schemas for a database in the current Snowflake account:
1. Log in to [Snowsight](https://docs.snowflake.com/user-guide/ui-snowsight-homepage) with your Snowflake account.
2. In Snowsight, on the navigation menu, click **Data > Databases**.
3. Expand the name of the target database.
Alternatively, the following Snowflake query returns a list of available schemas in the current account:
```text theme={null}
SHOW SCHEMAS;
```
The following Snowflake query returns a list of available schemas for the database named `` in the current account:
```text theme={null}
SHOW SCHEMAS IN DATABASE ;
```
* The name of the [table](https://docs.snowflake.com/sql-reference/sql/create-table) in the schema.
To view a list of available tables for a schema in a database in the current Snowflake account:
1. Log in to [Snowsight](https://docs.snowflake.com/user-guide/ui-snowsight-homepage) with your Snowflake account.
2. In Snowsight, on the navigation menu, click **Data > Databases**.
3. Expand the name of the database that contains the target schema.
4. Expand the name of the target schema.
5. Expand **Tables**.
Alternatively, the following Snowflake query returns a list of available tables for the schema named `` in the datbase named
`` in the current account:
```text theme={null}
SHOW TABLES IN SCHEMA .;
```
Snowflake requires the target table to have a defined schema before Unstructured can write to the table. The minimum viable
schema for Unstructured contains only the columns `ID`, `ELEMENT_ID`, and `RECORD_ID`. The columns `TEXT` and `TYPE` are optional, but highly recommended.
If you are generating embeddings, then you must also include the column `EMBEDDINGS`.
In the following `CREATE TABLE` statement, replace the following placeholders with the appropriate values:
* ``: The name of the target database in the Snowflake account.
* ``: The name of the target schema in the database.
* ``: The number of dimensions for any embeddings that you plan to use. This value must match the number of dimensions for any embeddings that are
specified in your related Unstructured workflows or pipelines. If you plan to use Snowflake vector embedding generation or Snowflake vector search,
this value must match the number of dimensions that you plan to have Snowflake generate or search against.
```sql SQL theme={null}
CREATE TABLE ..ELEMENTS (
ID VARCHAR(36) PRIMARY KEY NOT NULL DEFAULT UUID_STRING(),
ELEMENT_ID VARCHAR,
RECORD_ID VARCHAR,
TEXT VARCHAR,
TYPE VARCHAR,
EMBEDDINGS VECTOR(FLOAT, )
);
```
For objects in the `metadata` field that Unstructured produces and that you want to store in a Snowflake table, you must create columns in your table's schema that
follow Unstructured's `metadata` field naming convention. For example, if Unstructured produces a `metadata` field with the following
child objects:
```json theme={null}
"metadata": {
"is_extracted": "true",
"coordinates": {
"points": [
[
134.20055555555555,
241.36027777777795
],
[
134.20055555555555,
420.0269444444447
],
[
529.7005555555555,
420.0269444444447
],
[
529.7005555555555,
241.36027777777795
]
],
"system": "PixelSpace",
"layout_width": 1654,
"layout_height": 2339
},
"filetype": "application/pdf",
"languages": [
"eng"
],
"page_number": 1,
"image_mime_type": "image/jpeg",
"filename": "realestate.pdf",
"data_source": {
"url": "file:///home/etl/node/downloads/00000000-0000-0000-0000-000000000001/7458635f-realestate.pdf",
"record_locator": {
"protocol": "file",
"remote_file_path": "file:///home/etl/node/downloads/00000000-0000-0000-0000-000000000001/7458635f-realestate.pdf"
}
}
}
```
You could create corresponding fields in your table's schema by using the following field names and data types:
```sql theme={null}
-- The ID, RECORD_ID, and ELEMENT_ID columns are required.
-- TEXT and TYPE are not required but highly recommended.
-- EMBEDDINGS is required if embeddings are being generated.
-- All other "metadata" columns are optional.
CREATE TABLE ..ELEMENTS (
ID VARCHAR(36) PRIMARY KEY NOT NULL DEFAULT UUID_STRING(),
RECORD_ID VARCHAR,
ELEMENT_ID VARCHAR,
TEXT VARCHAR,
TYPE VARCHAR,
EMBEDDINGS VECTOR(FLOAT, ),
IS_EXTRACTED VARCHAR,
POINTS VARCHAR,
SYSTEM VARCHAR,
LAYOUT_WIDTH INTEGER,
LAYOUT_HEIGHT INTEGER,
FILETYPE VARCHAR,
LANGUAGES ARRAY,
PAGE_NUMBER VARCHAR,
IMAGE_MIME_TYPE VARCHAR,
FILENAME VARCHAR,
URL VARCHAR,
RECORD_LOCATOR VARCHAR
);
```
Unstructured cannot provide a schema that is guaranteed to work in all
circumstances. This is because these schemas will vary based on your source files' types; how you
want Unstructured to partition, chunk, and generate embeddings; any custom post-processing code that you run; and other factors.
* The name of the column in the table that uniquely identifies each record (for example, `RECORD_ID`).
To create the destination connector:
1. On the sidebar, click **Connectors**.
2. Click **Destinations**.
3. Cick **New** or **Create Connector**.
4. Give the connector some unique **Name**.
5. In the **Provider** area, click **Snowflake**.
6. Click **Continue**.
7. Follow the on-screen instructions to fill in the fields as described later on this page.
8. Click **Save and Test**.
Fill in the following fields:
* **Name** (*required*): A unique name for this connector.
* **Account ID** (*required*): The target Snowflake account's identifier.
* **Role** (*required*): The name of the Snowflake role that the user belongs to. This role must have the appropriate access to the target Snowflake warehouse, database, schema, and table.
* **User** (*required*): The target Snowflake user's login name (not their username).
* **Password** (*required*): The user's programmatic access token (PAT).
Specifying a password is no longer recommended, as passwords are being deprecated by Snowflake. Use a PAT instead.
* **Host** (*required*): The hostname of the target Snowflake warehouse.
* **Port** (*required*): The warehouse's port number. The default is `443` if not otherwise specified.
* **Database** (*required*): The name of the target Snowflake database.
* **Schema** (*required*): The name of the target Snowflake schema within the database.
* **Table** (*required* for source connector only): The name of the target Snowflake table within the database's schema. For the destination connector, the default is `elements` if not otherwise specified.
* **Columns** (source connector only): A comma-separated list of columns to fetch from the table. By default, all columns are fetched unless otherwise specified.
* **ID Column** (*required*, source connector only): The name of the column that uniquely identifies each record in the table.
* **Record ID Key** (destination connector only): The name of the column that uniquely identifies each record in the table. The default is `record_id` if not otherwise specified.
* **Batch Size** (*required*): The maximum number of rows to fetch for each batch. The default is `50` if not otherwise specified.
## Learn more
* [Getting Started with Unstructured and Snowflake](https://unstructured.io/blog/getting-started-with-unstructured-and-snowflake).