Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.unstructured.io/llms.txt

Use this file to discover all available pages before exploring further.

First time creating a connector? Read this first.
Send processed data from Unstructured to MotherDuck. The requirements are as follows.
  • A MotherDuck account.
  • A MotherDuck access token for the account.
  • A database in the account. You can run commands to manage MotherDuck databases, schemas, tables, and more in the MotherDuck UI or for example by connecting to MotherDuck with the DuckDB CLI.
  • A schema in the target database.
    • Create a schema.
    • You can list available schemas and their parent catalogs by running the following command in the MotherDuck UI or the DuckDB CLI: 
      SELECT * FROM information_schema.schemata;
    The MotherDuck connector uses the default schema name of main if not otherwise specified.
  • A table in the target schema.
    • Create a table.
    • You can list available tables in a schema by running the following commands in the MotherDuck UI or the DuckDB CLI, replacing the target catalog and schema names: 
      USE <catalog_name>.<schema_name>;
SHOW TABLES;
    The MotherDuck connector uses the default table name of elements if not otherwise specified. For maximum compatibility, Unstructured recommends the following table schema: 
    CREATE TABLE elements (
    id VARCHAR,
    element_id VARCHAR,
    text TEXT,
    embeddings FLOAT[],
    type VARCHAR,
    system VARCHAR,
    layout_width DECIMAL,
    layout_height DECIMAL,
    points TEXT,
    url TEXT,
    version VARCHAR,
    date_created INTEGER,
    date_modified INTEGER,
    date_processed DOUBLE,
    permissions_data TEXT,
    record_locator TEXT,
    category_depth INTEGER,
    parent_id VARCHAR,
    attached_filename VARCHAR,
    filetype VARCHAR,
    last_modified TIMESTAMP,
    file_directory VARCHAR,
    filename VARCHAR,
    languages VARCHAR[],
    page_number VARCHAR,
    links TEXT,
    page_name VARCHAR,
    link_urls VARCHAR[],
    link_texts VARCHAR[],
    sent_from VARCHAR[],
    sent_to VARCHAR[],
    subject VARCHAR,
    section VARCHAR,
    header_footer_type VARCHAR,
    emphasized_text_contents VARCHAR[],
    emphasized_text_tags VARCHAR[],
    text_as_html TEXT,
    regex_metadata TEXT,
    detection_class_prob DECIMAL,
    partitioner_type VARCHAR
);
    You can list the schema of a table by running the following commands in the MotherDuck UI or the DuckDB CLI, replacing the target catalog, schema, and table names: 
    USE <catalog_name>.<schema_name>;
DESCRIBE TABLE <table_name>;
To create the destination connector:
  1. On the sidebar, click Connectors.
  2. Click Destinations.
  3. Cick New or Create Connector.
  4. Give the connector some unique Name.
  5. In the Provider area, click MotherDuck.
  6. Click Continue.
  7. Follow the on-screen instructions to fill in the fields as described later on this page.
  8. Click Save and Test.
Fill in the following fields:
  • Name (required): A unique name for this connector.
  • Database (required): The name of the target MotherDuck database.
  • Schema (required): The name of the target schema within the database.
  • Table: The name of the target table within the schema. By default, this table is named elements if not otherwise specified.
  • MotherDuck Token (required): The access token value within the MotherDuck account that has the appropriate access to the target database, schema, and table.

​
Learn more