Overview

The Unstructured Platform offers multiple source connectors to connect to your data in its existing location.

Routing determines which strategy Unstructured Platform uses to transforming your documents into Unstructured’s canonical JSON schema. The Unstructured Platform provides these partitioning strategies for document transformation:

• Basic / Fast is ideal for simple, text-only documents.

• Advanced / High Res is best for PDFs, images, and complex file types.

  During Advanced / High Res processing, any detected text-based files are processed and billed at the Basic / Fast rate instead.

• Platinum / VLM is for challenging documents, including scanned and handwritten content.

  During Platinum / VLM processing, any detected files that are not PDFs or images are processed and billed at either the Advanced / High Res or Basic / Fast rate instead. Of those non-PDF and non-image files, all text-based files are processed and billed at the Basic / Fast rate instead. The other files are processed and billed at the Advanced / High Res rate instead.

Your source document is transformed into Unstructured’s canonical JSON schema. Regardless of the input document, this JSON schema gives you a standardized output. It contains more than 20 elements, such as Header, Footer, Title, NarrativeText, Table, Image, and many more. Each document is wrapped in extensive metadata so you can understand languages, file types, sources, hierarchies, and much more.

The Unstructured Platform provides these chunking strategies:

• Basic combines sequential elements up to specified size limits. Oversized elements are split, while tables are isolated and divided if necessary. Overlap between chunks is optional.
• By Title uses semantic chunking, understands the layout of the document, and makes intelligent splits.
• By Page attempts to preserve page boundaries when determining the chunks’ contents.
• By Similarity uses an embedding model to identify topically similar sequential elements and combines them into chunks.

Images and tables can be optionally summarized. This generates enriched content around the images or tables that were parsed during the transformation process.

The Unstructured Platform uses optional third-party embedding providers such as OpenAI.

The Unstructured Platform offers multiple destination connectors, including all major vector databases.

Source connectors to ingest your data into the Unstructured Platform for transformation.

Destination connectors tell the Unstructured Platform where to write your transformed data to.

Workflows connect sources to destinations and provide chunking, embedding, and scheduling options.

Jobs enable you to monitor data transformation progress.