Summarizing
After partitioning and chunking, summarizing generates text-based summaries of images and tables. This summarization is done by using models offered through these providers:
- GPT-4o, provided through OpenAI.
- Claude 3.5 Sonnet, provided through Anthropic.
- Claude 3.5 Sonnet, provided through Amazon Bedrock.
Here is an example of the output of image summarization using GPT-4o. Note specifically the text
field that is added.
Line breaks have been inserted here for readability. The output will not contain these line breaks.
Here is an example of the output of table summarization using GPT-4o. Note specifically the text
field that is added.
Line breaks have been inserted here for readability. The output will not contain these line breaks.
Summarize images or tables
To summarize images or tables, in the Task drop-down list of an Enrichment node in a workflow, specify the following:
Image summary descriptions, table summary descriptions, and table-to-HTML output is generated only when the Partitioner node in a workflow is set to use the High Res partitioning strategy and the workflow also contains an image description, table description, or table-to-HTML enrichment node.
Setting the Partitioner node to use Auto, VLM, or Fast in a workflow that also contains an image description, table description, or table-to-HTML enrichment node will not generate any image summary descriptions, table summary descriptions, or table-to-HTML output, and it could also cause the workflow to stop running or produce unexpected results.
For image summarization, select Image Description, and then choose one of the following provider (and model) combinations to use:
- OpenAI (GPT-4o). Learn more.
- Anthropic (Claude 3.5 Sonnet). Learn more.
- Amazon Bedrock (Claude 3.5 Sonnet). Learn more.
For table summarization, select Table Description, and then choose one of the following provider (and model) combinations to use:
- OpenAI (GPT-4o). Learn more.
- Anthropic (Claude 3.5 Sonnet). Learn more.
- Amazon Bedrock (Claude 3.5 Sonnet). Learn more.