Skip to main content
The following information applies only to Unstructured Pay-As-You-Go and Business SaaS accounts. Multimedia is not available for Let’s Go accounts, or for dedicated instance or in-VPC deployments.
Type: partition Subtype: multimedia The Multimedia strategy turns audio into timestamped transcript fragments and video into scene descriptions. It can also transcribe a video’s soundtrack. For output, formats, limits, and usage, see Process audio and video files with Multimedia.

Usage guidance

Use the Multimedia strategy for workflows whose source contains only audio and video files. Other strategies, including Auto, do not process media. Place the Multimedia node directly after the source, and follow it with an Embedder node rather than a Chunker node. The workflow designer saves a Multimedia node with Unstructured transcription and the default vision model. The following settings are available only through the Pipelines API.

Settings

string
required
The transcription provider. Allowed values: parakeet, openai. Use parakeet for Unstructured transcription with speaker labels. The workflow designer uses parakeet.
string
required
The transcription model. With parakeet, use nvidia/parakeet-tdt-0.6b-v3. With openai, use a transcription model listed in Available models.
string
An optional two-letter ISO 639-1 code for the spoken language, such as en. The value labels the output and does not translate the transcript. Unstructured rejects any value that is not a two-letter ISO 639-1 code. If unset, the output language is und.
number
The length of each audio window, in seconds. Allowed range: 300 to 900. Default: 300. With parakeet, Unstructured accepts only 300. With openai, Unstructured accepts values up to 744.
number
The length of each video window, in seconds. Longer windows produce fewer, broader scene descriptions. Allowed range: 300 to 900. Default: 300.
boolean
True to also transcribe a video’s soundtrack and interleave transcript fragments with scene descriptions. False to return scene descriptions only. Default: false. A video bills both audio and video minutes when this is true.
boolean
True or unset to describe video scenes. False to skip scene descriptions for video.
string
The provider of the vision model that describes video scenes. Allowed values: anthropic, bedrock, openai, vertexai. Set it together with video_vlm_model, or leave both unset to use the default vision model.
string
The vision model that describes video scenes. Use a model listed for the provider under Partitioner (VLM and Auto). Set it together with video_vlm_provider.
Unstructured rejects invalid settings when you save the workflow. The 422 response names the node and the field, for example "json_path": "$.language".

Create a Multimedia workflow

The following request creates a workflow that partitions audio and video from a source connector, embeds the elements, and writes them to a destination connector. Replace the source and destination IDs, and choose an embedding model from Available models.
To process local files without a source connector, run an on-demand job and pass the same nodes as job_nodes in request_data. See Create job.