How It Works:
GstExtractor receives an extended video frame containing both image data and an embedded data region. The plugin separates the metadata from the actual video frame and exposes the information through independent outputs.
The resulting video frame can continue through the GStreamer pipeline normally, while extracted information can be processed as KLV metadata, H.264/H.265 SEI metadata, or application-readable data.
The separation is designed to avoid unnecessary video-frame copies, helping minimize additional processing overhead.
Key Features:
- Custom Metadata Parsing: Implement application-specific parsers for proprietary embedded data formats.
- Video and Metadata Separation: Separates the embedded data region from the original video frame for independent processing.
- KLV Metadata Output: Extract and send embedded information downstream as KLV metadata.
- SEI Metadata Integration: Combine GstExtractor with GstSEIMetadata to associate extracted information with H.264 or H.265 video streams.
- Application-Readable Data: Expose selected embedded values as GstExtractor properties that can be accessed by the controlling application.
- GStreamer Integration: Handles pads, buffer creation, caps negotiation, and other GStreamer functionality internally.
- Flexible Frame Handling: Custom parsing logic can determine whether to pass the original frame, replace it with a predefined frame, or drop it based on embedded information.
GstSEIMetadata Integration:
The included GstSEIMetadata plugin enables metadata to be inserted into or extracted from H.264 and H.265 encoded streams using SEI NAL units.
This allows metadata to remain synchronized with the corresponding video frames while the video is streamed or recorded, without affecting standard decoders that do not process the additional SEI information.
Example Use Case:
A camera sensor produces video frames containing an additional metadata region with information such as sensor measurements, timestamps, telemetry, or device status.
GstExtractor separates this information from the visible frame and parses the required values. The video can then continue through the normal processing pipeline while the extracted metadata is sent independently as KLV or embedded into an H.264/H.265 stream using GstSEIMetadata.
Perfect For:
- Embedded camera systems
- UAV and drone video
- Sensor metadata extraction
- Defense and aerospace video systems
- Industrial imaging
- Video analytics and telemetry
- Applications combining video and synchronized metadata
What’s Included:
- GstExtractor source code
- GstSEIMetadata
- Support for custom embedded-data parsers
- GStreamer integration
- Example pipelines and technical documentation
Developer Resources:
Learn more about configuration, custom parsers, properties, pipelines, and integration on our Developer Wiki:
GstExtractor – RidgeRun Developer Wiki
Monthly Subscription
Hire RidgeRun at a flat monthly rate for a maximum of 8 hours per day, 40 hours per week each month. Get fast interaction with engineers working on your project, weekly 45 minute calls to update you on our progress, and the complete engagement and expertise of our engineering team.
Work With UsFAQs
GstExtractor is a GStreamer plugin that separates custom data embedded at the end of an extended video frame from the visible video content.
It is a video frame that includes an additional data region after the normal image area. GstExtractor separates this region before sending the video to downstream processing elements.
GstExtractor handles GStreamer pads, buffer creation, capability negotiation, video and metadata separation, and downstream output. Developers only need to implement the application-specific parser.