High-Throughput Multi-SKU Media Catalog Processing: An Open Ingestion Pipeline and Concurrent Benchmark Dataset
Year: 2026
Type: article
Abstract: Omnichannel digital commerce feeds require synchronizing high-resolution imagery across heterogeneous marketplace APIs (Shopify, Amazon, Walmart, Google Merchant Center). Managing catalog migrations exceeding 5,000 SKUs frequently collapses under serial upload bottlenecks and non-standardized manifest formats. This specification introduces a concurrent multipart chunk streaming architecture over HTTP/2, evaluating throughput benchmarks across 10,000 multi-resolution inventory assets. The open benchmark dataset, reference ingestion tooling, and automated manifest generator are accessible at https://imagetourlkit.com/bulk-images-to-url.
Language: English
Topic: Mobile and Web Applications
Subfield: Information Systems
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7225780163
FWCI:
Cites:
Cited by:
Related to: