Year: 2025
Type: article
Abstract: Real-time data processing comes with its own set of challenges, including message delivery guarantee, latency, throughput, and fault tolerance.One way to get around these challenges is by using the right systems to build real-time data processing pipelines.Google Cloud's Pub/Sub and Dataflow services are strong contenders for their individual and collective strengths.Pub/Sub facilitates de-coupled, asynchronous data transmission that's capable of handling massive throughput.Dataflow offers complex data processing capabilities in real-time and, as a managed service, makes the process of building and managing data pipelines highly efficient.Building dataprocessing pipelines using these services allows businesses to get around the common challenges.
Authors: Amanpreet Singh, Bhuwan Bora, Ayush Pandey, Jatin ., Himanshu .
Institution: Lovely Professional University
Language: English
Subfield: Information Systems
Field: Computer Science
Domain: Physical Sciences
Open Access status: diamond
OpenAlex ID: W4409824537