Google Cloud Dataflow
Unified stream and batch data processing that's serverless, fast, and cost-effective. Benefits Streaming data analytics with speed Dataflow enables fast, simplified streaming data pipeline development with lower data latency. Simplify operations and management Allow teams to focus on programming instead of managing server clusters as Dataflow’s serverless approach removes operational overhead from data engineering workloads. Reduce total cost of ownership Resource autoscaling paired with cost-optimized batch processing capabilities means Dataflow offers virtually limitless capacity to manage your seasonal and spiky workloads without overspending. Key Features Streaming Engine Streaming Engine separates compute from state storage and moves parts of pipeline execution out of the worker VMs and into the Dataflow service back end, significantly improving autoscaling and data latency. Autoscaling Autoscaling lets the Dataflow service automatically choose the appropriate number o...