GCP Pub/Sub + Dataflow
Event streaming with Pub/Sub, Dataflow, BigQuery and a serving cache.
Rendering…
Make it your own.
flowchart LR
Pub[Producers] --> Topic[(Pub/Sub topic)]
Topic --> Sub1[(Subscription A)]
Topic --> Sub2[(Subscription B)]
Sub1 --> DF[Dataflow streaming job]
DF --> BQ[(BigQuery)]
DF --> GCS[(GCS — archive)]
Sub2 --> CR[Cloud Run service]
CR --> Mem[(Memorystore Redis)]
BQ --> Looker[Looker dashboards]