Google Cloud DataFlow Previewed at Google I/O
I had another post in mind for this recent week, got a bit busy, and then Google previews a new big data processing service that’s native and only available in the cloud.
This has the potential to be huge, literally. I am also presuming that you need large physical connections to get your live stream of data into it at a good pace to take real advantage. I think you’ll also need to be dealing with huge volume data streams.
Ingesting, cleansing and transforming huge volumes of data, in real time for real time analysis makes for interesting possibilities. Now I want to go look for some use scenarios that are applicable for the less than super massive data generating companies. I am thinking it could be an interesting platform for health and government data. I also wonder how it can be used in conjunction with some heavy engineering analysis.
I’d love to hear your thoughts. Meanwhile, here’s where I read about it:
http://techcrunch.com/2014/06/25/google-launches-cloud-dataflow-a-managed-data-processing-service/