Melbourne Java & JVM Users Group: Rahul Gupta on “Fast Data Analytics in Two Simple Steps”
February 6, 2019 @ 6:15pm-8:30pm ()
- Aconex, 96 Flinders St, Melbourne VIC 3000, Australia
Topic: Fast Data Analytics in Two Simple Steps
Speaker: Rahul Gupta – Senior Solution Architect
“Big data is good, but the economics of storing large volumes push this towards slow storage. That’s a bad place to analyse the data due to the disk speed.
So what we’ll do is take an input data stream of fast data passing through the Jet analytics in memory, to update IMDG data storage in memory. With nothing touching the disk, performance is super fast. What comes in as a stream of data is processed in-flight, stored to memory containers, and saved down to (write-only) disk for posterity.
You will also learn all about directed acyclic graph (DAG) and why it is so powerful for Big Data processing. I’ll walk you through the evolution of Big Data computing from sequential to DAG as well as other techniques such as SP/SC, Cooperative Multithreading, Data Locality and In-Memory sources and sinks that power the third generation of Big Data processing.”