Optimizing data pipeline using Big Data analytics techniques
Engagement details - A product that uses data transformation and data processing activities to produce results can be hard to manage. The time consumed to process data in a sequential manner using a traditional framework consisting of MySQL could be a problem that increased the time to process data and produce results.
Technologies – Big Data
Tools and platforms – Apache Kafka, Spark, HBase, MySQL,
Benefits -
- Faster delivery with the ability of parallel data processing
- Performance optimization with the gilt-edge utilization of the computing power/resources