Data Engineer II

 Develop high quality, secure and scalable data pipelines using spark, Scala/ python on Hadoop or object storage.
• Leverage new technologies and approaches to innovate with increasingly large data sets.
• Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration.
• Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.
• Perform assigned tasks and support production incidents.


All About You
• 3-5 years of overall career experience in Data Warehouse related projects in product or service-based organization
• Expertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment
• Experience of building data pipelines through Spark with Scala/Python/Java on Hadoop or Object storage
• Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge
• Experience of working on Nifi will be an added advantage
• Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan
• Strong communication skills - both verbal and written
• Ability to be high-energy, detail-oriented, proactive and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results
• Flexibility to work as a member of a matrix based diverse and geographically distributed project teams