Data Engineer I A - GBS IND

Responsibilities*

• Participate actively in development/maintenance activities.
• Ensure stability, performance, and reliability of big data systems.
• Monitor and manage daily batch processes across the Hadoop ecosystem.
• Collaborate with CIO leads to deliver development tasks and technical solutions.
• Participate in code reviews, testing, and deployment activities.
• Support during upgrades and new functionality implementations.
• Facilitate brainstorming meetings with team to review, analyses, query optimization, conduct Root Cause Analysis & troubleshoot multiple and complex issues , assess business systems and implement changes as needed
• Develop complex technical objects in accordance with the technical development standards and best practices Troubleshoot, prioritize, resolve, and escalate production issues
• Participate in continuous process improvement.
• Proactively monitor Hadoop maintenance tasks, troubleshoot failed processes, and address issues as soon as possible.
• Monitor system's health and performance.
• Ensure high levels of performance, availability, sustainability, and security.
• Refine and automate regular processes, track issues, and document changes.
• Assist developers with query tuning, schema refinement, query improvement and optimization.
• Understand Agile methodologies and work independently in sprints
• Maintain technical documentation and ensure compliance with data governance standards.

Skills Required:

• Hands-on experience in software development using Graph DB (TigerGraph/Neo4j)
• DBA experience with any NoSQL database like MongoDB
• Good understanding of data architecture and Big Data platform
• Collaborate with product teams, data analysts and data scientists to design and build data-forward solutions
• Accountable for the availability, stability, scalability, security, and recoverability enabled by the design
• Ability to clearly communicate with team & stakeholders
• Hands on experience in coding for the following GraphDB & Hadoop Eco System:
• Tiger Graph or Neo4J or any NoSQL DB
• Java or Python
• Spark/Scala
• Spark-SQL
• Py-Spark
• HIVE
• Impala
• Scala
• Autosys
• Shell Scripting

Desired skills

•             Experience building E2E analytics platform using Graph DB (Neo4j, Tiger Graph) and Big Data platform.

•             Hands on experience on implementing CI/CD and automation using the Atlassian ecosystem.

•             Hands on experience in designing, developing, and maintaining software frameworks using Tiger Graph / Neo4J

•             Experience with graph-based data workflows and working with graph analytics.

•             Good Knowledge of metadata management, data lineage, and principles of data governance