Assistant Manager - Data Engineer

Key Responsibilities 

• Understand, implement, and automate ETL pipelines following industry best practices. 
• Identify, design, and implement internal automation solutions to streamline manual processes. 
• Develop, integrate, test, and maintain new and existing applications. 
• Design and create data pipelines for data lakes and data warehouses. 
• Use expert-level Python proficiency for scripting and automation. 
• Work with distributed computing frameworks: Spark, Spark-SQL, Kafka, Hive, Azure Databricks. 
• Hands-on with Azure Data Factory, Logic Apps, Analysis Services, Blob Storage, etc. 
  • Work collaboratively within an Agile environment using JIRA and Git.