Azure Data Engineer

Design and develop ETL processes based on functional and non-functional requirements in Azure platform
• Design and develop migration process from SQL Server to Azure platform
• Understand the full end to end development activities from design to go live for ETL development in Azure platform
• Recommend and execute improvements
• Document component design for developers and for broader communication.
• Understand and adopt an Agile (SCRUM like) software development mindset
• Follow established processes/standards, business technology architecture for development, release management and deployment process
• Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.


Job Requirement for Azure ETL Data Engineer:

Must-have skills
• Undergraduate Degree or Technical Certificate.
• Microsoft Azure certified – Data Engineer
• Working experience (> 3 years) in Azure Data Factory, Azure Databricks, ADLS, Datadog, Azure SQL DB, Azure Synapse
• Hands-on experience in Python / Spark / Pyspark / JSON
• SQL Server (SSIS)
• Working experience with data modeling, relational modeling and dimensional modeling
• General knowledge about file formats (e.g. XML, CSV, JSON), databases (e.g. MS SQL, Oracle) and different type of connectivity is also very useful.
• Data files movement via mailbox
• Source-code versioning/promotion tools, e.g. Git/Jenkins
• Orchestration tools in Azure platform
Nice-to-have skills
• Sqoop / Hadoop / Shell Script
• Java / Scala
• Experience in Agile environment
• Tracking and collaboration tools (e.g. JIRA, Confluence, MS Teams)
Skills:
• Azure Data Factory
• Azure Databricks
• Azure Data Lake
• Data Engineering
• Azure SQL Data Warehouse
• SQL
• PowerShell
• Python
• Pyspark