Cloud Data Engineer

Your key responsibilities:

• Define and document standards for Data Architecture, Data Models, Data Products and Data Catalogs.   

• Define data governance processes to ensure that data is reliable, accurate and well-managed; Create data security and privacy policies and procedures.

• Create and maintain data architecture models and documents for Azure data services.

• Design, configure, and implement our Azure Data Lake Storage (ADLS) to store, process, and analyze large-scale data sets.

• Develop and implement ETL processes using Azure Data Factory (ADF) for data integration between systems and Databricks for data manipulation and cataloguing.

• Design and implement CI/CD processes for Azure data services using Azure DevOps.

• Provide technical guidance and training to other team members on Azure data services.

• Collaborate with Azure Solution Architects, Data Scientists, and Business Analysts to design, develop, and deploy data solutions that meet business needs.

• Ensure that Azure data services adhere to established security and compliance standards.

• Continuously assess and evaluate new technologies and techniques to improve Azure data services and architecture.

Qualifications:

• Bachelor's degree in Computer Science, Information Systems, or related field.

• 4+ years of experience in data engineering or related field.

• Strong SQL and Python skills.

• Deep knowledge of Azure data services such as Azure Data Lake, Azure Data Factory, Databricks and related CI/CD tools.

• Proficiency in data modeling, data warehousing, ETL processes, and data analytics.

• Strong problem-solving and troubleshooting skills.

• Excellent communication and collaboration skills.

• Ability to lead and mentor other team members.