Data Platform Engineer (Azure)
pgcareers
Job Description
Key Responsibilities
- Working with the customers of the platform to identify emerging needs in the platform offering together with platform Product Owner.
- Infrastructure Provisioning and Management: Deploying and managing infrastructure resources on Azure.
- Continuous Integration and Deployment (CI/CD): Implementing and maintaining CI/CD pipelines to automate build, test, and deployment processes.
- Monitoring and Logging: Setting up supervising and logging solutions to ensure the availability, performance, and security of the platform.
- Security and Compliance: Implementing security measures and best practices to protect the platform and its data.
- Teamwork and Communication: Collaborating with multi-functional teams as well as effective communication and documentation of processes, procedures, and configurations are essential.
- Solving and Support: Identifying and resolving issues related to infrastructure, deployments, and platform performance.
- Automation and Optimization: Continuously finding opportunities to automate manual tasks, improve operational efficiency, and optimize resource utilization.
- Learning and Growth: Staying updated with the latest Azure services, DevOps practices, and industry trends. Actively participating in training programs, certifications, and knowledge-sharing initiatives to improve skills and supply to the team's growth.
Job Qualifications
- Understanding of Cloud infrastructure (with focus on Databricks)
- Practical knowledge of Data Engineering and DevOps toolset:
- Over 3 years of experience working with Databricks.
- Over 3 years of experience working with Azure (configuring resources, basic understanding of networking and permissions model)
- Over 3 years of experience using DevOps tools - (GitHub Repos, GitHub Actions, Azure DevOps Pipelines, SonarQube, Snyk etc.)
- Nice to have - Infrastructure as a Code (Terraform)
- Good interpersonal skills
- Bachelor's degree or equivalent experience