Senior Data Engineer
pgcareers
Job Description
- Lead application engineering across the full lifecycle, including solution design, development, deployment, upgrades, and continuous improvement.
- Design end-to-end technical solutions that are scalable, secure, and aligned with platform and business standards.
- Act as a hands-on technical lead by writing, reviewing, and testing code, while building cloud-native Data & Analytics solutions on Azure.
- Ensure architecture and development follow modern engineering practices and standards, including CI/CD, Agile, DevOps, automation, and code quality.
- Collaborate with architects, product teams, business stakeholders, and vendors to translate requirements into effective technical solutions.
- Drive resolution of complex technical, performance, and integration issues to ensure reliable and efficient delivery.
- Mentor team members and contribute to the overall engineering roadmap, platform evolution, and technical excellence of the team.
Ideal Candidate:
- Strong technical leader who can independently design end-to-end solutions while remaining hands-on in development and problem-solving.
- Self-motivated and collaborative, with the ability to work effectively across global teams, align with stakeholders, and translate business needs into scalable technical solutions.
- Detail-oriented and analytical, with strong problem-solving skills and a passion for modern engineering practices, continuous improvement, and delivering high-quality results
Job Qualifications
- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related technical field, or equivalent practical experience.
- 10+ years of experience in data engineering, with strong hands-on expertise in building and delivering Big Data solutions using Spark and Databricks.
- Proven experience designing and developing end-to-end data solutions, including architecture, coding, testing, deployment, and production support.
- Strong knowledge of modern data platform concepts and architectures, including Data Warehousing, Lakehouse, Data Mesh, and Data Quality.
- Strong programming skills in Python (PySpark) and SQL.
- Experience with orchestration and cloud data integration tools such as Airflow and Azure Data Factory.
- Hands-on experience with CI/CD pipelines, unit testing, API integrations, and modern software engineering practices across Agile and DevOps environments.
- Ability to lead technical design discussions, drive solution decisions, and work as a hands-on technical lead within cross-functional and global teams.
- Strong verbal, written, and interpersonal communication skills, with the ability to collaborate effectively with technical and business stakeholders.
- Strong commitment to engineering excellence and delivering high-quality software through code reviews, testing, automation, and continuous improvement.