Data Engineer
ey
Job Description
- Responsible for the development, daily operation, and continuous improvement of data infrastructure for a set of analytics products, including ingestion, transformation, quality, and access.
- Co‑develop, test, and maintain Azure Data Factory pipelines to ingest, transform, and orchestrate data from multiple internal and external sources, supporting batch and near‑real‑time processing.
- Create relational and non‑relational databases, including Azure SQL Database and/or Azure Synapse SQL, and contribute to Azure data warehouse and data lake solutions.
- Write and optimize SQL queries and transformations, including stored procedures where appropriate, to support analytics products and downstream insight consumption.
- Assist in automating and scaling data flows using Git‑based workflows and deployment pipelines (e.g., Azure DevOps or GitHub), improving reliability, reuse, and performance.
- Perform daily monitoring of data pipelines and data quality, including validation checks, issue triage, and resolution.
- Maintain data documentation, metadata, and basic lineage tracking.
- Work with analysts and business stakeholders to help define technical requirements for new products.
- Follow established data security, privacy, and governance standards.
- Continue learning modern data engineering tools, platforms, and best practices.