Junior Data Engineer
advanceautoparts
Job Description
- Help in the migration and modernization of data platforms, moving applications and pipelines to Google Cloud-based solutions.
- Ensure data security and governance, enforcing compliance with industry standards and regulations.
- Help in managing and scale data pipelines from internal and external data sources to support new product launches and ensure high data quality.
- Help in developing automation and monitoring frameworks to capture key metrics and operational KPIs for pipeline performance.
- Collaborate with internal teams, including data science and product teams, to drive solutioning and proof-of-concept (PoC) discussions.
- Help in developing and optimizing procedures to transition data into production.
- Create and maintain technical documentation for sharing knowledge.
- Help in developing reusable packages and libraries to enhance development efficiency.
- Help in developing real-time and batch data processing solutions, integrating structured and unstructured data sources.