Data Engineer

oraclecloud

Bengaluru NM Years Exp Posted 1h ago

Job Description

  • Build, maintain, and improve ingestion pipelines, notebooks, and data assets on Azure and Databricks using Delta Lake and PySpark, supporting reliable data delivery across the platform.
  • Develop and optimize SQL and Python solutions that improve pipeline performance, data quality, and platform stability.
  • Partner with architects, leads, product owners, and engineering peers to understand requirements, troubleshoot issues, and deliver practical data solutions.
  • Provide specialist platform support to the operations team by diagnosing pipeline and platform issues, sharing deep technical knowledge, and guiding effective resolutions.
  • Contribute to Power BI reporting and analytics enablement, turning curated platform data into useful insights for stakeholders.
  • Use CI/CD practices in Azure DevOps to test, deploy, and maintain platform changes safely and efficiently.
  • Help evaluate and apply new platform capabilities in partnership with internal architects and external specialists, turning emerging features into reliable engineering patterns for the team.
  • Apply AI-assisted tools daily for research, design, coding, testing, and documentation, using them to move faster while maintaining engineering quality.

What success looks like in your first year

  • You are confident and effective working across the EDP platform stack and team ways of working.
  • You are a trusted specialist partner to the operations team, helping them resolve platform and pipeline challenges with clear technical guidance.
  • You are delivering ingestion pipelines, notebooks, and analytics-ready outputs that meet team and stakeholder needs.
    • You are contributing to platform optimization and evolution, including practical use of newer platform capabilities and patterns shaped with architects and external partners.

Similar Openings for You