Data Engineer
oraclecloud
Job Description
- Build, maintain, and improve ingestion pipelines, notebooks, and data assets on Azure and Databricks using Delta Lake and PySpark, supporting reliable data delivery across the platform.
- Develop and optimize SQL and Python solutions that improve pipeline performance, data quality, and platform stability.
- Partner with architects, leads, product owners, and engineering peers to understand requirements, troubleshoot issues, and deliver practical data solutions.
- Provide specialist platform support to the operations team by diagnosing pipeline and platform issues, sharing deep technical knowledge, and guiding effective resolutions.
- Contribute to Power BI reporting and analytics enablement, turning curated platform data into useful insights for stakeholders.
- Use CI/CD practices in Azure DevOps to test, deploy, and maintain platform changes safely and efficiently.
- Help evaluate and apply new platform capabilities in partnership with internal architects and external specialists, turning emerging features into reliable engineering patterns for the team.
- Apply AI-assisted tools daily for research, design, coding, testing, and documentation, using them to move faster while maintaining engineering quality.
What success looks like in your first year
- You are confident and effective working across the EDP platform stack and team ways of working.
- You are a trusted specialist partner to the operations team, helping them resolve platform and pipeline challenges with clear technical guidance.
- You are delivering ingestion pipelines, notebooks, and analytics-ready outputs that meet team and stakeholder needs.
- You are contributing to platform optimization and evolution, including practical use of newer platform capabilities and patterns shaped with architects and external partners.