Data Engineer
oraclecloud
Job Description
Key Responsibilities
- Design, build, and maintain scalable, modular dbt models and transformation pipelines using DBT Core.
- Understand DBT Architecture thoroughly and experience in writing Python operators in DBT flow. Strong experience in writing Jinja code, macros, seeds etc.
- Design and develop data warehouses using Snowflake.
- Build and maintain ETL/ELT pipelines to load data from multiple sources.
- Optimize Snowflake performance (Clustering, Warehouses, Query tuning).
- Implement data security (roles, access control, masking)
- Knowledge of data modeling techniques like data vault and dimensional modeling (Kimball/Inmon).
- Automate workflows using data orchestration tools (Apache Airflow or Snowflake Tasks)
- Collaborate with full-stack developers and UI/UX engineers to support application features that rely on transformed datasets.
- Work closely with analysts and stakeholders to gather data requirements and translate them into reliable data models.
- Enforce data quality through rigorous testing, documentation, and version control in dbt.
- Participate in Agile ceremonies (e.g., stand-ups, sprint planning) and manage tasks using Jira.
- Integrate dbt into CI/CD pipelines and support automated deployment practices.
- Monitor data performance and pipeline reliability, and proactively resolve issues.
Mandatory Qualifications & Skills
- 6-11 years of experience in data engineering or analytics engineering, with a focus on SQL-based data transformation.
- Hands-on production experience using dbt core or dbt cloud as a primary development tool.
- Strong command of SQL and solid understanding of data modeling best practices (e.g., star/snowflake schema).
- Proven experience with Snowflake as a cloud data warehouse.
- Python skills for data pipeline integration or ingestion.
- Familiarity with Git-based version control workflows.
- Strong communication and collaboration skills, with the ability to work across engineering and business teams.
- Experience working in Agile/Scrum environments and managing work using Jira.