Senior Data Engineer
okta
Job Description
-
Design and Develop Scalable Platforms: Build and maintain scalable data platforms using AWS, Snowflake, dbt, and Databricks.
-
Infrastructure as Code: Utilize Terraform to manage infrastructure as code, ensuring consistent and reproducible environments.
-
CI/CD Management: Develop and maintain CI/CD pipelines for data platform applications using GitHub and GitLab.
-
AI/ML Infrastructure: Engineer robust data pipelines that fuel high-performance AI and ML models by delivering reliable, feature-rich datasets.
-
Data Governance & Strategy: Implement comprehensive data governance frameworks to ensure data lineage, compliance, and quality across all analytical platforms.
-
Security & Compliance: Conduct vulnerability scans, apply necessary patches, and ensure data security meets industry standards.
-
Innovation: Explore cutting-edge tools like "data engineer agents" to automate routine tasks and free up time for high-leverage, custom pipelines.
-
Cross-Functional Collaboration: Partner with product managers, UX designers, and other developers to deliver end-to-end solutions.
-