AWS Snowflake

Data Pipeline Engineering: Lead the design and implementation of reliable, metadata-driven ETL/ELT pipelines using dbt, Snowflake, and Python. AWS Integration: Architect seamless data ingestion flows from diverse sources (APIs, RDBMS, SaaS) into Snowflake using AWS services such as S3, Lambda, and Kinesis/MSK. Advanced Data Modeling: Design and optimize Star and Snowflake schemas, ensuring that data structures are high-performing, scalable, and optimized for analytical consumption. Performance Engineering: Manage Snowflake compute resources (Virtual Warehouses), optimize micro-partitioning, and tune complex SQL queries to ensure maximum cost-efficiency and speed. Automation & CI/CD: Drive engineering excellence by implementing version control (Git), automated testing via dbt, and continuous integration/deployment (CI/CD) workflows. Orchestration: Develop and maintain sophisticated job schedules and dependencies using tools such as Airflow, Dagster, or Prefect. Data Governance & Quality: Implement automated data validation, monitoring, and alerting to ensure data integrity and compliance with enterprise standards (GDPR/HIPAA). Cross-functional Collaboration: Partner with Data Scientists and Business Stakeholders to translate complex requirements into technical data products and comprehensive documentation.