Data Engineer - GCP
instahyre
Job Description
Requirements:
- Experience: 3+ years in Data Engineering, with at least 3+ years specifically leading GCP-based projects.
- Migration Track Record: Proven experience moving large-scale production datasets across environments.
- Leadership: Experience mentoring junior engineers and leading technical sprints.
- Communication: Ability to explain complex technical trade-offs to non-technical stakeholders.
- Problem-Solving: A proactive approach to identifying bottlenecks in the data lifecycle.
- Must have worked with US/Europe-based clients in an onsite/offshore delivery model.
Required Technical Skills:
- Cloud Platform: Expert-level proficiency in Google Cloud Platform (GCP).
- Data Warehousing: Advanced BigQuery (SQL, optimization, and administration).
- Orchestration: Hands-on experience with Cloud Composer (Apache Airflow).
- ETL/ELT Tools: Proficiency in Dataform and Cloud Data Fusion.
- Languages: Expert in SQL (complex joins, CTEs, window functions). Fair to solid proficiency in Python for scripting and Airflow DAGs.
- Security and Ops: Deep understanding of IAM, Service Accounts, and Secret Manager.
- Networking: Fair understanding of GCP Networking (VPC, Cloud SQL Auth Proxy, etc. ).