Senior Data Engineer - GCP

equinix

Bengaluru (Bangalore) 5 Years Exp Posted 45d ago

Job Description

  • Participate in design and implementation of enterprise-scale data pipelines and platform architecture for End-to-End data products.

  • Develop fault-tolerant data processing systems using advanced GCP services

  • Evaluate and recommend new technologies, tools, and architectural approaches

  • Build complex ETL/ELT workflows using Cloud Dataflow, Composer, Dataform/dbt, BigQuery and custom solutions

  • Implement sophisticated real-time streaming architectures with Cloud Pub/Sub, Kafka and Apache Beam

  • Design and optimize data processing workflows for performance, cost, and reliability

  • Develop advanced data transformation logic and custom processing functions

  • Implement data architectures and microservices-based data platforms

  • Design multi-environment deployment strategies and automated scaling solutions

  • Establish monitoring, alerting, and observability frameworks across the data platform

  • Lead code reviews and establish quality assurance processes

  • Provide technical guidance on complex problem-solving and optimization techniques

  • Facilitate knowledge sharing sessions and technical training programs

  • Collaborate with hiring managers on technical interviews and team expansion

  • Implement comprehensive data governance frameworks and compliance controls

  • Design fine-grained access controls and data classification systems

  • Establish automated data quality monitoring and lineage tracking

  • Ensure GDPR, SOX, and other regulatory compliance across data workflows

  • Implement privacy-preserving techniques and data anonymization strategies

  • Translate complex business requirements into scalable technical solutions

  • Coordinate cross-functional initiatives involving multiple engineering teams

Similar Openings for You