Senior Data Engineer - GCP
equinix
Job Description
-
Participate in design and implementation of enterprise-scale data pipelines and platform architecture for End-to-End data products.
-
Develop fault-tolerant data processing systems using advanced GCP services
-
Evaluate and recommend new technologies, tools, and architectural approaches
-
Build complex ETL/ELT workflows using Cloud Dataflow, Composer, Dataform/dbt, BigQuery and custom solutions
-
Implement sophisticated real-time streaming architectures with Cloud Pub/Sub, Kafka and Apache Beam
-
Design and optimize data processing workflows for performance, cost, and reliability
-
Develop advanced data transformation logic and custom processing functions
-
Implement data architectures and microservices-based data platforms
-
Design multi-environment deployment strategies and automated scaling solutions
-
Establish monitoring, alerting, and observability frameworks across the data platform
-
Lead code reviews and establish quality assurance processes
-
Provide technical guidance on complex problem-solving and optimization techniques
-
Facilitate knowledge sharing sessions and technical training programs
-
Collaborate with hiring managers on technical interviews and team expansion
-
Implement comprehensive data governance frameworks and compliance controls
-
Design fine-grained access controls and data classification systems
-
Establish automated data quality monitoring and lineage tracking
-
Ensure GDPR, SOX, and other regulatory compliance across data workflows
-
Implement privacy-preserving techniques and data anonymization strategies
-
Translate complex business requirements into scalable technical solutions
-
Coordinate cross-functional initiatives involving multiple engineering teams