GDS Consulting-AI And DATA-GCP-Senior
ey
Job Description
- Experience with streaming and messaging technologies such as Pub/Sub, Dataflow, and Apache Kafka on GCP.
- Hands-on experience building data pipelines and architectures using GCP services including BigQuery, Cloud Storage, Dataproc, Dataflow, Cloud Composer, and Cloud Functions.
- Proficiency in Spark, PySpark, and Scala for big data processing.
- Experience with software version control and CI/CD tools such as Git, Jenkins, and Cloud Build.
- Relevant GCP certifications or other professional technical certifications in cloud and data engineering.
- Experience with cloud or on-premises middleware and enterprise integration technologies.
- Skilled in writing MapReduce, Spark, or Dataflow jobs for large-scale data processing.
- Strong background in architecting scalable data warehouse solutions and integrating various technical components.
- Excellent analytical skills with deep knowledge of SQL and data querying.
- 4+ years of experience working in large-scale data warehousing environments.
- Exceptional communication skills, both written and verbal.
- 7+ years of experience with detailed knowledge of data warehouse architectures, infrastructure components, ETL/ELT processes, and reporting/analytics tools.
- 4+ years of experience in data modelling concepts.
- 3+ years of development experience in Python and/or Java.
- 3+ years of experience working with Big Data ecosystems such as Hadoop, Spark, and related technologies.
Skills and attributes for success
- Flexible, proactive, and self-motivated with strong ownership of problem resolution.
- Excellent communicator with strong verbal and written skills in both formal and informal settings.
- Ability to multitask under pressure and work independently with minimal supervision.
- A collaborative team player who thrives in cooperative environments.
- Adaptable to new technologies and evolving industry standards.
To qualify for the role, you must have
- BE/BTech/MCA/MBA
- Minimum 3+ years hand-on experience in one or more key areas.