GDS Consulting-AI And DATA-GCP-Senior

ey

kolkata 7 Years Exp Posted 9h ago

Job Description

  • Experience with streaming and messaging technologies such as Pub/Sub, Dataflow, and Apache Kafka on GCP.
  • Hands-on experience building data pipelines and architectures using GCP services including BigQuery, Cloud Storage, Dataproc, Dataflow, Cloud Composer, and Cloud Functions.
  • Proficiency in Spark, PySpark, and Scala for big data processing.
  • Experience with software version control and CI/CD tools such as Git, Jenkins, and Cloud Build.
  • Relevant GCP certifications or other professional technical certifications in cloud and data engineering.
  • Experience with cloud or on-premises middleware and enterprise integration technologies.
  • Skilled in writing MapReduce, Spark, or Dataflow jobs for large-scale data processing.
  • Strong background in architecting scalable data warehouse solutions and integrating various technical components.
  • Excellent analytical skills with deep knowledge of SQL and data querying.
  • 4+ years of experience working in large-scale data warehousing environments.
  • Exceptional communication skills, both written and verbal.
  • 7+ years of experience with detailed knowledge of data warehouse architectures, infrastructure components, ETL/ELT processes, and reporting/analytics tools.
  • 4+ years of experience in data modelling concepts.
  • 3+ years of development experience in Python and/or Java.
  • 3+ years of experience working with Big Data ecosystems such as Hadoop, Spark, and related technologies.

 

Skills and attributes for success

  • Flexible, proactive, and self-motivated with strong ownership of problem resolution.
  • Excellent communicator with strong verbal and written skills in both formal and informal settings.
  • Ability to multitask under pressure and work independently with minimal supervision.
  • A collaborative team player who thrives in cooperative environments.
  • Adaptable to new technologies and evolving industry standards.

 

To qualify for the role, you must have

  • BE/BTech/MCA/MBA
    • Minimum 3+ years hand-on experience in one or more key areas.