Data Engineer

pitchnhire

Thiruvananthapuram, India 5 Years Exp Posted 22d ago

Job Description

Responsibilities

• Build our next generation data warehouse

• Build our event stream platform

• Translate user requirements for reporting and analysis into actionable deliverables

• Enhance automation, operation, and expansion of real-time and batch data environment

• Manage numerous projects in an ever-changing work environment

• Extract, transform, and load complex data into the data warehouse using cuttingedge technologies • Build processes for topnotch security, performance, reliability, and accuracy

• Provide mentorship and collaborate with fellow team members

 

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Systems, Operations Research, or related field required

• 3+ years of experience building data pipelines

• 3+ years of experience building data frameworks for unit testing, data lineage tracking, and automation

• Fluency in Scala is required

• Working knowledge of Apache Spark

• Familiarity with streaming technologies (e.g., Kafka, Kinesis, Flink) Nice-to-Haves

• Experience with Machine Learning

• Familiarity with Looker a plus

Similar Openings for You