Data Engineer
pitchnhire
Job Description
Responsibilities
• Build our next generation data warehouse
• Build our event stream platform
• Translate user requirements for reporting and analysis into actionable deliverables
• Enhance automation, operation, and expansion of real-time and batch data environment
• Manage numerous projects in an ever-changing work environment
• Extract, transform, and load complex data into the data warehouse using cuttingedge technologies • Build processes for topnotch security, performance, reliability, and accuracy
• Provide mentorship and collaborate with fellow team members
Qualifications
• Bachelor’s or Master’s degree in Computer Science, Information Systems, Operations Research, or related field required
• 3+ years of experience building data pipelines
• 3+ years of experience building data frameworks for unit testing, data lineage tracking, and automation
• Fluency in Scala is required
• Working knowledge of Apache Spark
• Familiarity with streaming technologies (e.g., Kafka, Kinesis, Flink) Nice-to-Haves
• Experience with Machine Learning
• Familiarity with Looker a plus