Data Engineer II

ROLE AND RESPONSIBILITIES

• Guide and front the design and development of ETL pipelines and processes
• Collaborate with a team of data science and analytics professionals to understand how best to prepare data for further use
• Build, maintain, and optimize existing data architecture and infrastructure
• Enhance data quality and integrity through pressure testing and validation
• Spearhead the development and unification of multiple systems in a microservice centric architecture

REQUIRED QUALIFICATION & EDUCATION

• University Degree in Computer Science, Data Science, Mathematics or a related field and 4+ years of applicable experience
• Certification in one or more data management technologies or methodologies

REQUIRED SKILLS & COMPETENCIES

• Expertise with both SQL and noSQL database solutions
• Experience working with both structured and unstructured data
• Knowledge of programming languages such as Python or Ruby
• Understanding of data warehousing concepts and tools in AWS or Azure
• Understanding of a data lakehouse architecture, design, and implementation
• Strong problem solving skills and a passion for high quality data management

REQUIRED SOFTWARE KNOWLEDGE

• 2+ yrs of SQL experience
• 4+ years of programming experience using either Ruby, Python, or another scripting language
• Experience working within expansive AWS systems involving multiple groups of microservices

PREFERRED EXPERIENCE

• Bachelors / Masters Degree in Computer Science, Data Science, Mathematics or a related field and 2+ years of applicable experience
• Experience unifying systems with similar but distinct approaches to data management is a plus

PREFERRED SKILLS & COMPETENCIES

• Understanding of cloud computing and data management technologies in AWS (Sagemaker, Lambda, RDS, Redshift)
• Prior history working under Agile software development methods and tooling, such as Jira ticketing, Kanban process, etc.
• Exposure to data visualization or business intelligence tools is a plus (DOMO, Tableau, PowerBI)
  • Experience working with version control systems such as GIT