Sr Data Engineer

• Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions.

• Take ownership of data pipeline projects from inception to deployment, managing scope, timelines, and risks.

• Ensure data quality and integrity through rigorous testing and monitoring.

• Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions.

• Work closely with data analysts, data scientists, and business stakeholders to understand data requirements.

• Identify and resolve complex data-related challenges.

• Adhere to data engineering best practices and standards.

• Stayup to datewith the latest data technologies and trends.

Functional Skills:

Must-Have Skills:

• Demonstrated hands-on experience with cloud platforms (AWS, Azure, GCP) and the ability to architect cost-effective and scalable data solutions.

• Proficiencyin Python,PySpark, and SQL.Handon experience withbiddataETL performance tuning.

• Strong analytical and problem-solving skills to address complex data challenges.

• Effective communication and interpersonal skills to collaborate with cross-functional teams.

Good-to-Have Skills:

• Experiencedwith data modeling and performance tuning for both OLAP and OLTP databases 

• Experiencedworking with Apache Spark, Apache Airflow

• Experiencedwith software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and Dev Ops

• Experiencedwith AWS, GCP or Azure cloud services

Education andProfessional Certifications

• Bachelor’s /Master’sdegree in computer science and engineering preferred, other Engineering field is considered and 8 to 13 years' experience

• AWS Certified Data Engineerpreferred

• DatabricksCertificate preferred

Soft Skills:

• Excellent analytical and troubleshooting skills.

• Strong verbal and written communication skills

• Ability to work effectively with global, virtual teams

• High degree of initiative and self-motivation.

• Ability to manage multiple priorities successfully. 

• Team-oriented, with a focus on achieving team goals

• Strong presentation and public speaking skills.