Senior Data Engineer

Key Requisites:

• Expertise in Data structures and algorithms

• Strong knowledge of Object-Oriented Analysis and Design (OOAD) & hands-on experience with programming languages like Python

• Hands-on experience on test-driven development (TDD)

• Strong knowledge of relational databases like PostgreSQL and MySQL

• Good knowledge of Kafka and Spark Streaming internal architecture

• Good knowledge of application servers

• Knowledge of data ingestion and integration on cloud services such as AWS/ Google Cloud/ Azure

• Experience using Big Data batch and streaming tools.

• Experience using ELT/ ETL tools.

Working Relationships

Reporting to

• Team Lead / Project Manager

External Stakeholders

• Clients

Skills/ Competencies Required

Technical Skills

• Strong expertise (9 or more out of 10) in at least one modern programming language such as Python or SQL, and frameworks like Pandas, PySpark, Django / FastAPI, data visualization tools like Plotly, Streamlit, and orchestration tools like Apache Airflow

• Clear end-to-end experience in designing, programming, and implementing large-scale data pipelines

• Strong analytical and problem-solving abilities to solve complex problems

Soft Skills

• Ability to express ideas confidently and constructively

• Clear communication skills, both verbal and written, with high integrity and respect for intellectual property

• Ability to exercise discretion and independent judgment, work without micro-management, and maintain high professional standards

Academic Qualifications & Experience Required

Required Educational Qualification & Relevant experience

• Bachelor’s or Master’s in Computer Science, Computer Engineering, or related discipline from a well-known institute.

• Minimum 4 - 6 years of work experience as a developer in an IT organization (preferably Analytics / Big Data/ Data Science / AI background.