Data Engineer
easyrewardz
Job Description
- Architect, build, and maintain real-time and batch data pipelines using tools like Apache Spark, PySpark, RisingWave, Redpanda, and ScyllaDB.
- Develop and maintain data transformation and integration workflows using Python and Airflow.
- Design and orchestrate reliable ETL/ELT pipelines that ingest data from SDKs, APIs, webhooks, and third-party systems.
- Collaborate with product, analytics, and engineering teams to build scalable data solutions that support BI, customer analytics, and marketing automation.
- Optimize query performance and data storage using systems like ScyllaDB, MySQL, and cloud-native data lakes.
- Ensure high standards of data quality, validation, and lineage through monitoring and alerting frameworks.
- Work closely with DevOps to deploy resilient, cloud-native infrastructure to support scalable data systems.
- Mentor junior engineers and participate in the development of the team’s technical strategy and roadmap