Data Engineer

Build and operate batch and streaming data pipelines with strong scalability, performance, and fault tolerance.

Implement and monitor ETL (Extract, Transform, Load) processes to gather data from various sources.

Write clean, testable Python/PySpark code using object-oriented principles and unit testing.

Develop and manage databases and data warehouses and optimise database performance and storage across multipul platforms, e.g. Snowflake, PostgreSQL RDS & Aurora.

Ensure data quality, integrity, and reliability, whilst adhering to data security best practices.

Work closely with data analysts, and other stakeholders to understand data requirements.

Collaborate with teammates in an agile, dynamic environment to deliver reliable outcomes

Partner with Customer Support & Relationship Management for data-related queries and issues,

• Collaborate with the wider Engineering Team to integrate data solutions into the overall architecture.