Data Engineer

As a Data Engineer, you will:

• Design data structures for data ingestion, integration, and consumption layers across a variety of technologies

• Work in a cross-skilled squad with stakeholders from both business and technology to build end-to-end feature

• Contribute to the design of data pipelines and patterns for on-premises and cloud environments, and learn to use AI tools within data engineering

• Optimise data flows by building robust, fault-tolerant data pipelines that clean, transform, and aggregate unstructured and complex data into databases or other data sources.

What will you bring?

To grow and be successful in this role, you will ideally bring the following:

• Experience using tools such as GitHub Copilot, SQL, Python, cloud platforms and native databases, Control-M/Airflow, ELT/ETL processes, Git/Bitbucket, CI/CD, and Unix/Linux scripting

• Should have a good knowledge of Python and be able to make minor code changes using basic language features and existing patterns, with guidance, and validate code using unit tests

• Should be familiar with existing documentation standards and require guidance to create or modify artifacts

• Good communication, problem-solving, planning and prioritisation, critical thinking, and curiosity to learn new AI tools

• Understands data security policies and principles with guidance and applies them to minimize risks

• Understands and applies basic Agile principles with guidance, contributing to team workflows

• Understands fundamental data privacy and ethical principles and follows guidelines with supervision

  • Familiar with basic testing methodologies and tools and applies them under supervision to execute simple test cases