Unify Technologies - Big Data Developer - Hadoop/Spark

- Create new and maintain existing Scala/Spark jobs for data transformation and aggregation from simple to complex data transformations involving structured and unstructured data.

- Produce unit tests for Spark transformations and helper performance optimisation methods.

- Develop data processing pipelines, data storage, and management architecture.

- Define scalable calculation logic for interactive and batch use cases

- Interact with infrastructure and data teams to produce complex analysis across data

- You'll be working on a unique and challenging big data ecosystem with a focus on storage efficiency, data security and privacy, scalable and performant queries, expandability and flexibility, etc., and to help better measure the quality of map data.

- You will work with engineers to build a big data platform that processes and manages exabytes of data and enables efficient access to that data.