Data Engineer

Main responsibilities:

• Maintain & develop data platforms based on Microsoft Fabric for Business Intelligence & Databricks for real-time data analytics.
• Design, implement and maintain standardized production-grade data pipelines using modern data transformation processes and workflows for SAP, MS Dynamics, on-premise or cloud.
• Develop an enterprise-scale cloud-based Data Lake for business intelligence solutions.
• Translate business and customer needs into data collection, preparation and processing requirements.
• Optimize the performance of algorithms developed by Data Scientists.
• General administration and monitoring of the data platforms.

Competencies to be demonstrated:

• Working with structured & unstructured data.
• Experienced in various database technologies (RDBMS, OLAP, Timeseries, etc.)
• Solid programming skills (Python, SQL, Scala is a plus).
• Experience in Microsoft Fabric (incl. Warehouse, Lakehouse, Data Factory, DataFlow Gen2, Semantic Model) and/or Databricks (Spark).
• Proficient in PowerBI.
• Experienced working with APIs.
• Proficient in security best practices.
• Data centered Azure know-how is a plus (Storage, Networking, Security, Billing).

Education, Experience and Languages:

• Bachelor or Master degree in business informatics, computer science, or equal.
• A background in software engineering (e.g., agile programming, project organization) and experience with human centered design would be desirable.
• Extensive experience in handling large data sets.
• Experience working at least 5 years as a data engineer, preferably in an industrial company.
• Analytical problem-solving skills and the ability to assimilate complex information.
• Programming experience in modern data-oriented languages (SQL, Python).
• Experience with Apache Spark and DevOps.
• Proven ability to synthesize complex data advanced technical skills related to data modelling, data mining, database design and performance tuning.
  • English language proficiency