Data Engineer

• Maintain & develop data platforms based on Microsoft Fabric for Business Intelligence & Databricks for real-time data analytics.
• Design, implement and maintain standardized production-grade data pipelines using modern data transformation processes and workflows for SAP, MS Dynamics, on-premise or cloud.
• Develop an enterprise-scale cloud-based Data Lake for business intelligence solutions.
• Translate business and customer needs into data collection, preparation and processing requirements.
• Optimize the performance of algorithms developed by Data Scientists.
• General administration and monitoring of the data platforms.

Competencies to be demonstrated:

• Working with structured & unstructured data.
• Experienced in various database technologies (RDBMS, OLAP, Timeseries, etc.)
• Solid programming skills (Python, SQL, Scala is a plus).
• Experience in Microsoft Fabric (incl. Warehouse, Lakehouse, Data Factory, DataFlow Gen2, Semantic Model) and/or Databricks (Spark).
• Proficient in PowerBI.
• Experienced working with APIs.
• Proficient in security best practices.
  • Data centered Azure know-how is a plus (Storage, Networking, Security, Billing).