Data Engineer

Responsibilities

Direct Responsibilities

• carry out production monitoring (when needed)
• process business line requests (data pipelines creation/evolution/issues/...)
• provide quality user support to the business lines.
• collect/analyze/challenge business line needs, provideits technicalexpertiseand propose a technical response tailored to the needs, the BNPPCardifecosystem and existing technical-functional constraints.
• adapt itself to functional and technical contexts and increase skills if needed/required.
• followtechnicalroadmap required by IT Group andmaintain/develop IT solution by considering these requirements.
• monitorthe product’s performance indicators (during build/run activities) and reporting to its management.
• fix issues and get their remediations.
• writeand keep updating technical documentation.
• be proactive about technical optimizations or efficiency gains.

Contributing Responsibilities

• Get knowledge overCardifTrusted Data Fabric product, itsfeaturesand several use cases.
• contribute, if needed, to the RUN tasks tomaintainthe data productsand, above all, havea critical point of view to propose/implement the improvements needed to simplify/make the tasks more reliable
• get and keepinformed about strategic plans about theCardifTrusted Data Fabric product defined and needed to transform the main functionalities and theproduct itselfinto the new Data Fabric product.
• activelyparticipatein projects by helping others squad members, managing, and doing building phases (pre-study/analysis/development/tests/documentation/...) of data engineering ranging from collection, ingestion,integrationand exposure ofCardifTrusted Data Fabric data
• close collaboration with the IT teams to ensure a good understanding of the needs and their IT implementations.
• active contribution to all agile rituals (sprint planning, backlog refinement, sprint review, sprint demo, sprint retrospective, daily meeting)

Technical & Behavioral Competencies

• SQL (Master)
• Python development (Master) 
• Starburst, Trino, Airflow (Master)
• Toolchain CI/CD (principle, tools, automated test...) 
• Cloud concept with container, Object Storage (COS)and exchange protocol (type S3)
• ETL/ELT (at least 1significant experience)
• KSH development
• Basics knowledges:

• Security rules and protocols
• Exchange file protocols (CFT)
• Distributed architecture

• LINUX environment
• Strong problem-solving skills, with the ability to debug and troubleshoot complex technical issues

Optional: 

• Java development Spring Batch (at least 1significant experience)
• Java development API (at least 1significant experience)

• Spark
  • Oracle SQL