Data Engineer
bnpparibas
Job Description
Direct Responsibilities
- carry out production monitoring (when needed)
- process business line requests (data pipelines creation/evolution/issues/...)
- provide quality user support to the business lines.
- collect/analyze/challenge business line needs, provideits technicalexpertiseand propose a technical response tailored to the needs, the BNPPCardifecosystem and existing technical-functional constraints.
- adapt itself to functional and technical contexts and increase skills if needed/required.
- followtechnicalroadmap required by IT Group andmaintain/develop IT solution by considering these requirements.
- monitorthe product’s performance indicators (during build/run activities) and reporting to its management.
- fix issues and get their remediations.
- writeand keep updating technical documentation.
- be proactive about technical optimizations or efficiency gains.
Contributing Responsibilities
- Get knowledge overCardifTrusted Data Fabric product, itsfeaturesand several use cases.
- contribute, if needed, to the RUN tasks tomaintainthe data productsand, above all, havea critical point of view to propose/implement the improvements needed to simplify/make the tasks more reliable
- get and keepinformed about strategic plans about theCardifTrusted Data Fabric product defined and needed to transform the main functionalities and theproduct itselfinto the new Data Fabric product.
- activelyparticipatein projects by helping others squad members, managing, and doing building phases (pre-study/analysis/development/tests/documentation/...) of data engineering ranging from collection, ingestion,integrationand exposure ofCardifTrusted Data Fabric data
- close collaboration with the IT teams to ensure a good understanding of the needs and their IT implementations.
- active contribution to all agile rituals (sprint planning, backlog refinement, sprint review, sprint demo, sprint retrospective, daily meeting)
Technical & Behavioral Competencies
- SQL (Master)
- Python development (Master)
- Starburst, Trino, Airflow (Master)
- Toolchain CI/CD (principle, tools, automated test...)
- Cloud concept with container, Object Storage (COS)and exchange protocol (type S3)
- ETL/ELT (at least 1significant experience)
- KSH development
- Basics knowledges:
- Security rules and protocols
- Exchange file protocols (CFT)
- Distributed architecture
- LINUX environment
- Strong problem-solving skills, with the ability to debug and troubleshoot complex technical issues
Optional:
- Java development Spring Batch (at least 1significant experience)
- Java development API (at least 1significant experience)
- Spark
- Oracle SQL
Specific Qualifications:
• Minimum 5 years of experience along with Master Degree or equivalent
Skills Referential (Required knowledge, skills and abilities)
Technical Skills:
- SQL (Master)
- Python (Master)
- Linux
- ETL/ELT (At least 1 year experience)
- Starburst, Trino, Airflow (Master)
Behavioral Skills:
- Attention to detail / rigor
- Adaptability
- Creativity & Innovation / Problem solving
- Ability to deliver / Results driven
Transversal Skills:
- Ability to understand, explain and support change
- Analytical Ability
- Ability toanticipatebusiness / strategic evolution
- Ability to develop others & improve their skills