AML Senior Data Engineer
bnpparibas
Job Description
- Develop & deliver production‑grade Python micro‑services, event‑driven workers and APIs (FastAPI/Django/Flask, Celery, asyncio) that process millions of transactions per day with low latency.
- Build data pipelines using PySpark, Apache Beam or similar frameworks; integrate with streaming platforms (Kafka, Pulsar) and batch ingestion layers.
- Collaborate with data‑science teams to package, serve and monitor ML models for anomaly detection, transaction clustering and network analysis.
- Implement data‑quality, lineage and privacy controls (GDPR/CCPA) throughout ingestion‑to‑case‑management flows.
- Write automated tests, CI/CD scripts and IaC (Terraform/CloudFormation) to ensure repeatable, safe releases.
- Perform code reviews, mentoring and knowledge‑sharing to uplift junior developers and enforce Python best‑practice standards.
- Monitor, troubleshoot and optimize services in production using observability stacks (ELK, Grafana, Prometheus, OpenTelemetry) and profiling tools (Dynatrace, Py‑Spy, cProfile).
- Participate in feasibility studies for emerging technologies (graph databases, stream‑ and produce concise evaluation artefacts for the AML Architecture Committee (ITSVC).
- Implement end to end data orchestration with proper data modeling.
- Document architectural decisions, API contracts and data‑flow diagrams to keep the AML platform aligned with the target‑state design.
Technical and behavioral Competencies:
- Expert‑level knowledge on Python, async programming, libraries: FastAPI/Django/Flask, Celery, Pandas, NumPy, PySpark.
- Should be able to design, develop and secure REST/GraphQL services; event‑driven patterns (Kafka, Pulsar).
- Should be able to build/optimize ETL/ELT pipelines; experience with Spark/Flink
- Strong knowledge on SQL (PostgreSQL, Oracle) and NoSQL/graph (Neo4j, JanusGraph) – modelling, indexing, performance tuning.
- Production experience on Docker, Kubernetes (helm charts), serverless functions.
- Hands on experience on Jenkins, Bitbucket Pipelines, GitHub Actions; IaC (Terraform, CloudFormation); automated testing (pytest, unittest).
- Should be able to write logging, metrics & tracing using (ELK, Prometheus, Grafana, OpenTelemetry).
- Should have awareness of Secure coding, OAuth2/JWT, data‑privacy (GDPR/CCPA.
- Should have ability to articulate technical concepts to both technical and compliance audiences; strong written documentation skills.
- Proven experience in globally distributed Agile squads; mentor junior team members.
- Ability & willingness to learn & work on diverse technologies (languages, frameworks, and tools)
Nice to have skills:
- Exposure to ML frameworks (Scikit‑learn, TensorFlow, PyTorch) and model‑deployment pipelines.
- Familiarity with AML‑specific open‑source tools (SAR‑ML, OpenAML, custom rule engines).
- Knowledge of AML regulatory reporting standards (FAT, 5AMLD, FinCEN).
- Cloud‑architect certifications (AWS Solutions Architect, Azure Solutions Architect, Google Professional Cloud Architect)