AML Senior Data Engineer

bnpparibas

Mumbai, India 3 Years Exp Posted 5h ago

Job Description

  • Develop & deliver production‑grade Python micro‑services, event‑driven workers and APIs (FastAPI/Django/Flask, Celery, asyncio) that process millions of transactions per day with low latency.
  • Build data pipelines using PySpark, Apache Beam or similar frameworks; integrate with streaming platforms (Kafka, Pulsar) and batch ingestion layers.
  • Collaborate with data‑science teams to package, serve and monitor ML models for anomaly detection, transaction clustering and network analysis.
  • Implement data‑quality, lineage and privacy controls (GDPR/CCPA) throughout ingestion‑to‑case‑management flows.
  • Write automated tests, CI/CD scripts and IaC (Terraform/CloudFormation) to ensure repeatable, safe releases.
  • Perform code reviews, mentoring and knowledge‑sharing to uplift junior developers and enforce Python best‑practice standards.
  • Monitor, troubleshoot and optimize services in production using observability stacks (ELK, Grafana, Prometheus, OpenTelemetry) and profiling tools (Dynatrace, Py‑Spy, cProfile).
  • Participate in feasibility studies for emerging technologies (graph databases, stream‑ and produce concise evaluation artefacts for the AML Architecture Committee (ITSVC).
  • Implement end to end data orchestration with proper data modeling.
  • Document architectural decisions, API contracts and data‑flow diagrams to keep the AML platform aligned with the target‑state design.

Technical and behavioral Competencies:

  • Expert‑level knowledge on Python, async programming, libraries: FastAPI/Django/Flask, Celery, Pandas, NumPy, PySpark.
  • Should be able to design, develop and secure REST/GraphQL services; event‑driven patterns (Kafka, Pulsar).
  • Should be able to build/optimize ETL/ELT pipelines; experience with Spark/Flink
  • Strong knowledge on SQL (PostgreSQL, Oracle) and NoSQL/graph (Neo4j, JanusGraph) – modelling, indexing, performance tuning.
  • Production experience on Docker, Kubernetes (helm charts), serverless functions.
  • Hands on experience on Jenkins, Bitbucket Pipelines, GitHub Actions; IaC (Terraform, CloudFormation); automated testing (pytest, unittest).
  • Should  be able to write logging, metrics & tracing using (ELK, Prometheus, Grafana, OpenTelemetry).
  • Should have awareness of Secure coding, OAuth2/JWT, data‑privacy (GDPR/CCPA.
  • Should have ability to articulate technical concepts to both technical and compliance audiences; strong written documentation skills.
  • Proven experience in globally distributed Agile squads; mentor junior team members.
  • Ability & willingness to learn & work on diverse technologies (languages, frameworks, and tools)

Nice to have skills:

  • Exposure to ML frameworks (Scikit‑learn, TensorFlow, PyTorch) and model‑deployment pipelines.
  • Familiarity with AML‑specific open‑source tools (SAR‑ML, OpenAML, custom rule engines).
  • Knowledge of AML regulatory reporting standards (FAT, 5AMLD, FinCEN).
    • Cloud‑architect certifications (AWS Solutions Architect, Azure Solutions Architect, Google Professional Cloud Architect)

Similar Openings for You