Data Engineer-II

Key Responsibilities

• Design, develop, and maintain party reference data services and pipelines supporting clients, counterparties, issuers, and legal entities.
• Build and enhance cloud-native data solutions using AWS services such as Glue, Lambda, EventBridge, S3, RDS (Aurora/Postgres), and MSK/Kinesis.
• Contribute to modernization efforts by migrating legacy party data systems from on-premise platforms to scalable, cloud-based architectures.
• Integrate and manage third-party data providers (e.g., S&P Global Markit, Dun & Bradstreet, KYC/AML vendors) to ensure accurate ingestion, enrichment, and synchronization of party data.
• Implement data mastering capabilities including deduplication, survivorship rules, identity resolution, and golden record creation.
• Develop and maintain APIs and data services to deliver party data to downstream systems such as CRM, trading, compliance, and reporting platforms.
• Ensure data quality, reliability, and lineage through validation frameworks, monitoring, and metadata management.
• Build resilient, observable systems with appropriate logging, alerting, and fault-tolerant design patterns.
• Collaborate with architecture, security, and governance teams to ensure compliance with data privacy, regulatory, and cybersecurity standards.
• Participate actively in Agile delivery processes including backlog refinement, sprint planning, code reviews, and production support.
• Mentor junior developers and contribute to coding standards, design reviews, and engineering best practices.

Requirements:

• 3+ years of experience in data engineering or software development with a focus on enterprise data platforms, including hands-on experience working with party or entity reference data domains.
• Proficiency with AWS services including Glue, Lambda, EventBridge, S3, RDS (Aurora/Postgres), and MSK/Kinesis.
• Experience with data mastering concepts such as identity resolution, source system prioritization, and golden record management.
• Experience working with relational and cloud-native data stores, including Snowflake, Aurora, Postgres, MSSQL, or similar technologies.
• Experience building data pipelines, APIs, and event-driven architectures (Python preferred), along with familiarity with CI/CD pipelines, infrastructure-as-code (Terraform preferred), and modern DevOps practices.
  • Problem-solving skills, the ability to work independently on complex technical challenges, effective communication skills, and the ability to collaborate across technical and business teams; AWS certification(s) are a plus.