Data Engineer
standardchartered
Job Description
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes for the PS application
- Build data ingestion, transformation, and distribution workflows using Python, PySpark, SQL, and Hadoop/big‑data tools
- Engineer robust data models to support trade lifecycle, post‑trade processing, and downstream analytics/reporting
- Implement data quality checks, validation rules, and exception handling to ensure completeness, accuracy, and consistency of trade data
- Optimize performance of batch and near real‑time data processing jobs on distributed data platforms
- Collaborate with business analysts, architects, and operations teams to understand data requirements and translate them into technical solutions
- Contribute to the design and implementation of data governance, metadata management, and lineage across post‑trade datasets
- Support production systems, including incident investigation, root cause analysis, and continuous improvement of reliability and resiliency
- Document data flows, technical designs, and best practices for ongoing maintenance and knowledge sharing
- Work within CI/CD, DevOps, and microservices‑oriented environments, collaborating closely with platform and SRE teams.