Data Engineer

Key Responsibilities

•    Work as part of Core Development team and support in contributing to Build, solution design & production release and maintenance
•    Understand user requirements and Translate it into detailed, business and technical requirements
•    Must know Programming skills like ETL using Python, SQL, Shell scripting, PySpark,
•    SQL Expertise in writing complex queries, performance tuning, query optimization.
•    Work with business users in guiding and obtaining Non-functional requirement as well as obtaining the relevant sign off for the performance test deliverables.
•    Able to work as a team and be proactive in providing out-of-the box solution if required.

Strategy
•    Develop our technical strategy and architecture using modern distributed application software, tools and techniques
•    Design our technology applications holistically and continuously improve our technical efficiency and make changes as necessary
•    Communicate technology strategy, architecture, and regular status reporting

Business

•    Have a good understanding of financial market instruments 

Processes

•    Align to Standard Chartered delivery processes of software delivery framework and keep high standard for change management practice.
•    Create process to reduce product time-to-market by embracing automation in the delivery lifecycle

People & Talent
•    Provide technical guidance and direction, as well as hands-on resource management for all software development activities
•    Coaching, mentoring, and developing our high performing engineers
•    Play a leading role in interviewing and supporting hiring new engineers
•    Leveraging the Engineering Career Path, develop members of the Liquidity Engineering team towards Distinguished Engineer and Enterprise Engineer status.

Risk Management
•    Highlight emerging risks to planned delivery upfront to ensure sufficient measures can be taken
•    Inform all stakeholders appropriately only risk / issues / challenges

Governance
•    Establish good governance process in the team to ensure quality delivery.
•    Ensure minimal release rollbacks, minimum post release production issues

Regulatory & Business Conduct 
•    Display exemplary conduct and live by the Group’s Values and Code of Conduct. 
•    Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct.
•    Lead to achieve the outcomes set out in the Bank’s Conduct Principles 
•    Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters.

Qualifications

Bachelor Degree Or Above

Skills and Experience

•    Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related technical field.
•    10+ years of experience in data engineering
•    Strong proficiency in Python, Python-spark, shell scripting and SQL, with hands-on experience in building large-scale ETL/ELT pipelines
•    Good to have exposure in the Big Data Ecosystem like Hive, Spark and HDFS
•    Good to have exposure with modern data stack components (Airflow, Iceberg).
•    Strong understanding of APIs, microservices, and DevOps/CI/CD concepts (Docker, Kubernetes, Terraform). 

Role Specific Technical Competencies
•    Data Engineering 
•    Pyton
•    SQL
•    Unix Scripting
•    Control-M /Airflow
•    Devops