Senior Data Engineer
mlp
Job Description
-
Create and maintain optimal data pipeline architecture.
-
Extract, transform, and load data from a wide variety of data sources using Python and SQL.
-
Provide users access to datasets using REST and Python APIs.
-
Categorize, catalog, cleanse, and normalize datasets.
-
Communicate effectively with business users and technology stakeholders.
Required skills/experience:
-
8+ years of relevant experience in data engineering or a closely related field.
-
Strong Python skills and experience with data analysis libraries (Pandas, NumPy, SciPy).
-
Hands-on relational SQL database development experience.
-
Unix/Linux experience.
-
Bachelor’s degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.
Desirable skills/experience:
-
Object-oriented languages: Java, C++, etc.
-
AWS cloud services: EC2, RDS, Athena, Lambda, etc.
-
RDBMS: SQL Server and PostgreSQL.
-
Identity and Access Management: Kerberos, OAuth 2.0, LDAP.
-
Other technologies: Apache HTTP Server, Kafka, Snowflake.
-
Broad understanding of credit, fixed income, derivatives, futures, FX, or other financial instruments.
Other Qualifications:
-
Excellent listening and communication skills (both oral and written).
-
Self-starter and critical thinker; takes ownership of projects and suggests improvements to the broader infrastructure.
-
Proactive, assertive, and attentive to detail.
-
Able to work both independently and collaboratively.
-
Comfortable handling multiple projects with competing priorities in a fast-paced environment.
-
Strong self-management and problem-solving skills.
-
Quick learner.
-