Data Engineer
acuitykp
Job Description
• 5-7 years of experience in software development with a focus on data projects using Python, PySpark, and associated frameworks.
• Proven experience as a Data Engineer with experience in Azure cloud.
• Experience implementing solutions using Azure cloud services, Azure Data Factory, Azure Lake Gen 2, Azure Databases, Azure Data Fabric, API Gateway management, Azure Functions.
• Strong SQL skills with RDMS or NoSQL databases.
• Experience with developing APIs using FastAPI or similar frameworks in Python.
• Familiarity with the DevOps lifecycle (git, Jenkins, etc.), CI/CD processes.
• Good understanding of ETL/ELT processes.
• Experience in the financial services industry, financial instruments, asset classes, and market data are a plus.
• Assist stakeholders with data-related technical issues and support their data infrastructure needs.
• Develop and maintain documentation for data pipeline architecture, development processes, and data governance.
• In-depth knowledge of data warehousing concepts, architecture, and implementation.
• Extremely strong organizational and analytical skills with strong attention to detail.
• Strong track record of excellent results delivered to internal and external clients.
• Excellent problem-solving skills, with the ability to work independently or as part of a team.
• Strong communication and interpersonal skills, with the ability to effectively engage with both technical and non-technical
stakeholders.
• Able to work independently without the need for close supervision and collaboratively as part of cross-team efforts.