Senior Data Engineer
irissoftware
Job Description
- Data Infrastructure Management: Design, implement, and maintain efficient and scalable data infrastructure, including data lakes, data warehouses, and relational and NoSQL databases.
- Reporting: Maintain existing reports and data feeds. Optimize existing ones for resilience and spend. Build new reports and feeds into our internal and external customers.
- Data Pipeline Development: Develop, test, and maintain ETL (Extract, Transform, Load) pipelines to collect, process, and transfer data across different sources and destinations.
- Data Quality and Governance: Ensure data quality, consistency, and accuracy through data validation, monitoring, and management of data governance standards.
- Optimization: Optimize database queries, data storage, and retrieval for performance improvements.
- Collaboration: Work closely with data scientists, analysts, and product teams to understand data requirements and translate them into efficient technical solutions.
- Data Security: Implement and enforce data security best practices to ensure compliance with regulatory standards.
- Documentation: Document data architecture, processes, and infrastructure changes.