Tech Lead Data Engineer
southwestair
Job Description
- Lead and develop the big data platform
- Design, build, implement, document and automate ingestion (real time and batch), enrichment and analytics data pipelines using big data tools and technologies
- Assemble large, complex sets of data that meet non-functional and functional business requirements
- Identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
- Build required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies
- Implement Big Data Solutions as a hands-on Technical Lead
- Process & ingest high volumes of data & transactions with full Life Cycle Implementation(s) of Scalable Big Data & Data Lake solutions
- Build analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition
- Work with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues
- Work with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure needs while assisting with data-related technical issues
- Generate or adapt equipment and technology to serve user needs
- May perform other job duties as directed by Employee's Leaders