Tech Lead - AWS Job

Roles & Responsibilities:

• Understanding the current business functionalities of the ETL processes and identifying areas for improvement.
• Designing and building AWS Glue workflows to replace existing ETL processes.
• Standardizing code across all workflows to maintain consistency and scalability.
• Conducting unit tests on all converted jobs to ensure accuracy and reliability.
• Loading initial data into the required workflows and validating data integrity.
• Implementing a layered architecture in AWS and Snowflake for efficient data consumption.
• Creating comprehensive mapping documents for all existing processes and assets.
• Analyzing and enhancing all Excel, Qlik, and MS Access assets to support ongoing reporting needs.
• Developing additional views and logic to supplement reporting requirements.
• Deploying solutions to QA/UAT environments and providing support for Production migration.
• Documenting procedures to enable end-user execution and ongoing support.
• Knowledge of CICD pipelines and Jenkins.

Required Skills and Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience).
• Proven experience as a Technical Architect or similar role, with a track record of designing and implementing complex technical solutions.
• Strong expertise in architecture principles, design patterns, and best practices.
• Hands-on experience with cloud platforms (e.g., AWS) and related services(AWS Glue, AWS Athena, AWS Lambda, AWS Devops, AWS CloudWatch, AWS S3, Event Bridge).
• Proficiency in PySpark, Python and Snowflake.
• Knowledge on libraries of DuckDB, Polars, Dask etc
• Understanding about Data Engineering Pipelines, Terraform Pipelines. 
• Basic Knowledge of SSIS.
• Excellent analytical and problem-solving skills with a strong attention to detail.
• Outstanding communication and interpersonal skills, with the ability to collaborate effectively with diverse teams and stakeholders.
• Experience in Agile methodologies and DevOps practices.
• Relevant certifications (e.g., AWS Certified Associate Architect).
• Experience in leading digital transformation initiatives, migration projects, and Data Modeling.
• Knowledge of containerization and orchestration tools.