Data Engineer

globallogic

Bengalor 5 Years Exp Posted 1h ago

Design, develop, and maintain scalable ETL/ELT data pipelines using DBT, SSIS, and Python
Develop and optimize SQL queries, stored procedures, and database objects in Microsoft SQL Server, PostgreSQL, and Snowflake
Build and automate data workflows using Apache Airflow
Manage and optimize cloud-based data solutions on AWS (S3, Lambda, EC2, RDS, IAM)
Implement data quality checks, validation, and monitoring for production pipelines
Troubleshoot production issues, optimize pipeline performance, and resolve data-related problems
Maintain code quality through Git version control, code reviews, and documentation
Develop shell scripts to automate operational and deployment tasks
Containerize applications and data services using Docker
Participate in Agile ceremonies including sprint planning, stand-ups, and retrospectives
Utilize AI-assisted development tools such as GitHub Copilot and Claude to improve productivity and code quality
- Document technical designs, workflows, and project progress using Jira and Confluence