Data Engineer

cgi

Chennai, Tamil Nadu, India 3 Years Exp Posted 1h ago

Job Description

. Design, develop and maintain scalable data pipelines and data engineering solutions.
. Develop data ingestion, transformation and processing workflows using cloud based technologies.
. Work with Snowflake and Databricks to build and optimize data processing and analytical solutions.
. Develop and maintain data pipelines using AWS Glue, S3 and Lambda.
. Implement data transformation, cleansing, validation and integration processes.
. Develop efficient SQL queries and optimize data processing and warehouse workloads.
. Work with business and technical teams to understand data requirements and translate them into technical solutions.
. Participate in solution design, development, testing and deployment activities.
. Develop reusable components and follow established data engineering and coding standards.
. Troubleshoot data pipeline and application issues and implement appropriate fixes.
. Participate in code reviews, technical discussions and continuous improvement initiatives.
. Support deployment and release activities across environments.
. Monitor data pipelines and proactively identify issues affecting data processing or availability.
. Provide support for production issues when required, including troubleshooting and root cause analysis.
. Maintain technical documentation and operational procedures.

Similar Openings for You