ETL Data Engineer

virtusa

Chennai, India 7 Years Exp Posted 3h ago

Job Description

Technical Skills Data Engineering, Big Data, Platform Engineering, Multi-tenant Database Design, Data Modeling, Advanced SQL, Oracle, Azure SQL Managed Instance (SQL MI), MySQL, Snowflake, Azure, ETL, ELT, Informatica, SnapLogic, Azure Functions, Python, Batch Data Processing, Feature Engineering, GitHub, CI/CD, DataOps, Azure Event Hubs, Kafka, Amazon Kinesis, Confluence, Draw.io, Metadata Management, Data Lineage, Production Support, Incident Management, Root Cause Analysis (RCA), Financial Services, Benefits Administration, Data Architecture, Batch Pipelines, Streaming Pipelines, Lakehouse, Delta Lake, Apache Iceberg, Apache Hudi, Data Warehouse, Semantic Data Modeling, Azure Data Factory, Azure Databricks, Apache Spark, Azure Kubernetes Service (AKS), Azure Service Bus (ASB), API Management, Azure Storage Accounts, Azure Event Grid, Azure Redis Cache, SQL Server, PostgreSQL, Cosmos DB, MongoDB, Azure DevOps, GitHub Actions, Unit Testing, Integration Testing, Data Quality, Great Expectations, Deequ, Monte Carlo, Schema Evolution, Partitioning, Performance Tuning, Business Intelligence, Analytics, Agile, Scrum, Jira, dbt, Control-M, DB2, CICS, Kubernetes, Containerization, Infrastructure as Code, Terraform, ARM Templates, Bicep.

Roles and Responsibilities Architect scalable cloud data platforms, design and implement high-performance batch and streaming data pipelines, build ETL/ELT solutions using Informatica, SnapLogic, Azure Data Factory, Azure Functions, Python and Databricks, develop lakehouse and data warehouse solutions, create scalable semantic data models, optimize SQL queries and database performance, implement DataOps and CI/CD practices, automate deployments and data quality validation, design metadata 

 

Similar Openings for You