Lead Data Engineer

providence

Hyderabad 6 Years Exp Posted 4h ago

Strong knowledge of SQL, Azure SQL, TSQL
Strong knowledge of database, datawarehouse and data analysis
Strong knowledge of Databricks, python, spark.
Working experience in writing scripts on C# or similar languages for API development
Integrate unstructured data from multiple systems to create a single source of truth
Develop, monitor, and manage report curation and data modeling
Creating/implementing/Adopting API Governance and Standards for Data Analytics
Creating APIs to integrate unstructured data from a variety of systems to create a single source of truth (SailPoint, ServiceNow, Project Online, ADO, Intune, Azure licensing, and other systems of records for single/bi-direction data sets)
Working on Azure Services like Azure Data Factory, Azure Workbook, Log Analytics, Azure Functions, and other data analytics tools
Leveraging various Azure Services such as Azure Storage, Logic Apps, Data Factory, Azure SQL SaaS, Runbooks, Automation, Graph API, and various other data tools Developing/maintaining microservice automation (Prisma Cloud/Kubernetes)
Working experience in data visualization, PowerBI, writing complex SQL queries

What would your day look like?

Work closely with service teams to determine project engagement and priority, business data reporting and analysis requirements
Gather Requirements, Data analysis and modelling
Create scripts to support enhancements
Work with external vendors on bi-directional API integrations
Collaborate with DWH and Reporting teams on data analysis and integrity
Gather requirements, develop, and implement solutions across all endpoint technologies in the Microsoft stack

Who we are looking for?

Minimum 6-9 years of experience in Azure Data Engineering
Minimum 6-9 years of experience in BI Development
6-9 years of experience working in cloud technologies such as Azure/AWS/Google cloud service
Experience with Apache Spark and Azure Databricks
Working knowledge of Microsoft Fabric
Ability to troubleshoot technical problems, demonstrate problem solving
Ability to effectively communicate and excellent interpersonal skills
Experience working in Agile/sprints in a global team setup
- Bachelor’s Degree in Computer Science, Data Analytics, Business Management, or IS