Data Engineer

ey

Hyderabad 4 Years Exp Posted 1h ago

Job Description

  • Responsible for implementing secure, scalable, and highly available cloud-based solutions on Azure Cloud Analytics
  • Collaborate with internal and external stakeholders to understand their business requirements and translate them into technical solutions
  • Identify and implement automation opportunities to increase operational efficiency
  • Conduct knowledge sharing and training sessions to educate clients and internal teams on cloud technologies
  • Interact and collaborate with various teams (web Development/ MS Apps / API Development etc.) to deliver the products
  • Work very closely with Data Architects/Technical Managers in agile environment to identify and understand the problem statements and develop/prototype the solutions accordingly.
  • Should be able to work as Individual contributor
  • Experience in leading 2-4 member team

 

Technical Skills

  • 4-8 years of experience in architecting big data solutions with proven track record in driving business success
  • Strong SQL Expertise and Hands-on experience
  • Strong PySpark Expertise and Hands-on experience
  • Expertise experience with integration of different Sources System (ERPs, Applications DBs, Cloud Systems and Sharepoint) using Azure Data Factory, Azure Synapse pipelines and ADLS. Strongs Hands on experience on ADF, ADLS and Synapse.
  • Good Hands on Experience on DataBricks and should be able to demonstrate the usecases for DataBricks usage
  • Good Understanding on Unity Catalog and Delta Lake concepts
  • Understanding of data modelling concepts and should be able to demonstrate various Data Modelling mechanisms
  • Exposure on Azure AI Fundamentals
  • Experience with BI, and data analytics databases
  • Exposure in working with NoSQL using MongoDB or similar
  • Experience in converting business problems/challenges to technical solutions considering security, performance, scalability etc.
  • Experience in real-time data ingestion from LIVE sources using Apache Kafka, Spark Streaming, EventHub and related technologies
  • Exposure on PowerBi or similar reporting tools and should be able to work with PowerBi team to achieve end goal.