Data Engineer

barclays

pune NM Years Exp Posted 14d ago

Job Description

o be successful in this role, you should have below skills:

  • Build and Maintain Data Architectures: Develop and maintain data pipelines that enable the transfer and processing of durable, complete, and consistent data 1.

  • Design and Implement Data Warehouses and Data Lakes: Manage appropriate data volumes and velocity while adhering to required security measures 1.

  • Develop Processing and Analysis Algorithms: Create algorithms fit for the intended data complexity and volumes 1.

  • Collaborate with Data Scientists: Work closely with data scientists to build and deploy machine learning models 1.

 

Some other highly valued skills may include below:

  • Building and maintaining scalable, reliable data pipelines

  • Ensuring data durability, completeness, and consistency

  • Designing and managing data storage solutions

  • Handling large volumes and high-velocity data securely

  • Creating efficient data processing and analysis algorithms

  • Optimizing for complexity and performance

  • Supporting data scientists in building and deploying ML models

  • Providing clean, structured data for model training and inference

  • Strong programming skills (e.g., Python, SQL, Scala)

  • Familiarity with tools like Apache Spark, Kafka, Airflow, and cloud platforms (AWS, Azure, GCP)

    • Ensuring data privacy, access control, and compliance with standards

Similar Openings for You