Data Engineer

pal

Hyderabad 2 Years Exp Posted 17d ago

Job Description

  • Design and deploy automated ETL/ELT pipelines to ingest data from various sources (APIs, databases, logs) into cloud data warehouses.
  • Maintain cloud storage solutions (Data Lakes and Data Warehouses).
  • Monitor and tune query performance and cloud resource consumption to manage costs.

 

Technical Requirements:

  1. Cloud Platforms: AWS (Redshift, S3, Glue), Azure (Data Factory, Synapse), or GCP (BigQuery, Dataflow).
  2. Languages: Advanced SQL (essential) and Python.
  3. Data Processing: Apache Spark, Flink, or Kafka for real-time streaming. 
    1. Orchestration: Apache Airflow, dbt, or Prefect

Similar Openings for You

Data Engineer
husky • Chennai, India
Lead II - Data Engineering
ripplehire • Bangalore
Data Engineer I
generalmills • Mumbai, India
Senior Data Engineer
cgi • Hyderabad