Data Engineer, Senior
cutshort
Job Description
Key Responsibilities:
- Design, develop, and maintain scalable pipelines to process structured and unstructured data.
- Optimize and manage SQL queries for performance and efficiency in large-scale datasets.
- Experience working with data warehouse solutions (e.g., Redshift, BigQuery, Snowflake) for analytics and reporting.
- Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions.
- Experience in Implementing solutions for streaming data (e.g., Apache Kafka, AWS Kinesis) is preferred but not mandatory.
- Ensure data quality, governance, and security across pipelines and storage systems.
- Document architectures, processes, and workflows for clarity and reproducibility.
Required Technical Skills:
- 4 or more years of experience in Data Engineering file.
- Expertise in SQL (complex queries, optimization, and database design).
- Write optimized and production-grade SQL scripts for transformations and data validation.
- Solid understanding and hands on experience in creating data pipelines and patterns.
- Proficiency in any programming languages like Python or R for scripting, automation, and pipeline development.
- Hands-on experience with Google Bigquery and Apache Airflow.
- Experience working on any cloud-based platforms like AWS or GCP or Azure.
- Experience working with structured data (RDBMS) and unstructured data (JSON, Parquet, Avro).
- Familiarity with cloud-based data warehouses (Redshift, BigQuery, Snowflake).
- Knowledge of version control systems (e.g., Git) and CI/CD practices.
Why Join Us:
· Collaborative work environment.
· Exposure to modern tools and scalable application architectures.
· Medical cover for employee and eligible dependents.
· Tax beneficial salary structure.
· Comprehensive leave policy
· Competency development training programs.