Data Engineer

irco

Bangalore 5 Years Exp Posted 14d ago

Key Responsibilities

Pipeline Monitoring & Observability: Monitor daily data pipelines (ELT/ETL) and dbt jobs to ensure successful completion. Proactively identify delays or failures before they impact stakeholders.
Incident Response (Break/Fix): Serve as the first line of defense for pipeline failures. Troubleshoot errors in SQL, Python, or ingestion tools, and implement fixes to restore service.
Data Ingestion Management: Oversee the routine ingestion of data from various sources. Verify data arrival and validate row counts/quality metrics.
Ticketing & User Support: Manage the data support queue (e.g., Jira, ServiceNow). Assist users with access requests, query issues, and data discrepancies.
Automation: Write scripts (using Python) to automate repetitive maintenance tasks, alerting, and data validation checks.
Deployment (CI/CD): Assist in the deployment of code changes (SQL/dbt models) to production, ensuring smooth releases and quick rollbacks if necessary.
Root Cause Analysis: Document incidents and perform root cause analysis to prevent recurring issues.

Required Skills & Qualifications

Exp range : 5-10 Years

Operational Experience: Experience in a DataOps, Site Reliability Engineering (SRE), or Production Support role.
Strong SQL Knowledge: Ability to write and debug SQL queries to diagnose data issues and verify fixes.
Scripting Skills: Proficiency in Python for automation and scripting. (Experience with Python 3.10 or 3.11 is preferred).
Troubleshooting Mindset: Excellent analytical skills to trace errors through logs, code, and data lineage.
Snowflake Familiarity: Understanding of Snowflake virtual warehouses, history tables, and query profiles.
Communication: Ability to communicate clearly with technical teams and business users regarding ticket status and outages.
Agility: Comfortable working on a lean team where priorities can shift, and willingness to learn new observability tools.

Preferred Qualifications (Added Advantage)

SnowPro Core Certification.
Experience with dbt (specifically running and debugging models).
Familiarity with data observability tools (e.g., Monte Carlo, Datadog, or custom alerting).
Experience with version control (Git) and CI/CD pipelines.

What we Offer

We are all owners of the company! Stock options (Employee Ownership Program) that align your interests with the company's success.  
Yearly performance-based bonus, rewarding your hard work and dedication.  
Leave Encashments
Maternity/Paternity Leaves
Employee Health covered under Medical, Group Term Life & Accident Insurance
Employee Assistance Program 
Employee development with LinkedIn Learning 
Employee recognition via Awardco 
- Collaborative, multicultural work environment with a team of dedicated professionals, fostering innovation and teamwork.