Data Engineer
irco
Job Description
Key Responsibilities
- Pipeline Monitoring & Observability: Monitor daily data pipelines (ELT/ETL) and dbt jobs to ensure successful completion. Proactively identify delays or failures before they impact stakeholders.
- Incident Response (Break/Fix): Serve as the first line of defense for pipeline failures. Troubleshoot errors in SQL, Python, or ingestion tools, and implement fixes to restore service.
- Data Ingestion Management: Oversee the routine ingestion of data from various sources. Verify data arrival and validate row counts/quality metrics.
- Ticketing & User Support: Manage the data support queue (e.g., Jira, ServiceNow). Assist users with access requests, query issues, and data discrepancies.
- Automation: Write scripts (using Python) to automate repetitive maintenance tasks, alerting, and data validation checks.
- Deployment (CI/CD): Assist in the deployment of code changes (SQL/dbt models) to production, ensuring smooth releases and quick rollbacks if necessary.
- Root Cause Analysis: Document incidents and perform root cause analysis to prevent recurring issues.
Required Skills & Qualifications
Exp range : 5-10 Years
- Operational Experience: Experience in a DataOps, Site Reliability Engineering (SRE), or Production Support role.
- Strong SQL Knowledge: Ability to write and debug SQL queries to diagnose data issues and verify fixes.
- Scripting Skills: Proficiency in Python for automation and scripting. (Experience with Python 3.10 or 3.11 is preferred).
- Troubleshooting Mindset: Excellent analytical skills to trace errors through logs, code, and data lineage.
- Snowflake Familiarity: Understanding of Snowflake virtual warehouses, history tables, and query profiles.
- Communication: Ability to communicate clearly with technical teams and business users regarding ticket status and outages.
- Agility: Comfortable working on a lean team where priorities can shift, and willingness to learn new observability tools.
Preferred Qualifications (Added Advantage)
- SnowPro Core Certification.
- Experience with dbt (specifically running and debugging models).
- Familiarity with data observability tools (e.g., Monte Carlo, Datadog, or custom alerting).
- Experience with version control (Git) and CI/CD pipelines.
What we Offer
- We are all owners of the company! Stock options (Employee Ownership Program) that align your interests with the company's success.
- Yearly performance-based bonus, rewarding your hard work and dedication.
- Leave Encashments
- Maternity/Paternity Leaves
- Employee Health covered under Medical, Group Term Life & Accident Insurance
- Employee Assistance Program
- Employee development with LinkedIn Learning
- Employee recognition via Awardco
- Collaborative, multicultural work environment with a team of dedicated