IT Analyst Applications (Matillion ETL/ELT Developer – Snowflake Data Engineering)

caterpillar

Bangalore 5 Years Exp Posted 14d ago

Job Description

What you will do

  • ETL/ELT Pipeline Development: Design, develop, and maintain Matillion orchestration and transformation jobs to ingest, cleanse, and deliver data from diverse source systems (e.g., insurance policy administration, claims, Salesforce, warranty/quality feeds) into Snowflake. Implement incremental and full-load patterns appropriate to each data domain.
  • Snowflake Best Practices: Leverage strong SQL and Snowflake engineering practices including warehouse sizing and auto-suspend configuration, clustering and partitioning strategies where applicable, query performance tuning, and cost-aware execution to ensure pipelines are efficient, scalable, and financially responsible.
  • Business-Friendly Semantic Views & Certified Data Sources: Collaborate with data modelers and architects to build and maintain governed, business-friendly semantic layers on top of the Snowflake data warehouse. These certified data sources serve as the single source of truth for downstream consumption — including Power BI dashboards, Snowflake Semantic Views, Polaris AI (Snowflake Intelligence), and Streamlit applications. The role requires understanding how curated, well-defined data models enable natural language querying, AI agent consumption, and self-service analytics at scale.
  • Data Quality & Governance: Implement robust data validation checks, error handling, and logging within ETL workflows to ensure data accuracy, completeness, and traceability. Support data governance standards including consistent naming conventions, field-level definitions, and alignment with enterprise compliance requirements.
  • Deployment & Operations: Promote repeatable, reliable deployment practices including version control (Git), environment management (dev/test/prod), job scheduling (ActiveBatch), and on-call support as needed. Troubleshoot pipeline failures, rerun/restart job schedules, and manage support tickets in a timely manner.
  • Self-Service Analytics Enablement: Support the team's strategic shift toward publishing certified, governed data products that business users, analytics platforms, and AI experiences can consume directly — reducing IT bottlenecks and accelerating time-to-insight. This includes preparing data layers that feed Snowflake Semantic Views, ensuring the data is curated, well-documented, and optimized for natural language interaction.
  • Collaboration & Knowledge Sharing: Work closely with onshore team leads, data modelers, BI developers, business analysts, and project managers to align transformations with governed business definitions and deliver trusted datasets on time. Participate in knowledge-sharing sessions, maintain technical documentation, and support onboarding of new team members.

 

What you will have

  • 5+ years of experience in data engineering, ETL/ELT development, or cloud data integration
  • 2+ years hands-on experience with Matillion (ETL or Data Productivity Cloud)
  • 2+ years hands-on experience with Snowflake (SQL scripting, stored procedures, streams, tasks, views, performance tuning)
  • Strong SQL proficiency for data extraction, transformation, validation, and troubleshooting
  • Experience integrating data from diverse source systems into a cloud data warehouse
  • Familiarity with version control (Git), environment management, and CI/CD concepts for data pipelines
  • Excellent communication and collaboration skills; ability to work effectively in a distributed, global team
  • This position requires candidate to work a 5-day -a -week schedule in the office.
    • Shift Timing: 01:00Noon -10:00PM IST

Similar Openings for You