Sr. Software Engineer - ETL

yash

Bangalore 5 Years Exp Posted 11d ago

Roles & Responsibilities:

Tech / B.Sc./M.Sc. in Computer Science or related field and overall 5+ years of industry experience
Strong experience in Big Data & Data Analytics
Experience in building robust ETL pipelines for batch as well as streaming ingestion.
Experience with Palantir Foundry
Most important Foundry apps: Code Repository, Data Lineage and Scheduling, Ontology Manager, Contour, Object View Editor, Object Explorer, Quiver, Workshop, Vertex
Experience with Data Connection, external transforms, Foundry APIs, SDK and Webhooks is a plus
Interacting with RESTful APIs incl. authentication via SAML and OAuth2
Experience with test driven development and CI/CD workflows
Knowledge of Git for source control management
Agile experience in Scrum environments like Jira
Experience in visualization tools like Tableau or Qlik is a plus
Experience in Palantir Foundry, AWS or Snowflake is an advantage
Basic knowledge of Statistics and Machine Learning is favorable
Problem solving abilities
Proficient in English with strong written and verbal communication

Primary Responsibilities

Responsible for designing, developing, testing and supporting data pipelines and applications
Industrialize data pipelines
Establishes a continuous quality improvement process to systematically optimize data quality
Collaboration with various stakeholders incl. business and IT