Senior Data Engineer

pgcareers

Hyderabad 5 Years Exp Posted 2h ago

Job Description

  • Architect AI-native data pipelines — design end-to-end ingestion, transformation, and serving pipelines optimized for both traditional analytics consumption and agentic consumption (retrieval-augmented generation, tool-calling, MCP-based access).

  • Build the semantic data layer — standardize and contextualize data (schemas, metadata, business definitions) so knowledge and cognitive agents can reliably interpret and reason over it.

  • Own the KPI factory / manipulation layer — encode standard KPI calculations and business logic in reusable back-end services so agents and downstream consumers retrieve trusted outputs instead of recalculating in real time.

  • Design the data acquisition strategy — define systems of record, reference data, access rules, refresh frequency, and ownership for every data element feeding AI agents.

  • Build agent retrieval infrastructure — implement vector stores, embedding pipelines, and RAG patterns that support knowledge agents at production scale.

  • Govern agent data access — Design permissioning, guardrails, approval workflows, and audit logging for AI-assisted and automated data interactions, ensuring appropriate human accountability for sensitive or consequential actions.

  • Lead the full application lifecycle — from development, deployment, and upgrade through replacement or termination, for AI-native data pipeline components on Azure.

  • Enforce engineering standards — CI/CD, testing, data quality checks, drift detection, and evaluation of agent-facing outputs, in line with modern DevOps and Agile practices.

  • Collaborate cross-functionally — partner with agentic engineers, platform engineers, governance and risk leads, and business process experts to translate work-process redesign into production-grade data architecture.

    • Design for Human + AI Collaboration - Design data products and access patterns that improve how people work with AI—reducing repetitive data preparation and retrieval while preserving human judgment, accountability, and control for decisions and actions that require it.

Similar Openings for You