Senior Data Engineer
te
Job Description
1. AI Data Engineering & Architecture
- Design and develop scalable data pipelines to prepare structured, semi-structured, and unstructured enterprise data for AI/GenAI applications.
- Build standardized, reusable, and governed AI-ready datasets.
- Implement data ingestion, transformation, validation, and refresh mechanisms supporting AI applications.
2. RAG, Embeddings & Vector Data Engineering
- Develop data pipelines supporting Retrieval-Augmented Generation (RAG) solutions.
- Implement document ingestion, parsing, text extraction, cleaning, chunking, and metadata enrichment.
- Develop and maintain embedding generation, refresh, and indexing workflows.
3. Knowledge Graph & Graph Data Engineering
- Design and develop graph-ready datasets representing enterprise entities and relationships.
- Transform relational and other enterprise data sources into nodes, relationships, and properties.
- Support knowledge graph development and graph-based data retrieval.
4. Cloud AI Data Integration
- Build secure data integrations across Azure, Databricks, enterprise databases, cloud storage, and APIs.