Sr. Software Engineer

• Design, develop, and optimize scalable data pipelines using AWS and Databricks.
• Build and manage modern Lakehouse architectures leveraging Delta Lake, Iceberg and Unity Catalog.
• Implement data governance capabilities including data quality, data lineage, metadata management, and data security.
• Develop ETL/ELT solutions using Python, PySpark, and SQL.
• Design and deploy GenAI solutions, including RAG-based chatbots and AI agents.
• Implement Context Engineering and semantic search frameworks to improve AI outcomes.
• Collaborate with architects, data scientists, and business stakeholders to deliver enterprise data solutions.
• Ensure platform scalability, performance, reliability, and cost optimization.

Key Skills

• AWS Data Analytics: S3, Glue, Athena, Redshift, Lake Formation, Lambda, DataZone, DynamoDB
• Databricks: Delta Lake, Iceberg, Unity Catalog, Delta Live Tables (DLT), MLflow, Mosaic AI, Vector Search, Genie Agent, Genie One
• Programming: Python, PySpark, SQL
• Data Engineering: ETL/ELT, Data Modeling, Data Warehousing, Lakehouse Architecture, Medallion Architecture
• Data Governance: Data Quality, Data Lineage, Metadata Management, Data Cataloging, Data Observability, Data Security
  • AI & GenAI: AWS Bedrock, SageMaker, RAG, Context Engineering, Semantic Search, AI Agents, LLM Orchestration