Data Engineer

Core Technical Skills

• Python
  • Backend service development and business logic implementation
  • Retry and error-handling mechanisms
  • Data schema modeling and validation using Pydantic
  • REST API development and request handling

• SQL / Snowflake
  • • MERGE and STREAM-based CDC pipeline development
    • Task scheduling and stored procedure implementation
    • Secure Views and Secure Data Sharing
    • Streaming data ingestion using Snowpipe and Snowpipe Streaming
    • RBAC, role management, and grant administration
    • Warehouse performance tuning and optimization

• Terraform
  • Infrastructure as Code (IaC) for Snowflake resource provisioning
  • Database, role, warehouse, and grant management
  • Modular and reusable infrastructure deployments
  • Automated environment provisioning and standardization

• AWS
  • Lambda-based event-driven ingestion workflows
  • S3 data lake storage architecture
  • Glue Data Catalog integration
  • IAM-based security and access control implementation

• Palantir Foundry
  • Workshop-based GUI and application development
  • Backend workflow and process orchestration
  • Data request, approval, and provisioning workflows
  • Multi-stage approval lifecycle management with role-based ownership transitions

• Version Control & CI Engineering
  • Git-based source control and branching strategies
  • Pre-commit hook framework implementation
  • Python linting and formatting using Ruff
  • Pull request templates and review governance
  • AI-assisted development workflows (Plan → Build → Review)

Data Modeling & Interchange Formats

• • JSON-based configuration and request schema design
  • Hierarchical and relational data modeling
  • Cross-platform data model synchronization

Platform & Domain Expertise

• Enterprise Data Provisioning & Request Portals
  • End-to-end ownership of data request platforms
  • Palantir Foundry Workshop GUI development
  • Workflow orchestration and Python-based execution engines
  • Integration with Snowflake and AWS target platforms

Data Virtualization & Analytics Platform Integration

• • • Output-port and ownership-privilege management
    • Source-to-target data model synchronization
    • Integration of hierarchical data structures across platforms

Industrial / OT Data Integration

• • • Integration of Aveva PI process historian data
    • Event-driven ingestion pipelines using Lambda → Snowpipe → Snowflake
    • Secure data sharing architectures
    • OT entity modeling and governance framework design

Multi-Stage Approval Workflow Design

• • Workflow development in Palantir Foundry
  • Role-based approval and ownership handoffs
  • End-to-end request lifecycle management:
    • Requester
    • Data Steward
    • Data Owner
    • Engineering Team
    • Business Verification Team

Data Access Governance

• • Access request and approval workflow implementation
  • Role-Based Access Control (RBAC) design
  • Self-service data provisioning solutions
  • Business-owner-driven governance models

• Regulated Environment Delivery
  • Dev → QA → Production deployment management
  • Controlled release and promotion workflows
  • Support for validated and GxP-equivalent environments

Compliance-focused system delivery and governance practices