IT Engineer,Software,Advanced
keysight
Job Description
Data Engineering & Pipeline Development
- Design, develop, and maintain scalable and reliable ELT/ETL pipelines using Fivetran, Matillion, and Snowflake.
- Build and optimize data ingestion frameworks for structured, semi-structured, and unstructured data sources.
- Develop and maintain Snowflake data models, schemas, views, and transformation logic.
- Implement data quality checks, validation frameworks, and monitoring processes.
- Optimize data pipelines for performance, scalability, and cost efficiency.
- Support batch and near real-time data integration requirements.
Snowflake Platform Engineering
- Design and implement data solutions leveraging Snowflake's cloud-native architecture.
- Manage Snowflake objects including databases, schemas, warehouses, tasks, streams, and secure data sharing.
- Implement performance tuning strategies, query optimization, and warehouse sizing recommendations.
- Ensure adherence to data governance, security, and compliance requirements.
AI & Advanced Analytics Enablement
- Utilize Snowflake Cortex AI capabilities for intelligent data processing, summarization, classification, sentiment analysis, and generative AI use cases.
- Implement AI-powered workflows using Snowflake-native AI services.
- Leverage Snowflake Intelligence to enable business users with natural language insights and data exploration capabilities.
- Collaborate with Data Scientists and Analytics teams to operationalize AI/ML and GenAI solutions on Snowflake.
Collaboration & Best Practices
- Work closely with business and technical teams to understand data requirements and translate them into scalable solutions.
- Participate in architecture reviews, code reviews, and data platform enhancement initiatives.
- Develop technical documentation, data lineage documentation, and operational runbooks.
- Support production deployments and troubleshoot data pipeline issues.