Data Engineer

cisco

Bengaluru 4 Years Exp Posted 1h ago

Design, develop, and implement scalable and efficient data pipelines using AWS services (e.g., S3, EC2, ECS, Aurora).
Write high-quality, maintainable Python code for data extraction, transformation, and loading (ETL) and Machine leaning / AI (LLM) processes.
Develop and integrate with Web Services, Micro Services, and APIs to ingest and expose data from various internal and external sources.
Implement robust Data Engineering solutions, including data modeling, database design, and data warehousing.
Optimize data storage, retrieval, and processing for performance and cost-efficiency on AWS.
Monitor and troubleshoot data pipeline issues, ensuring data quality, integrity, and availability.
Collaborate with data scientists, analysts, and software engineers to understand data requirements and deliver solutions.
Contribute to the development and enforcement of data governance policies and standards.
- Stay up-to-date with emerging technologies and industry trends in Data Engineering, cloud computing, and data management.