Data Engineer
crisil
Job Description
- Database Design and Development:
- Design and develop database architectures to support business requirements
- Develop and maintain database models, including entity-relationship diagrams and schema definitions
- Implement database security measures to ensure data integrity and confidentiality
- ETL Pipeline Development:
- Design and develop ETL pipelines to extract, transform, and load data from various sources
- Develop and maintain ETL scripts using Python and other programming languages
- Ensure data quality and integrity throughout the ETL process
- Data Integration and Migration:
- Integrate data from various sources, including APIs, files, and databases
- Develop and execute data migration plans to ensure seamless data transition
- Database Performance Optimization:
- Analyze and optimize database performance, including query optimization and indexing
- Implement caching and other techniques to improve database performance
- Collaboration and Communication:
- Work closely with development teams to ensure database systems meet application requirements
- Communicate database design and implementation plans to stakeholders
- Provide technical guidance and support to junior team members