DATA ENGINEERING
micron
Job Description
- Understanding of Big Data Engineering/processing, Business Intelligence and Advanced analytics
- Developing ETL/ELT processes
- Knowledge in databases and Data warehouse modeling
- Knowledge in Cloud based data engineering and Machine Learning Models
- Knowledge in building APIs for application integration
- Experience with various frameworks and processes, such as Agile
- Determine transformation requirements and develop processes to bring structured and unstructured data from the source to a new physical Data Model
- Implement strategies for cleaning and preparing data for analysis, to develop data imputation algorithms, and optimize performance of big data and machine learning systems
Above average skills in:
- Big Data Engineering and Processing using Hadoop stack (Hadoop, Hive, HDFS, Spark and HBase etc.)
- Develop ETL/ELT processing using Apache Ni-Fi
- Strong background on SQL and databases
- Programming Skills in Python or Scala
- Data Analysis and Validation skills
- UI and AI development
Demonstrated ability to:
- Work in a dynamic, fast-paced, work environment
- Self-motivated with the ability to work under minimal direction
- To adapt to new technologies and learn quickly
- A passion for data and information with strong analytical, problem solving, and organizational skills
- Work in multi-functional groups, with diverse interests and requirements, to a common objective