Data Engineer
global
Job Description
• Experience with Big Data Technologies or Cloud Technologies building data
pipelines
• DevOPs Experience (source control, continuous integration, deployments, etc.)
• Experience with containerization and related technologies (e.g. Docker, Kubernetes)
• Experience in other open-sources like Druid, Elastic Search, Logstash etc
• Advanced knowledge of the Hadoop ecosystem and Big Data technologies
• Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)
• System level understanding
- Data structures, algorithms, distributed storage & compute
• Exposure and / or development experience in Microservices Architectures best practices
• Experience around REST APIs, services, and API authentication schemes
• Knowledge in RDBMS and NoSQL technologies
Minimum Skills Required: 3+ years of the following experience:
• Experience with Big Data Technologies or Cloud Technologies building data
pipelines
• DevOPs Experience (source control, continuous integration, deployments, etc.)
• Experience with containerization and related technologies (e.g. Docker, Kubernetes)
• Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)"