Data engineer with Kafka and ELK
njoyn
Job Description
4+ years of professional experience in: software development and/or data engineering; and in working with relational databases including Oracle, Teradata, MySQL.
. 4+ years+ of experience in working with Hadoop ecosystem, i.e. Hadoop, Hive, Spark, Scala, Sqoop, Flume,
. Programming experience in Python, shell scripting (Mandatory)
. Hands on Experience with Kafka Streaming Platform (Mandatory
. Hands on Experience with ELK Stack and building reporting dashboards (Mandatory)
. Experience in Data Analysis
. Knowledge on Banking Domain/Products
. Experience with modern workflow/orchestration tools (e.g. Apache Airflow, Oozie, etc.)
. Experience working Data Observability within streaming platform would be a plus.
. Learning knowledge in GenAI, Azure Open AI, GPT
. Strong analytical abilities.
. Agile experience is required with Version One or Jira tool expertise
. Provide hands-on technical solutions to business challenges & translates them into process/ technical solutions
. Good knowledge of CI/CD and DevOps principles
. Deliver high quality work and adapt to new challenges, as an individual or as part of a team
. Excellent communication and thought leadership skills