Data Engineer

We are looking for a Data Engineer with passion for building data pipelines, working with product, data science and business intelligence teams and delivering great solutions. As a part of the team you:-

• Acquire deep business understanding on how SPAN data flows from IoT device to cloud through the system and build scalable and optimized data solutions that impact many stakeholders.

• Be an advocate for data quality and excellence of our platform.

• Build tools that help streamline the management and operation of our data ecosystem.

• Ensure best practices and standards in our data ecosystem are shared across teams.

• Work with teams within the company to build close relationships with our partners to understand the value our platform can bring and how we can make it better.

• Improve data discovery by creating data exploration processes and promoting adoption of data sources across the company.

• Have a desire to write tools and applications to automate work rather than do everything by hand.

• Assist internal teams in building out data logging, alerting and monitoring for their applications

• Are passionate about CI/CD process.

• Design, develop and establish KPIs to monitor analysis and provide strategic insights to drive growth and performance.

About You

Required Qualifications

Bachelor's Degree in a quantitative discipline: computer science, statistics, operations research, informatics, engineering, applied mathematics, economics, etc.

• 2 - 5 years of relevant work experience in data engineering, business intelligence, research or related fields.

• Expert level production-grade, programming experience in at least one of these languages (Python, Kotlin, or other JVM based languages)

• Experience in writing clean, concise and well structured code in one of the above languages.

• Experience working with Infrastructure-as-code tools: Pulumi, Terraform, etc.

• Experience working with CI/CD systems: Circle-CI, Github Actions, Argo-CD, etc.

• Experience managing data engineering infrastructure through Docker and Kubernetes

• Experience working with latency data processing solutions like Flink, Prefect, AWS Kinesis, Kafka, Spark Stream processing etc.

• Experience with SQL/Relational databases, OLAP databases like Snowflake.

  • Experience working in AWS: S3, Glue, Athena, MSK, EMR, ECR etc.