Senior Technology Engineer

d4insight

Bengaluru 8 Years Exp Posted 2h ago

Job Description

Cloudera & Data Platform Administration

  • Provide hands-on Tier-2 production support for Cloudera Data Platform (CDP).
  • Install, configure, maintain, and optimize the Cloudera environment.
  • Install and maintain the latest supported CDP version, including CDP 7.1.9 or later and associated Cloudera Data Services.
  • Support ongoing platform maintenance and operational stability.

Security & Compliance

  • Implement and maintain security requirements for CDP.
  • Automate security and regulatory checks.
  • Support secure operation of the enterprise data platform.

Performance Engineering

  • Optimize Cloudera cluster performance.
  • Work closely with data engineering teams to optimize Spark job performance.
  • Troubleshoot:
    • Spark jobs
    • Hive jobs
    • YARN jobs
  • Drive platform optimization and service reliability.

Containerization

  • Implement CDP containerization with data services.
  • Work with container technologies and enterprise container-management platforms.
  • Support Kubernetes/OpenShift-based environments.

Automation & CI/CD

  • Build automated pipelines and workflows for data projects.
  • Use tools such as:
    • GitHub Actions
    • Jenkins
    • ArgoCD
    • Similar CI/CD technologies
  • Python-based automation is preferred.
    • Drive automated patching and platform observability.