Senior Technology Engineer
d4insight
Job Description
Cloudera & Data Platform Administration
- Provide hands-on Tier-2 production support for Cloudera Data Platform (CDP).
- Install, configure, maintain, and optimize the Cloudera environment.
- Install and maintain the latest supported CDP version, including CDP 7.1.9 or later and associated Cloudera Data Services.
- Support ongoing platform maintenance and operational stability.
Security & Compliance
- Implement and maintain security requirements for CDP.
- Automate security and regulatory checks.
- Support secure operation of the enterprise data platform.
Performance Engineering
- Optimize Cloudera cluster performance.
- Work closely with data engineering teams to optimize Spark job performance.
- Troubleshoot:
- Spark jobs
- Hive jobs
- YARN jobs
- Drive platform optimization and service reliability.
Containerization
- Implement CDP containerization with data services.
- Work with container technologies and enterprise container-management platforms.
- Support Kubernetes/OpenShift-based environments.
Automation & CI/CD
- Build automated pipelines and workflows for data projects.
- Use tools such as:
- GitHub Actions
- Jenkins
- ArgoCD
- Similar CI/CD technologies
- Python-based automation is preferred.
- Drive automated patching and platform observability.