Senior Data Platform Engineer
mitsogo
Job Description
- Architect and evolve the data layer to support high-throughput ingestion, real-time processing, and low-latency search across massive datasets.
- Evaluate existing search and storage platforms and drive modernization initiatives toward more scalable, performant, and cost-effective solutions.
- Design and implement optimized indexing, partitioning, and data structuring strategies for efficient querying and retrieval.
- Build and manage scalable data lake architectures that support advanced analytics, threat intelligence, and data science workflows.
- Define strategies for lifecycle management, retention, tiered storage, and cost optimization across the data platform.
- Ensure high availability, fault tolerance, and disaster recovery across distributed systems.
- Implement robust data security controls aligned with XDR and modern cybersecurity frameworks, ensuring data protection at rest and in transit.
- Collaborate closely with security engineering, backend teams, and data scientists to bridge raw telemetry ingestion with actionable insights.
- Continuously monitor platform performance and lead improvements in reliability, scalability, and operational efficiency.