Sr. Cloud Data Engineer
adp
Job Description
- Build scalable data pipelines for batch and streaming workloads using technologies such as Spark, Databricks, Airflow, and dbt.
- Process healthcare data including HL7, FHIR, X12/EDI, CCD/CCDA, and flat-file formats.
- Build cloud lakehouse solutions using S3/ADLS, Delta Lake, Apache Iceberg, or Hudi, along with modern cloud data warehouses i.e. Snowflake, Redshift
- Improve data quality through automated validation, cleansing, de-duplication, schema validation, and quarantine workflows.
- Support identity resolution and master data by integrating patient/member, provider, subscriber, and reference data with MPI/EMPI capabilities.
- Modernize legacy integrations into reusable, configuration-driven, event-based, streaming, and API-based patterns.
- Build for production reliability with monitoring, alerting, audit logging, data lineage, security, and operational observability.
- Collaborate across teams to translate architecture into well-tested, production-grade solutions that meet healthcare security and compliance requirements.