Senior Data Engineer
unitedhealthgroup
Job Description
- Design, develop, test, and support scalable data pipelines and ETL/ELT solutions using Azure Databricks, PySpark, SQL, and cloud-native technologies
- Contribute to the NHI Cloud Modernization program by migrating and modernizing legacy Teradata, DataStage, Unix, and SAS-based data processing workloads to Azure Databricks and Snowflake
- Develop and maintain data ingestion, transformation, and data quality frameworks supporting Bronze, Silver, and Gold data layers within the enterprise lakehouse architecture
- Build reusable and optimized PySpark components, notebooks, and workflows to process large-scale healthcare claims, membership, provider, and ancillary datasets
- Implement monitoring, logging, alerting, exception handling, and operational automation to improve platform reliability and supportability
- Partner with product owners, business stakeholders, architects, and data consumers to understand requirements and deliver high-quality data products
- Support data governance, security, lineage, and access control processes in alignment with enterprise standards
- Perform performance tuning, workload optimization, and cost management of Databricks environments and data pipelines
- Participate in code reviews, technical design discussions, release activities, production support, and root-cause analysis of data platform issues
- Contribute to engineering best practices including CI/CD, automated testing, documentation, and operational excellence
- Leverage emerging AI-assisted engineering capabilities and automation opportunities to improve delivery speed, quality, and platform efficiency where appropriate
- Builder Responsibility:
- Design, develop, and deploy AI-powered solutions using no-code, low-code, and advanced platforms, translating business needs into scalable applications that enhance products, workflows, and decision-making
- Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
- Design, develop, and deploy AI-powered solutions using no-code, low-code, and advanced platforms, translating business needs into scalable applications that enhance products, workflows, and decision-making