Senior Data Engineer I
alterdomus
Job Description
· Lead integration of Fenergo APIs to extract KYC and AML data, ensuring seamless connectivity between systems.
· Design, develop, and maintain scalable data pipelines and ETL processes for data ingestion from databases, APIs, and flat files.
· Implement data processing pipelines using Databricks, Apache Spark, DataFrames, and Medallion Architecture, leveraging AI tools for optimization.
· Conduct regular data quality assessments, audits, and root cause analysis to ensure data integrity and compliance with industry standards.
· Architect and develop interactive Power BI dashboards and reports, translating complex data into actionable insights for clients, leadership, and stakeholders.
· Create visual representations of KPIs and operational metrics for KYC/AML processes for regular reporting to clients and senior management.
· Maintain comprehensive documentation of data processes, API integrations, data flows, governance practices, and reporting solutions for compliance.
· Proactively resolve data-related issues, ensuring timely and accurate reporting.
· Implement data validation, quality control measures, and monitoring processes to ensure reliability throughout all pipelines.