DATA ENGINEER I

Databricks Data Engineering Support

• Support the design, development, testing, and maintenance of data pipelines and curated datasets on the Databricks platform.
• Develop and maintain datasets for reporting, analytics, dashboards, and business performance tracking.
• Use SQL, Python, and PySpark to transform, validate, and prepare data for analytics.
• Assist in troubleshooting data pipeline and reporting issues.
• Follow established development, testing, and release management standards.

BI Data Products & Reporting

• Build and maintain reusable datasets for Power BI, Tableau, and other analytics tools.
• Partner with BI analysts to understand reporting requirements, KPIs, and business rules.
• Create reporting tables, views, and data marts to support dashboard development.
• Validate data accuracy and ensure reporting outputs meet business needs.

Data Modeling & Data Quality

• Support the development of fact tables, dimension tables, reporting views, and curated data marts.
• Apply data modeling concepts such as star schema, keys, joins, dimensions, and measures.
• Perform data validation, reconciliation, and quality checks.
• Investigate and help resolve data discrepancies and reporting issues.
• Document data structures, business rules, and validation results.

Technical Development

• Write and optimize SQL queries for data extraction, transformation, and analysis.
• Use Python or PySpark for automation and data processing.
• Develop maintainable and well-documented code.
• Participate in code reviews and follow engineering best practices.

Version Control & Cloud Technologies

• Use Git for version control and collaboration.
• Follow team processes for code reviews, releases, and documentation.
• Gain experience working within AWS-based data environments.
• Support validation and migration activities involving Amazon Redshift and Databricks.

Governance & Collaboration

• Follow data governance, security, and documentation standards.
• Support data lineage, metadata management, and access controls.
• Work closely with data engineers, BI analysts, product owners, and business stakeholders.
• Participate in requirements gathering, testing, and release activities.
  • Communicate progress, challenges, and data-related issues effectively while contributing to a collaborative team environment.