Senior Software Engineer
peoplestrong
Job Description
3in1 Data Tech team manages data which is consumed by applications like- 3in1 App/web, Customer 360, IVR and other digital channels. To provide timely delivery and to manage data integrity between source system and Cosmos DB resources are required. |
|
| Duties and Responsibilities | 1. ETL Development Design and develop ETL pipelines to transfer data from source systems (Data Lake) to target systems (NoSQL or RDBMS). Develop Azure Functions to capture and process data modifications occurring in Cosmos DB collections, as required. 2. Reconciliation Development and Analysis Develop reconciliation logic to compare data between source systems (Data Lake) and target systems (NoSQL or RDBMS). Analyse reconciliation reports and investigate discrepancies or data issues identified during validation. 3. Code Review Review code developed by junior team members and provide constructive feedback to improve code quality, correctness, and performance optimization. 4. Support Provide operational support for ETL and reconciliation job failures. Identify and resolve data or code-related issues causing job failures in ETL or reconciliation processes. Provide timely support to API and application teams as required. 5. Cosmos DB Monitoring Monitor Cosmos DB for RU consumption, throttling, and overall performance. Analyse logs and metrics to identify and troubleshoot potential issues proactively. 6. IT Requests Coordinate with the Tech-Ops team to track, follow up, and close IT service requests. Ensure timely resolution of user-related queries and operational requests. 7. BRD Discussion Conduct initial-level requirement discussions with business stakeholders for new initiatives or enhancements. |
| Key Decisions / Dimensions | 1. When to repair and execute the failed job and when to modify the code to mitigate the issue. |
| Major Challenges | 1. Will have to gain knowledge and enhance technical skill set to carry out day-to-day tasks. 2. Will need to handle Support tasks without impacting development timeline. |
| Required Qualifications and Experience | a) Qualifications B.E, MCA, M.E, B.Tech/M.Tech in Computer Science. b) Work Experience Total 7-8 Years experience with relevant Technology skills c) Skills Keywords DataBricks, PySpark, SQL, Scala/Java, NoSQL. |