About the Role** We are seeking an experienced Azure Databricks Developer to join our team. The ideal candidate will be responsible for designing and implementing large-scale migration pipelines from on-premises systems to Azure Data Lake Storage (ADLS). This role involves developing user interfaces using Scala and Terraform, generating data pipelines in Azure ADF, and performing analytics for stakeholders. The position requires a strong focus on ensuring reliable handling of high-volume unstructured data with performance and cost-efficiency, as well as implementing data quality checks to support audit and compliance needs. **Responsibilities** - Design and implement migration pipelines to Azure Data Lake Storage. - Develop user interfaces using Scala and Terraform for pipeline management. - Generate and manage data pipelines in Azure ADF. - Perform data analytics to support stakeholder needs. - Ingest data from various sources using Azure ADF. - Ensure efficient and reliable handling of high-volume unstructured data. - Implement data quality checks, logging, and traceability. - Transform data using Azure Databricks and Delta Lake. - Utilize Azure DevOps for CI/CD, including managing stories, bugs, and issues. - Conduct data analysis to troubleshoot and resolve data-related issues. - Work as an individual contributor and problem solver in agile development projects. **Education Qualification** - Bachelor's degree in Computer Science, Information Technology, or a related field. **Required Skills** - 7+ years of experience in data warehousing. - Proficiency in querying databases and analyzing data. - Experience in developing complete data warehouse solutions. - Hands-on experience with Scala UI development. - Strong knowledge of Azure Databricks, Scala, Azure Data Factory (ADF), and Terraform. - Experience in agile development projects and sprint delivery. - Ability to write complex queries, including joins and duplicate records identification.

The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, paid time off, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, and paid holidays annually – as applicable.