Roles and responsibilities:
Design and implement end-to-end data solutions using Microsoft Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS), Azure Databricks, and SSIS.
Develop complex transformation logic using SQL Server, SSIS, and ADF, and develop ETL Jobs/Pipelines to execute those mappings concurrently.
Maintain and enhance existing ETL Pipelines, Warehouses, and Reporting leveraging traditional MS SQL Stack
Understanding of REST API principles and creating ADF pipelines to handle HTTP requests for APIs.
Well-versed with best practices for development, deployment of SSIS packages, SQL jobs, and ADF pipelines.
Implement and manage source control practices using GIT within Azure DevOps to ensure code integrity and facilitate collaboration
Participate in the development and maintenance of CI/CD pipelines for automated testing and deployment of BI solutions
Preferred skills, but not required:
Understanding of the Azure environment and developing Azure Logic Apps and Azure Function Apps.
Understanding of Code deployment, GIT, CI/CD, and deployment of developed ETL code (SSIS, ADF).