Engineering

Sr Data Engineer

Ahmedabad/Pune   |   Full Time
We are looking for a data engineering professional with strong experience in designing and implementing end-to-end ETL solutions using Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Databricks, and SSIS. The candidate should be proficient in SQL, REST API integration, and automation through CI/CD pipelines using Azure DevOps and Git. They should also have a solid understanding of maintaining and optimizing data pipelines, warehouses, and reporting within the Microsoft SQL stack.

Job Title: Sr. Data Engineer  
Location: Ahmedabad/Pune
Experience: 5 + Years
Educational Qualification: UG:  BS/MS in Computer Science or other engineering/technical degree

Roles and responsibilities:

  • Design and implement end-to-end data solutions using Microsoft Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS), Azure Databricks, and SSIS.

  • Develop complex transformation logic using SQL Server, SSIS, and ADF, and develop ETL Jobs/Pipelines to execute those mappings concurrently.

  • Maintain and enhance existing ETL Pipelines, Warehouses, and Reporting leveraging traditional MS SQL Stack

  • Understanding of REST API principles and creating ADF pipelines to handle HTTP requests for APIs.

  • Well-versed with best practices for development, deployment of SSIS packages, SQL jobs, and ADF pipelines.

  • Implement and manage source control practices using GIT within Azure DevOps to ensure code integrity and facilitate collaboration

  • Participate in the development and maintenance of CI/CD pipelines for automated testing and deployment of BI solutions


Preferred skills, but not required:

  • Understanding of the Azure environment and developing Azure Logic Apps and Azure Function Apps. 

  • Understanding of Code deployment, GIT, CI/CD, and deployment of developed ETL code (SSIS, ADF).

Submit Your Application

You have successfully applied
  • You have errors in applying