Deploy Azure Data Factory Pipeline
Introduced in v4.0
Azure Data Factory
Azure Data Factory, in short ADF, is a cloud-based data integration service
provided by Microsoft as part of the Azure ecosystem. It enables users to create,
schedule, and manage data pipelines for moving and transforming data across
different storage and processing services. Azure Data Factory serves as an
Extract, Transform, Load (ETL) tool that allows organizations to ingest data from
various sources, perform data transformations, and load transformed data into
databases, data warehouses, or other target destinations. With its monitoring
dashboards and alerts, users can track pipeline activities and handle data
integration tasks effectively.
Pre-requisites
Before configuring the sample pipeline for data integration from Azure Data
Factory, ensure you have the following pre-requisites in place –
- Users need to have Azure Subscription to create a pipeline.
- Users can create Azure Data Factory using this link :- Create a new data factory.
- Users need to deploy azure function present in sample attached/downloaded
(sample/Azure-Qpp-tokenGeneration) to generate QPP token in its resource
created for Azure Data Factory with the help of this link.
Note:- This document is created using the example of Azure Devops Query
Execution API.
Steps to configure sample pipeline in ADF
Follow these steps to configure a sample pipeline for data integration from
Azure Data Factory to QPP NextGen –
- Log in to the Azure Portal using your Azure account credentials.
- Once logged in, navigate to the Data Factories in the Azure Portal, select the created Data Factory and launch the Azure Data Factory Studio.

- Now navigate to the Author tab in Data Factory Studio (represented by the pencil icon), then click the + sign and choose Pipeline from the menu, and Pipeline again from the submenu.

- Then click the icon highlighted in the screenshot below

- Copy the JSON from the file present in sample attached/downloaded (file path: – sample/AzureDevopsQueryResultToCSVPipleine.json) and paste here as mentioned in the screenshot and also change the name of the pipeline in the JSON.

- Once JSON is copied, you’ll be able to see the variables in the Variables tab
of the pipeline.

To get Azure devops query related variables, you can refer to the postman collection present in sample attached/downloaded (file path: sample/Azure Devops API’s.json).
- You need to provide PAT (personal access token) to run the azure devops query in Get Query Result and ExecuteURL activity settings.

- To use the Azure Function that user deployed, one Azure Function Linked Service will be created. They can configure this using this link.





