Tag: azure data factory
Split the Text files using ADF Pipelines
Inkey, November 29, 2024124 Views
Requirements: If the file size of an Excel file exceeds the specified criteria, we need to address the following: The Excel file contains multiple sheets, and these sheets contain inter-related data. We utilize SQL Views to retrieve data from these sheets using the “Get Data” activity in Excel. Although we can split the Excel file […]
Read moreCopying Excel files from source to destination in Excel format using ADF Pipeline
Inkey, August 16, 2024435 Views
As Azure Data Factory (ADF) does not offer Excel as a sink option, an alternative method is required to copy Excel files using ADF pipelines. Implementation Step 1: Utilize the “Get Metadata” activity to retrieve the list of files stored in the blob storage. Select the “Child Items” option from the field list to include […]
Read moreDynamically copying all types of files, including Excels, JSON, CSV, and TXT, using a single copy data activity in ADF
Inkey, August 2, 2024493 Views
The objective is to copy various types of files, including JSON, CSV, Text, and Excel files, using a single Copy data activity in Azure Data Factory (ADF) pipeline. Implementation: Step 1: Utilize the “Get Metadata” activity to retrieve the list of files stored in the blob storage. Select the “Child Items” option from the field […]
Read moreImplementing ADF Branches and Filters for Employee Training
Inkey, March 22, 2024472 Views
In one organization, there is one analysis of employee’s performance on different technologies based on the technologies they know and ratings from their manager. If they don’t meet the required criteria, then that employee will get training for those technologies. Input: emp_id MSBI PowerBI ratings from the manager 101 null x 3 101 null null […]
Read more
