If you are going to use or explore Azure Data Factory then we suggest you start with version two. Version 2 allows us to use Azure data factory in the same fashion as a tradition ELT tool. It can fulfill organizational Data Warehouse needs though drag and drop activities.

Azure QuickStart Templates

Azure QuickStart Templates allow you to deploy Azure resources, including Data Factory, via Azure Resource Manager. These are templates built by Microsoft and their community partners and will help you build your solution faster. You can visit Azure GitHub and find available templates.

Here are some Data Factory templates available to you:

Copy data from Azure Blob Storage to Azure SQL Db with Stored

Copy data from Azure Blob Storage to Azure SQL

Two-Activity Chained Data Factory

Create a pipeline to transform data by running Hive

Azure Data Factory to copy data from Salesforce to Azure

Copy data from one folder to another folder in an Azure Blob

Copy data from on-premises SQL Server to Azure Blob

Provision Azure SSIS integration

Copy data from one folder to another folder in an Azure Blob Storage

Creating Data Factory Pipeline

As you can see, there are plenty of applications for Data Factory. So lets see one!

We are going to go through an example of moving our data from Amazon S3 to an Azure Database using Azure Data Factory. This will demonstrate the power and convenience of Data Factory. The process we will go through is very common and we are hoping that it will help you in your next data migration.

The architecture we are aiming to accomplish will look like the following: