Azure Data Factory quick start using templates

It is a common practice for business organizations to utilize repeat business processes. It is important to be able to start quickly with repetitive workflows. For this reason, Microsoft Azure now provides support for templates in Azure Data Factory. Templated setups improve developer productivity along with reducing development time for repeat processes.

The new feature enables a template gallery that has a variety of use-case based templates, data movement templates, SSIS templates or transformation templates that enable hands-on experience building data factory pipelines.

Get started with Azure Data Factory templates

Getting started is simple: click Create pipeline from template on the Overview page.

Azure Data Factory quick start using templates

or Pipeline from template on the Author page in your data factory.

Get started with Azure Data Factory templates

Select any template from the gallery and add the necessary actions.

Select any template from Azure Data Factory gallery

It is also possible to create new connections or compute when doing the template inputs.

create new connections when doing the template inputs.

Clicking on Use this template takes to the validation output that guides through filling in the properties required to run the pipeline.

Azure data factory - filling in the properties required to run the pipeline.

Template functionality also provides the possibility to save existing pipelines as templates.

Azure Data Factory Template functionality

GIT integration (Azure Dev Ops GIT or GitHub) in the data factory is required to be able to save existing pipelines as templates.

GIT integration (Azure Dev Ops GIT or GitHub) in the data factory

The template is saved in the GIT repo under the templates folder.

template is saved in the GIT repo under the templates folder

template is saved in the GIT repo under the templates folde

The template can be seen in the Templates section of the resource explorer.

Azure template can be seen in the Templates section of the resource explorer.

The new template is also available in the My templates section in the template gallery.

In the My templates section you can find the new template

The newly created template generates two files in the repository – an ARM template and a manifest file. The ARM file contains all the information about the data factory pipeline while the manifest contains the template metadata.

Further reading

Request a demo to speak with one of our engineers.

Ready to get started? Get in touch or schedule a demo.