Data Factory > azure-storage-blob-list

TL;DR;

This task lists all the blobs present in a container within an Azure storage account.

Name:

Max execution time: 120 mins

TIP

The full documentation of the behavior of this task is detailed in the Learning Center.

Technical details

Available logs

Code	Message	Metadata	Type	Remarks
INVALID_ARGUMENT	The provided input contains errors.	input parameter	error	The task ends in failure.
FILE_SIZE_UNDEFINED	File size is undefined.	filename	warning	The task continues and tries to download the file. Log appears only when the file download succeeded.
FILE_DOWNLOAD_ERROR	Failed to download file	filename	error	The task continues with next file in the list.
FILE_UPLOAD_ERROR	No name passed for blob; No url passed for blob; Could not determine content type; Blob client upload error	filename	error	The task continues with next file in the list.
FILE_SIZE_EXCEEDED	Total files size exceeds maximum allowed; Too many files in a single request	limit	error	When the limit is reached the task stops, returns success, but does not try to upload any remaining file.

Note that in case of any other error (authentication fails, container not found, etc.), the task ends in success, and a generic error log is generated with a message describing the issue.

Known limitations

• The Properties/ Content-MD5 property is not always present in the listing file
• Storage accounts with more than 100 000 files are not managed.
• The maximum number of files to list per job is 1000.
• The maximum size of all files to list per job is 20000 MB.