Azure Data Lake Storage Gen2 Python SDK

This skill provides comprehensive functionality for interacting with Azure Data Lake Storage Gen2 (ADLS Gen2) using its official Python SDK. It enables developers to manage hierarchical file systems, which are crucial for big data analytics workloads. The SDK supports a wide range of operations from account-level management down to individual file and directory manipulation.

Leverage this skill to perform common tasks such as creating and deleting file systems, managing directories (creation, deletion, renaming), and handling files (uploading, downloading, appending data, deleting). It also includes advanced features like listing contents recursively, managing file and directory properties, and configuring Access Control Lists (ACLs) for fine-grained permissions. The skill demonstrates both synchronous and asynchronous client usage for various performance requirements.

What It Does

This skill allows an AI agent to programmatically interact with Azure Data Lake Storage Gen2. It can perform operations such as:
- **File System Management**: Create, get, delete, and list file systems (containers).
- **Directory Operations**: Create, get, delete, rename, and move directories.
- **File Operations**: Upload, download, append data to, and delete files.
- **Content Listing**: List files and directories, including recursive listings.
- **Metadata & Properties**: Retrieve and set custom metadata and properties for files/directories.
- **Access Control**: Get, set, and update Access Control Lists (ACLs) for granular permissions.
- **Asynchronous Operations**: Execute operations asynchronously for improved performance in high-throughput scenarios.

When To Use

Use this skill when you need to:
- Manage data in Azure Data Lake Storage Gen2 from a Python application or script.
- Work with hierarchical file systems for big data analytics, machine learning, or data warehousing.
- Automate file and directory management tasks in ADLS Gen2.
- Integrate ADLS Gen2 operations into CI/CD pipelines or data processing workflows.
- Implement fine-grained access control on your data lake resources.
- Perform high-throughput data transfers using asynchronous operations.

Limitations

Installation

Add to .cursor/skills/

Add to Copilot workspace settings

Configure in .aider.conf.yml

Copy to ~/.claude/skills/

Add to .vscode/skills/