streaming.base.storage

Base module for downloading/uploading files from/to cloud storage.

Classes

AlipanDownloader	Download files from Alipan to local filesystem.
AzureDataLakeDownloader	Download files from Azure Data Lake to local filesystem.
AzureDataLakeUploader	Upload file from local machine to Microsoft Azure DataLake.
AzureDownloader	Download files from Azure to local filesystem.
AzureUploader	Upload file from local machine to Microsoft Azure bucket.
CloudDownloader	Download files from remote storage to a local filesystem.
CloudUploader	Upload local files to a cloud storage.
DBFSDownloader	Download files from Databricks File System to local filesystem.
DatabricksUnityCatalogDownloader	Download files from Databricks Unity Catalog to local filesystem.
GCSDownloader	Download files from Google Cloud Storage to local filesystem.
GCSUploader	Upload file from local machine to Google Cloud Storage bucket.
HFDownloader	Download files from Hugging Face to local filesystem.
HFUploader	Upload file from local machine to a Huggingface Dataset.
LocalDownloader	Download files from local filesystem to local filesystem.
LocalUploader	Copy file from one local directory to another local directory.
OCIDownloader	Download files from Oracle Cloud Infrastructure to local filesystem.
OCIUploader	Upload file from local machine to Oracle Cloud Infrastructure (OCI) Cloud Storage.
S3Downloader	Download files from AWS S3 to local filesystem.
S3Uploader	Upload file from local machine to AWS S3 bucket (or any S3 compatible object store).
SFTPDownloader	Download files from SFTP to local filesystem.