Universal Pathlib
Universal Pathlib is a python library that aims to extend Python's built-in pathlib.Path api to use a variety of backend filesystems using fsspec
Installation
Pypi
python -m pip install universal_pathlib
conda
conda install -c conda-forge universal_pathlib
Basic Usage
>>> from upath import UPath
>>>
>>> s3path = UPath("s3:/test_bucket") / "example.txt"
>>> s3path.name
example.txt
>>> s3path.stem
example
>>> s3path.suffix
.txt
>>> s3path.exists()
True
>>> s3path.read_text()
Hello World
For more examples, see the example notebook here
Currently supported filesystems (and schemes)
file: Local filessystem
memory: Ephemeral filesystem in RAM
az:, adl:, abfs: and abfss: Azure Storage (requires adlfs to be installed)
http: and https: HTTP(S)-based filesystem
hdfs: Hadoop distributed filesystem
gs: and gcs: Google Cloud Storage (requires gcsfs to be installed)
s3: and s3a: AWS S3 (requires s3fs to be installed)
webdav+http: and w
|