Filesystems

Interface

FileInfo	FileSystem entry info.
FileSelector	File and directory selector.
FileSystem	Abstract file system API.

Concrete Subclasses

LocalFileSystem	A FileSystem implementation accessing files on the local machine.
S3FileSystem	S3-backed FileSystem implementation
SubTreeFileSystem	Delegates to another implementation after prepending a fixed base path.

To define filesystems with behavior implemented in Python:

PyFileSystem	A FileSystem with behavior implemented in Python.
FileSystemHandler()	An abstract class exposing methods to implement PyFileSystem’s behavior.
FSSpecHandler(fs)	Handler for fsspec-based Python filesystems.

pyarrow.parquet.write_to_dataset pyarrow.fs.FileInfo