How to customize storage in HyperGBM?
HyperGBM store intermediate data (model files, cache data, etc.) in the work_dir, which is a subdirectory under your system temporary directory by default.
Customize the work_dir location
Create directory
conf
under the location where you starthypergbm
or your python scriptCreate file
storage.py
under theconf
directory, with the content:c.StorageCfg.root = '/your/full/path/for/work_dir'
Run
hypergbm
command or start your python script as normal
Use s3 compatible storage as HyperGBM work_dir
Install
s3fs
Create directory
conf
under the location where you starthypergbm
or your python scriptCreate file
storage.py
under theconf
directory, with the content:c.StorageCfg.kind = 's3' c.StorageCfg.root = '/bucket_name/some_path' c.StorageCfg.options = """ { "anon": false, "client_kwargs": { "endpoint_url": "your_service_address", "aws_access_key_id": "your_access_key", "aws_secret_access_key": "your_secret_access_key" } } """
Refer to s3fs for more installation and connection information.