Sometimes it is useful to load datasets from different filesystem locations, for example if one folder contains hand-curated data and another contains automatically generated data.
In code, it would be pretty simple to handle this. Instead of
from espei.datasets import load_datasets, recursive_glob
directory = '/path/to/directory/'
load_datasets(recursive_glob(directory))
we could do
from itertools import chain
from espei.datasets import load_datasets, recursive_glob
directories = ['/path/to/directory_1/', '/path/to/directory_2/']
load_datasets(chain(*map(recursive_glob, directories)))
Sometimes it is useful to load datasets from different filesystem locations, for example if one folder contains hand-curated data and another contains automatically generated data.
In code, it would be pretty simple to handle this. Instead of
we could do