Bit of a metaissue, partially external to daps_utils:
- we need to set up a
data-engineering-cookiecutter repo which calls all of the scripts from daps_utils in order to setup a new daps on demand.
- Before doing this we will need to work out how to set up the whole infrastructure (metaflow, batch, s3, mysql, other?) using terraform so that we can include that in the script.
- Good docs are a necessity
Bit of a metaissue, partially external to
daps_utils:data-engineering-cookiecutterrepo which calls all of the scripts fromdaps_utilsin order to setup a new daps on demand.