- Pin Redis to 2.x
- Adds ability to provide a custom callback to the Part context manager in place of sending a reduce message
- Modify the Part context manager to ensure the reduce message gets sent only once per job
- Send SNS messages in batch using boto3 thread safe method
- add a utils module
- Implement delete method for redis backend
- Pass kwargs to redis connection
- raise exception for missing jobid
- Refactor WatchbotProgress class to provide pluggable backends (#12)
- Implement a Redis backend (#13)
- Command line interface tools rewritten to use the backend interface.
- BREAKING CHANGE: the
Partcontext manager will not fail the entire job by default. - Added
fail_job_on, a list exceptions which will mark the job failed.
watchbot-progress-pycommand line interface for tracking jobs
- send metadata with map and reduce messages #5
- implement
set_metadatamethod to associate an arbitrary mapping to a job - pass
metadatakwarg tocreate_job