REEF, Tang and Wake version 0.8 are on their way to maven central. As always, this release contains general improvements and bug fixes, but also a few nice new features:
- Tang now supports Lists. This is a welcome addition for when Sets just don’t cut it for your application. Note that because of their semantics, lists are treated as atomic units: You can only bind them once, just like strings or numbers.
- The local runtime now issue process start and end events. Prior to this, you wouldn’t get a FailedEvaluator when a task calls the equivalent of System.exit(0). Now you do.
- The local runtime now uses symbolic links instead of copies for files. This speeds up the tests quite a bit.
- Classpaths are now assembled in a way that is compatible with current as well as outdated YARN installations. This resolved an issue reported on the mailing list where REEF examples wouldn’t run on e.g. the Hortonworks sandbox.
- More work towards Evaluator-preserving Driver restarts. The Evaluators now successfully re-establish connection with the Driver.