By far Azkaban was the most appropriate. We're investigating coupling it with Goblin and https://github.com/linkedin/WhereHows which has native integration.
Apache NiFi looks interesting as well, but we haven't looked at it yet.
