Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.