Maintains a directory of high water mark metrics for quality tools - used by https://github.com/apiology/quality and friends