Off-heap storage of cached windows. #48
Description
Garbage collection will ultimately become a problem as a user's data grows. While having a good stress testing suite will help us better place numbers with the claims, eventually, garbage collection of the longer-lived on-heap items like the windows and caches, is going to become a problem. We should investigate using different off-heap solutions like memcached which will allow the preservation of locality.