S3: In memory object cache
-
Periodically remove items in async fashion from cache -
|-> persist them in async fashion if not persist yet -
Watch memory, limit memory usage -
Over-usage should cause persist&purge-from-memory action
-
Also, persist/flushes are quite slow, need to figure out an improvement. IDK, maybe parallel invocation (from layer above).