Feature request: support UAST cache

[vmarkovtsev]

It would be great to have an ability to load UASTs from disk instead of parsing files every time. This is critical for ML benchmarks and quality evaluations, where we can analyze 1,000 predefined repositories at the same revisions. Thus we would have more stable timings, more stable experience (some driver may crash, e.g. cpp, or parse differently, e.g. js) and also run faster.

[carlosms]

ping @smola @src-d/product.

[smacker]

are we talking about UAST parsing for the content of pull requests or about the proxy to bblfshd?

[vmarkovtsev]

I meant UASTs which are supplied by the data service built into lookout-sdk binary.

[smacker]

thanks! just a note for Santiago and product:
We can implement caching in lookout itself to avoid parsing the same files for each analyzer and make backend configurable.
So lookout can store them in memory for a short period of time (analyzers are going to request uasts only after the event) and for sdk-bin we can use cache on disk that would solve this issue.