Vignette: Strategies to optimize performance/memory usage

[trangdata]

Perhaps we could put together a vignette on different strategies to optimize openalexR's performance and to consolidate the many GH issue threads we have had:

• select = ...
• output = "list"
• oa_generate with save as .rds in chunks for (memory)
• ... (anything else? @yjunechoe)
• link to different issues, explain our thinking re breaking changes, backward compatibility, etc. (maybe this is a different vignette?)

[yjunechoe]

Maybe the last bullet point can be a different vignette (broadly covering "Reproducibility", perhaps?) but I agree!

If you want to divide the work I can write up the strategy I wrote about the other day - #271 (comment). I'm less familiar with the oa_generate() strategy though.

[rkrug]

I think this is a great idea, but I would advise against oa_generate(). I tried to use it, it took me a considerable time to implement it, and then I had a bug somewhere which I did not figure out how to use.

Adding "each page as json in a directory" would make the use of oa_generate() not necessary and, imho, easier to maintain. The usage of the data in that directory would be completely to the advanced user. But I really like this idea of a vignette on this topic.

[trangdata]

If you want to divide the work I can write up the strategy I wrote about the other day - #271 (comment)

That would be great! Do you want to start the vignette? and I will add the oa_generate part after? Thanks so much June!

[trangdata]

Completed in #277