I’ve not checked in the v3+ version but there used to be a preload page generator that batch retrieved stuff from the API. Then pass the preloaded page object on to the parallel processing part.

On Mon, Mar 27, 2023 at 3:58 PM Roy Smith <roy@panix.com> wrote:

I need to issue a bunch of Page.get() requests in parallel. My understanding is that pywikibot uses the requests library which is incompatible with async_io, so that's out. So what do people use? Threading? Or, I see there's an async_io friendly requests port. Is there a way to make pywikibot use that?

_______________________________________________
pywikibot mailing list -- pywikibot@lists.wikimedia.org
Public archives at https://lists.wikimedia.org/hyperkitty/list/pywikibot@lists.wikimedia.org/message/QDE2AHAX4O6G5YTHLGGKWK5LLKKRYUST/
To unsubscribe send an email to pywikibot-leave@lists.wikimedia.org