How to cache all static files during many requests?

[QThans]

Which package is the feature request for? If unsure which one to select, leave blank

None

Feature

To cache static files to speed up.

Motivation

Too slow now.

Ideal solution or implementation, and any additional constraints

No

Alternative solutions or implementations

No response

Other context

No response

[janbuchar]

Hi @QThans and thanks for the question! Could you be a bit more specific?

• Are you using a headless browser? In that case, it should already cache files on its own.
• Could you provide an example of a website that is too slow to scrape? Or even better, a code snippet that we can run to reproduce the issue?
• Or do you want to cache the static files across multiple runs of the crawler?
• Are you running crawlee on your own infrastructure, or do you use Apify?