Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WXR import: Parallelize downloading media files #100

Open
adamziel opened this issue Apr 16, 2024 · 0 comments
Open

WXR import: Parallelize downloading media files #100

adamziel opened this issue Apr 16, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@adamziel
Copy link
Collaborator

adamziel commented Apr 16, 2024 •
edited
Loading

Sequential download of all the media files in a WXR file is super slow – let's parallelize it at PHP level using stream_select. This repo already ships an AsyncHttp library that's perfect for solving this issue:

CleanShot 2024-04-16 at 11 30 00@2x

Note this is related to Site Transfer Protocol.

cc @dmsnell
@adamziel adamziel added the enhancement New feature or request label Apr 16, 2024
adamziel added a commit to WordPress/wordpress-playground that referenced this issue Apr 16, 2024
@adamziel
WXR Import: Allow media files from wpthemetestdata.files.wordpress.com
0da3f0a 
Enables fully importing the Theme Unit Testing WXR file by tunneling all
the media files through plugin-proxy.php.

This PR, unfortunately, cannot be merged – there is so many media files
that the import takes more than 15 minutes to complete (I actually gave
up at the 15 minute mark).

We'll need to resolve
WordPress/blueprints-library#100 first
@adamziel adamziel mentioned this issue Apr 16, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
1 participant
@adamziel