Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add proper CMake build for extension_parallel #8938

Merged
merged 7 commits into from
Mar 5, 2025
Merged

Conversation

swolchok
Copy link
Contributor

@swolchok swolchok commented Mar 4, 2025

Previously it was copied in several places per executorch_srcs.cmake.

Needed for #8932

Test Plan: Compare cmake-out/executorch_srcs.cmake before/after for my usual testing cmake config with "all the CPU stuff" on; found that thread_parallel.cpp is now duplicated only in one place instead of multiple (it's in llama_runner, which needs a general fixup because it's duplicating several extensions).

[ghstack-poisoned]
@swolchok swolchok requested a review from kirklandsign as a code owner March 4, 2025 19:35
Copy link

pytorch-bot bot commented Mar 4, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/8938

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 9fdebee with merge base 5dd96c3 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 4, 2025
swolchok added a commit that referenced this pull request Mar 4, 2025
Previously it was copied in several places per executorch_srcs.cmake.

Needed for #8932

Test Plan: Compare cmake-out/executorch_srcs.cmake before/after for my usual testing cmake config with "all the CPU stuff" on; found that thread_parallel.cpp is now duplicated only in one place instead of multiple (it's in llama_runner, which needs a general fixup because it's duplicating several extensions).

ghstack-source-id: 333d1c9787f197b7c9163521af19cee4753426df
ghstack-comment-id: 2698715235
Pull Request resolved: #8938
Copy link
Contributor

@larryliu0820 larryliu0820 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What is the difference between extension_threadpool and extension_parallel?

@swolchok
Copy link
Contributor Author

swolchok commented Mar 4, 2025

What is the difference between extension_threadpool and extension_parallel?

extension_threadpool lives in extension/threadpool, and extension_parallel lives in extension/parallel. they're different code.

@swolchok
Copy link
Contributor Author

swolchok commented Mar 4, 2025

fixed tests -- forgot to git add extension/parallel/CMakeLists.txt

[ghstack-poisoned]
@swolchok swolchok requested a review from kimishpatel as a code owner March 4, 2025 20:30
swolchok added a commit that referenced this pull request Mar 4, 2025
Previously it was copied in several places per executorch_srcs.cmake.

Needed for #8932

Test Plan: Compare cmake-out/executorch_srcs.cmake before/after for my usual testing cmake config with "all the CPU stuff" on; found that thread_parallel.cpp is now duplicated only in one place instead of multiple (it's in llama_runner, which needs a general fixup because it's duplicating several extensions).

ghstack-source-id: d4917831ebe5f00628b1ffcbda8f92a08f0e9457
ghstack-comment-id: 2698715235
Pull Request resolved: #8938
[ghstack-poisoned]
swolchok added 4 commits March 4, 2025 18:23
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
[ghstack-poisoned]
swolchok added a commit that referenced this pull request Mar 5, 2025
Previously it was copied in several places per executorch_srcs.cmake.

Needed for #8932

Test Plan: Compare cmake-out/executorch_srcs.cmake before/after for my usual testing cmake config with "all the CPU stuff" on; found that thread_parallel.cpp is now duplicated only in one place instead of multiple (it's in llama_runner, which needs a general fixup because it's duplicating several extensions).

ghstack-source-id: d09bf5e6c6561574999d81b13b3fa3d363639596
ghstack-comment-id: 2698715235
Pull Request resolved: #8938
@swolchok swolchok merged commit cca6917 into main Mar 5, 2025
50 checks passed
@swolchok swolchok deleted the gh/swolchok/306/head branch March 5, 2025 18:08
zonglinpeng pushed a commit that referenced this pull request Mar 6, 2025
Previously it was copied in several places per executorch_srcs.cmake.

Needed for #8932

Test Plan: Compare cmake-out/executorch_srcs.cmake before/after for my usual testing cmake config with "all the CPU stuff" on; found that thread_parallel.cpp is now duplicated only in one place instead of multiple (it's in llama_runner, which needs a general fixup because it's duplicating several extensions).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. release notes: build Changes related to build, including dependency upgrades, build flags, optimizations, etc.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants