Skip to content

[Not for landing] piggy back on titan for scale init test #841

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 9 commits into
base: gh/fduwjj/1/base
Choose a base branch
from

Conversation

fduwjj
Copy link
Contributor

@fduwjj fduwjj commented Feb 13, 2025

fduwjj added a commit that referenced this pull request Feb 13, 2025
ghstack-source-id: 8e8b5d5aab718d22305b61c98873b4da9872abe7
Pull Request resolved: #841
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Feb 13, 2025
@fduwjj fduwjj marked this pull request as draft February 13, 2025 05:58
fduwjj added a commit that referenced this pull request Feb 13, 2025
ghstack-source-id: 8852e63604fc363c10327b8cd997a5a40c3a7533
Pull Request resolved: #841
fduwjj added a commit that referenced this pull request Feb 13, 2025
ghstack-source-id: 1199eaf906caf29d623ec9c616f5ce8a687b3427
Pull Request resolved: #841
fduwjj added a commit that referenced this pull request Feb 13, 2025
ghstack-source-id: a009c10ce7188bafaa29c9c7594e64c664ae8566
Pull Request resolved: #841
fduwjj added a commit that referenced this pull request Feb 14, 2025
ghstack-source-id: 6b41f54a558d605976f502e04d4968eb6f10a2a7
Pull Request resolved: #841
@kwen2501
Copy link
Contributor

Can you run an all-reduce on delta to get the avg/min/max init time across ranks?
It will reduce the script processing post benchmarking.

@fduwjj
Copy link
Contributor Author

fduwjj commented Feb 14, 2025

We are doing post-processing anyway. so I don't think all-reduce is needed. Plus by the time, there is no PG already.

fduwjj added a commit that referenced this pull request Mar 3, 2025
ghstack-source-id: c6a5b0d8f912999a10d7bf43e17ebf7bd11348d4
Pull Request resolved: #841
fduwjj added a commit that referenced this pull request Mar 3, 2025
ghstack-source-id: f11a19b5ceab133bf10d3e592c463c7292e91e17
Pull Request resolved: #841
fduwjj added a commit that referenced this pull request Mar 3, 2025
ghstack-source-id: 1a2c6661ba9894fe2ccc5a895a3abb46c478acdc
Pull Request resolved: #841
fduwjj added a commit that referenced this pull request Mar 3, 2025
ghstack-source-id: 0b551fed8c01c2da316a4448d7dced9c6e598777
Pull Request resolved: #841
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Meta Open Source bot.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants