Skip to content

fix row-wise alltoall error when some embeddings use mean pooling and others use sum pooling#2809

Closed
tiankongdeguiji wants to merge 1 commit intometa-pytorch:mainfrom
tiankongdeguiji:bugfix/mean_pooling_row_wise
Closed

fix row-wise alltoall error when some embeddings use mean pooling and others use sum pooling#2809
tiankongdeguiji wants to merge 1 commit intometa-pytorch:mainfrom
tiankongdeguiji:bugfix/mean_pooling_row_wise

Conversation

@tiankongdeguiji
Copy link
Contributor

@tiankongdeguiji tiankongdeguiji commented Mar 12, 2025

KJT.lengths is modified by mean pooling callback. When some embeddings use mean pooling and others use sum pooling, KJT.lengths will be incorrect.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 12, 2025
@tiankongdeguiji
Copy link
Contributor Author

hi, @iamzainhuda @henrylhtsang @PaulZhang12 @joshuadeng could you take a look?

@iamzainhuda
Copy link
Contributor

ack, will review

@tiankongdeguiji
Copy link
Contributor Author

ack, will review

thx! Could you take another look at this pr #2807 ?

@tiankongdeguiji
Copy link
Contributor Author

ack, will review

hi, @iamzainhuda can you help me land the changes? Are there any existing issues I should address?

@facebook-github-bot
Copy link
Contributor

@iamzainhuda has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants