You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
User cannot pass autocast argument to model.
So for my understanding autocast is not supported now, may I know do you have a plan for autocast ? Thank you
The text was updated successfully, but these errors were encountered:
Hi, the public experiments were run with autocast disabled given the datasets were small. In large-scale settings, enabling autocast would definitely be beneficial. It should be easy to flip that flag back on, but you probably want to integrate the custom triton kernels as well if efficiency is a main focus.
Hi - we discussed some possible industrial-scale configurations in Section 4.1.2 and Section 4.3.1 of the paper. For comparison, the Amazon Books dataset (one of the largest public datasets commonly used in prior work) consists of 694,897 users, 674,044 items, which is a few orders of magnitude smaller than the industrial-scale configurations we discussed/tested.
hi, I didn't found autocast support in the train step. Where we just convert model to bfloat16.
generative-recommenders/generative_recommenders/trainer/train.py
Line 263 in bb389f9
But I found some autocast related code in hstu main body, and autocast option is hard code to "None".
generative-recommenders/generative_recommenders/modeling/sequential/hstu.py
Line 621 in bb389f9
So for my understanding autocast is not supported now, may I know do you have a plan for autocast ? Thank you
The text was updated successfully, but these errors were encountered: