You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I've been running the 01_opt_single_gpu experiment on A100, 4090 and 4090 D, but noticed the reserved memory is still 22GB, just slightly reduced by 4GB to fit on training for 4090. As your README.md said that the reserved memory ultimately reduced to 6.2GB, could you kindly explain the weird results on my side? Maybe the bfloat16 setting doesn't take effect?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi, @rasbt
I've been running the
01_opt_single_gpuexperiment on A100, 4090 and 4090 D, but noticed the reserved memory is still 22GB, just slightly reduced by 4GB to fit on training for 4090. As yourREADME.mdsaid that the reserved memory ultimately reduced to 6.2GB, could you kindly explain the weird results on my side? Maybe the bfloat16 setting doesn't take effect?Beta Was this translation helpful? Give feedback.
All reactions