Doubts about the Acceptable Range of Model Accuracy Degradation and Evaluation Metrics in the Paper

[mia1460]

Hello, while reading the paper published by your team, I noticed the content related to "negligible regression" mentioned in Table 3.

• Question 1: The acceptable range of accuracy degradation is not clearly stated in the paper. I would like to know what specific interval is considered negligible?
• Question 2: When evaluating the model quality to determine the situation of accuracy degradation, were metrics such as NDCG, HR, and MRR used?

Looking forward to your reply. Thank you!

[jiaqizhai]

Hi - this is discussed in Section 4.2 and Appendix F. For those experiments, we measure model quality using Normalized Entropy (normalized log loss).