Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TableLlama seems to struggle with transferring to new tasks #9

Open
wbbeyourself opened this issue May 11, 2024 · 1 comment
Open

Comments

@wbbeyourself
Copy link

wbbeyourself commented May 11, 2024

The model seems to struggle with transferring to new tasks, as the output results appear to be fitted to those Table-Instruct tasks. Despite my instructions and inputs being in Chinese, I still expect it to understand the tables well, comprehend the tasks, and perform task transfer effectively. However, it doesn't. TableLlama cannot summarize the table content.

image

@zhangtianshu
Copy link
Collaborator

For your task, you can refer to our prompt of highlighted cells QA task https://github.com/OSU-NLP-Group/TableLlama/blob/main/imgs/fetaqa.png. Add a question part to explicitly highlight all the cells with special tokens [HIGHLIGHTED_BEGIN] and [HIGHLIGHTED_END].

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants