Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

config-nell.json #1

Closed
David-Lee-1990 opened this issue Nov 27, 2019 · 1 comment
Closed

config-nell.json #1

David-Lee-1990 opened this issue Nov 27, 2019 · 1 comment

Comments

@David-Lee-1990
Copy link

Hi, thanks for sharing your code for your beautiful model of graph-shaping reasoning. I just try to run a test on nell-one data. And follow your guidence:
1.
python src/main.py --directory datasets/NELL/ --gpu 0 --config configs/config-nell.json --load_embed DistMult --comment nell

python src/main.py --inference --directory datasets/NELL/ --gpu 3 --config configs/config-nell.json --load_embed DistMult --load_state ./datasets/NELL/log/11-26-13-nell/best.state

and I get the following results which seems not at the same scale as your paper shows.
image

So, is there any other parameters to add or the config-nell.json is not the best hyparameters?

@duzx16
Copy link
Member

duzx16 commented Dec 21, 2019

Sorry for the late response. config-nell.json is the hyperparameter we used in our experiments. I think the problem is that the parameters haven't converged yet. You need about 50k - 100k steps to achieve the optimal performance, while the evaluation is conducted every 5k steps. Hopefully this can address your problem.

@duzx16 duzx16 closed this as completed Dec 21, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants