Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot understand result #5

Open
eric-tc opened this issue Sep 18, 2019 · 1 comment
Open

Cannot understand result #5

eric-tc opened this issue Sep 18, 2019 · 1 comment

Comments

@eric-tc
Copy link

eric-tc commented Sep 18, 2019

Hi i have trained CIFAR10 with --split_classes 0 and after i have run /experiments/uncertainty/uncertainty.py i cannot understand the output about accuracy and NLL:

I am expected different result with higher accuracy.
Do the following results makes sense?

Thanks

1/30
79/79 [00:13<00:00, 6.00it/s]
Accuracy: 0.3055
NLL: 82666.69703534538
2/30
| 79/79 [00:13<00:00, 5.99it/s]
Accuracy: 0.3054
NLL: 80883.04669379114
3/30
| 79/79 [00:13<00:00, 5.95it/s]
Accuracy: 0.3058
NLL: 79560.46427493387
4/30
| 79/79 [00:13<00:00, 5.77it/s]
Accuracy: 0.3046
NLL: 78679.55740708904
5/30
| 79/79 [00:13<00:00, 5.92it/s]
Accuracy: 0.3046
NLL: 78697.95717055122
6/30
79/79 [00:13<00:00, 5.92it/s]
Accuracy: 0.3054
NLL: 78423.18946819699
7/30
79/79 [00:13<00:00, 5.99it/s]
Accuracy: 0.3043
NLL: 78413.52605041317
8/30
79/79 [00:13<00:00, 5.95it/s]
Accuracy: 0.3045
NLL: 77780.88915598544
9/30
79/79 [00:13<00:00, 5.95it/s]
Accuracy: 0.3042
NLL: 77406.18986791647
10/30
79/79 [00:13<00:00, 5.84it/s]
Accuracy: 0.3043
NLL: 76929.39630398026
11/30
79/79 [00:13<00:00, 5.92it/s]
Accuracy: 0.304
NLL: 76934.29220921292
12/30
| 79/79 [00:13<00:00, 5.96it/s]
Accuracy: 0.3043
NLL: 76991.46480763993
13/30
| 79/79 [00:13<00:00, 5.99it/s]
Accuracy: 0.3049
NLL: 76846.16643335675
14/30
79/79 [00:13<00:00, 5.97it/s]
Accuracy: 0.3047
NLL: 76986.94727699496
15/30
79/79 [00:13<00:00, 5.99it/s]
Accuracy: 0.3055
NLL: 77010.32154600904
16/30
| 79/79 [00:13<00:00, 5.90it/s]
Accuracy: 0.305
NLL: 76450.6290673627
17/30
| 79/79 [00:13<00:00, 5.96it/s]
Accuracy: 0.3054
NLL: 74538.73480594362
18/30
█| 79/79 [00:13<00:00, 5.88it/s]
Accuracy: 0.3053
NLL: 74561.06134984753
19/30
| 79/79 [00:13<00:00, 5.96it/s]
Accuracy: 0.3053
NLL: 74636.1909890976
20/30
| 79/79 [00:13<00:00, 5.94it/s]
Accuracy: 0.3053
NLL: 74616.04049727577
21/30
79/79 [00:13<00:00, 5.91it/s]
Accuracy: 0.3053
NLL: 74681.99346308134
22/30
79/79 [00:13<00:00, 5.99it/s]
Accuracy: 0.3049
NLL: 74770.6411489519
23/30
79/79 [00:13<00:00, 5.99it/s]
Accuracy: 0.3053
NLL: 74883.58924571003
24/30
79/79 [00:13<00:00, 5.89it/s]
Accuracy: 0.3049
NLL: 74830.6947837674
25/30
100%|| 79/79 [00:13<00:00, 5.99it/s]
Accuracy: 0.3046
NLL: 74713.18414589943
26/30
79/79 [00:13<00:00, 5.99it/s]
Accuracy: 0.3048
NLL: 74794.40056861148
27/30
| 79/79 [00:13<00:00, 5.94it/s]
Accuracy: 0.3049
NLL: 74712.60328365376
28/30
79/79 [00:13<00:00, 5.98it/s]
Accuracy: 0.305
NLL: 74729.760734134
29/30
79/79 [00:13<00:00, 5.94it/s]
Accuracy: 0.3049
NLL: 74740.55728330463
30/30
79/79 [00:13<00:00, 5.97it/s]
Accuracy: 0.3047
NLL: 74798.28355654998

@wjmaddox
Copy link
Owner

What was the command that you used?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants