Skip to content
This repository was archived by the owner on May 30, 2025. It is now read-only.

Commit aee0a4a

Browse files
apiadapiad
committed
Update
1 parent c3c1c57 commit aee0a4a

File tree

7 files changed

+122
-108
lines changed

7 files changed

+122
-108
lines changed

‎training_example/dev/output_A_example.txt‎

Lines changed: 11 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -1,16 +1,18 @@
11
1 3 7
2-
3 19 37
2+
2 8 14
3+
3 19 23
34
4 43 51
4-
5 67 71
5+
5 55 62
6+
6 67 71
57
7 79 89
6-
8 94 108
7-
9 112 119
8-
10 127 139
9-
11 140 148
8+
8 72 74
9+
9 94 108
10+
10 112 119
11+
11 131 139
1012
12 154 162
1113
13 168 179
1214
14 180 188
13-
16 237 247
14-
17 216 224
1515
15 193 207
16-
19 229 233
16+
16 216 224
17+
17 237 247
18+
18 24 37

‎training_example/dev/output_B_example.txt‎

Lines changed: 9 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,16 +1,18 @@
11
1 Concept
2+
2 Action
23
3 Concept
34
4 Concept
4-
5 Concept
5+
5 Action
6+
6 Concept
57
7 Concept
6-
8 Concept
7-
9 Action
8-
10 Concept
9-
11 Action
8+
8 Action
9+
9 Concept
10+
10 Action
11+
11 Concept
1012
12 Concept
1113
13 Concept
1214
14 Action
15+
15 Concept
1316
16 Concept
1417
17 Concept
15-
15 Concept
16-
19 Action
18+
18 Concept

‎training_example/dev/output_C_example.txt‎

Lines changed: 12 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,13 @@
1-
part-of 1 3
2-
subject 9 11
3-
target 9 8
4-
subject 11 10
5-
subject 14 12
6-
target 14 15
1+
is-a 16 17
2+
property-of 18 3
3+
subject 2 1
4+
target 2 3
5+
target 5 4
6+
subject 8 6
7+
target 8 7
8+
subject 10 11
9+
target 10 9
710
subject 14 13
8-
target 14 17
9-
subject 19 16
10-
target 19 17
11+
subject 14 T12
12+
target 14 15
13+
target 14 T16

‎training_example/gold/output_A_example.txt‎

Lines changed: 17 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -1,19 +1,20 @@
11
1 3 7
22
2 8 14
3-
3 19 37
4-
4 43 51
3+
3 19 23
4+
4 19 37
5+
5 43 51
56
6 55 62
6-
5 67 71
7-
7 79 89
8-
8 94 108
9-
9 112 119
10-
10 131 139
11-
11 140 148
12-
12 154 162
13-
13 168 179
14-
14 180 188
15-
16 237 247
16-
17 216 224
17-
15 193 197
18-
18 201 207
19-
19 19 23
7+
7 67 71
8+
8 79 89
9+
9 94 108
10+
10 104 108
11+
11 112 119
12+
12 131 139
13+
13 140 148
14+
14 154 162
15+
15 168 179
16+
16 180 188
17+
17 201 207
18+
18 193 197
19+
19 216 224
20+
20 237 247

‎training_example/gold/output_B_example.txt‎

Lines changed: 7 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -2,18 +2,19 @@
22
2 Action
33
3 Concept
44
4 Concept
5-
6 Action
65
5 Concept
6+
6 Action
77
7 Concept
88
8 Concept
9-
9 Action
9+
9 Concept
1010
10 Concept
1111
11 Action
1212
12 Concept
13-
13 Concept
14-
14 Action
15-
16 Concept
16-
17 Concept
13+
13 Action
14+
14 Concept
1715
15 Concept
16+
16 Action
17+
17 Concept
1818
18 Concept
1919
19 Concept
20+
20 Concept

‎training_example/gold/output_C_example.txt‎

Lines changed: 15 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -1,15 +1,15 @@
1-
is-a 5 7
2-
property-of 17 16
3-
property-of 15 18
4-
is-a 3 19
5-
subject 2 1
6-
target 2 3
7-
subject 6 4
8-
target 6 4
9-
subject 9 11
10-
target 9 8
11-
target 11 10
12-
subject 14 13
13-
subject 14 T12
14-
target 14 15
15-
target 14 T17
1+
property-of 18 17
2+
property-of 19 20
3+
is-a 4 3
4+
is-a 7 8
5+
subject 2 1
6+
target 2 4
7+
subject 6 5
8+
target 6 5
9+
subject 11 13
10+
target 11 9
11+
target 13 12
12+
subject 16 15
13+
subject 16 T14
14+
target 16 18
15+
target 16 T19

‎training_example/log.txt‎

Lines changed: 51 additions & 46 deletions
Original file line numberDiff line numberDiff line change
@@ -3,97 +3,102 @@
33
# gold file: gold/output_A_example.txt
44
# dev file: dev/output_A_example.txt
55

6-
* Correct (13):
6+
* Correct (15):
77
- "asma" from 3 to 7.
8-
- "vías respiratorias" from 19 to 37.
8+
- "afecta" from 8 to 14.
9+
- "vías" from 19 to 23.
910
- "pulmones" from 43 to 51.
11+
- "hinchan" from 55 to 62.
1012
- "asma" from 67 to 71.
1113
- "enfermedad" from 79 to 89.
1214
- "ataque de asma" from 94 to 108.
1315
- "produce" from 112 to 119.
14-
- "empeoran" from 140 to 148.
16+
- "síntomas" from 131 to 139.
1517
- "síntomas" from 154 to 162.
1618
- "tratamiento" from 168 to 179.
1719
- "dependen" from 180 to 188.
1820
- "avanzada" from 216 to 224.
1921
- "enfermedad" from 237 to 247.
20-
* Partial (2):
21-
- "síntomas" from 131 to 139 vs "los síntomas" from 127 to 139.
22-
- "tipo" from 193 to 197 vs "tipo de cáncer" from 193 to 207.
22+
* Partial (1):
23+
- "cáncer" from 201 to 207 vs "tipo de cáncer" from 193 to 207.
2324
* Missing (4):
24-
- "afecta" from 8 to 14.
25-
- "vías" from 19 to 23.
26-
- "hinchan" from 55 to 62.
27-
- "cáncer" from 201 to 207.
28-
* Spurious (1):
29-
- "esté" from 229 to 233.
25+
- "vías respiratorias" from 19 to 37.
26+
- "asma" from 104 to 108.
27+
- "empeoran" from 140 to 148.
28+
- "tipo" from 193 to 197.
29+
* Spurious (2):
30+
- "respiratorias" from 24 to 37.
31+
- "es" from 72 to 74.
3032

31-
Precision = 0.93
32-
Recall = 0.78
33-
F1 Score = 0.85
33+
Precision = 0.89
34+
Recall = 0.79
35+
F1 Score = 0.84
3436

3537
# Taks B (labeling phrases)
3638
# gold file: gold/output_B_example.txt
3739
# dev file: dev/output_B_example.txt
3840

39-
* Correct (15):
41+
* Correct (16):
4042
- Concept "asma" from 3 to 7.
41-
- Concept "vías respiratorias" from 19 to 37.
43+
- Action "afecta" from 8 to 14.
44+
- Concept "vías" from 19 to 23.
4245
- Concept "pulmones" from 43 to 51.
46+
- Action "hinchan" from 55 to 62.
4347
- Concept "asma" from 67 to 71.
4448
- Concept "enfermedad" from 79 to 89.
4549
- Concept "ataque de asma" from 94 to 108.
4650
- Action "produce" from 112 to 119.
47-
- Concept "los síntomas" from 127 to 139.
48-
- Action "empeoran" from 140 to 148.
51+
- Concept "síntomas" from 131 to 139.
4952
- Concept "síntomas" from 154 to 162.
5053
- Concept "tratamiento" from 168 to 179.
5154
- Action "dependen" from 180 to 188.
52-
- Concept "enfermedad" from 237 to 247.
53-
- Concept "avanzada" from 216 to 224.
5455
- Concept "tipo de cáncer" from 193 to 207.
56+
- Concept "avanzada" from 216 to 224.
57+
- Concept "enfermedad" from 237 to 247.
5558
* Incorrect (0):
5659
* Missing (4):
57-
- Action "afecta" from 8 to 14.
58-
- Action "hinchan" from 55 to 62.
59-
- Concept "cáncer" from 201 to 207.
60-
- Concept "vías" from 19 to 23.
61-
* Spurious (1):
62-
- Action "esté" from 229 to 233.
60+
- Concept "vías respiratorias" from 19 to 37.
61+
- Concept "asma" from 104 to 108.
62+
- Action "empeoran" from 140 to 148.
63+
- Concept "tipo" from 193 to 197.
64+
* Spurious (2):
65+
- Action "es" from 72 to 74.
66+
- Concept "respiratorias" from 24 to 37.
6367

6468
Micro-accuracy: 1.00
65-
Macro-accuracy: 0.75
66-
Precision: 0.94
67-
Recall: 0.79
68-
F1: 0.86
69+
Macro-accuracy: 0.73
70+
Precision: 0.89
71+
Recall: 0.80
72+
F1: 0.84
6973

7074
# Taks C (linking)
7175
# gold file: gold/output_C_example.txt
7276
# dev file: dev/output_C_example.txt
7377

7478
* Correct (4):
75-
- subject involving "produce" and "empeoran".
79+
- subject involving "afecta" and "asma".
80+
- target involving "hinchan" and "pulmones".
7681
- target involving "produce" and "ataque de asma".
7782
- subject involving "dependen" and "tratamiento".
78-
- target involving "dependen" and "tipo".
7983
* Missing (9):
80-
- is-a involving "asma" and "enfermedad".
81-
- property-of involving "avanzada" and "enfermedad".
8284
- property-of involving "tipo" and "cáncer".
85+
- property-of involving "avanzada" and "enfermedad".
8386
- is-a involving "vías respiratorias" and "vías".
84-
- subject involving "afecta" and "asma".
87+
- is-a involving "asma" and "enfermedad".
8588
- target involving "afecta" and "vías respiratorias".
8689
- subject involving "hinchan" and "pulmones".
87-
- target involving "hinchan" and "pulmones".
90+
- subject involving "produce" and "empeoran".
8891
- target involving "empeoran" and "síntomas".
89-
* Spurious (6):
90-
- part-of involving "asma" and "vías respiratorias".
91-
- subject involving "empeoran" and "los síntomas".
92-
- subject involving "dependen" and "síntomas".
93-
- target involving "dependen" and "avanzada".
94-
- subject involving "esté" and "enfermedad".
95-
- target involving "esté" and "avanzada".
92+
- target involving "dependen" and "tipo".
93+
* Spurious (7):
94+
- is-a involving "avanzada" and "enfermedad".
95+
- property-of involving "respiratorias" and "vías".
96+
- target involving "afecta" and "vías".
97+
- subject involving "es" and "asma".
98+
- target involving "es" and "enfermedad".
99+
- subject involving "produce" and "síntomas".
100+
- target involving "dependen" and "tipo de cáncer".
96101

97-
Precision: 0.40
102+
Precision: 0.36
98103
Recall: 0.31
99-
F1: 0.35
104+
F1: 0.33

0 commit comments

Comments
 (0)