Skip to content

Commit 2ddfa0a

Browse files
jzxucopybara-github
authored andcommitted
Update assessment instructions to point to the Eagle Eye labeling tool.
PiperOrigin-RevId: 681891717
1 parent 6ccf72a commit 2ddfa0a

File tree

2 files changed

+9
-10
lines changed

2 files changed

+9
-10
lines changed

docs/README.md

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -17,8 +17,6 @@ For more information, please refer to our [NeurIPS workshop paper](https://arxiv
1717

1818
## Setup
1919

20-
SKAI requires a Linux workstation with a recent version of Python (>=3.7). SKAI was designed to run on Google Cloud, so you need to have a Google Cloud project set up as well.
21-
2220
Please see detailed setup instructions [here](setup.md).
2321

2422

docs/assessment_instructions.md

Lines changed: 9 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -218,15 +218,16 @@ This CSV can be used by labeling tools to create labeling tasks.
218218

219219
## Step 6: Label examples
220220

221-
Use [this colab notebook](https://colab.research.google.com/drive/11RmU0h_-ehnsi2aSK7fl6P5__uwzBN_q?usp=sharing) to label the examples.
222-
223-
Note: This is a temporary solution until we develop a more featureful labeling
224-
tool.
221+
Set up the Eagle Eye labeling tool in your GCP environment by following these
222+
[instructions](https://github.com/google-research/skai/blob/main/src/eagle_eye/README.md).
223+
Then create a new project in Eagle Eye and upload the CSV generated in the
224+
previous step to begin labeling the examples.
225225

226226
## Step 7: Merge Labels into Dataset
227227

228-
When a sufficient number of examples are labeled, the labels need to be
229-
downloaded to a CSV file and then merged into the TFRecords we are training on.
228+
When a sufficient number of examples are labeled, download the labels from the
229+
labeling tool as a CSV file and then merged into the TFRecords we are training
230+
on.
230231

231232
```
232233
$ python create_labeled_dataset.py \
@@ -237,8 +238,8 @@ $ python create_labeled_dataset.py \
237238
--test_output_path=gs://$BUCKET/examples/labeled_test_examples.tfrecord
238239
```
239240

240-
The `--label_file_paths` flag should point to CSV files with two columns:
241-
"example_id" and "string_label". This file maps labels to examples.
241+
The `--label_file_paths` flag should point to the CSV files you downloaded from
242+
the labeling tool.
242243

243244
The flag `--string_to_numeric_labels` controls how string label values such as
244245
"no\_damage" and "destroyed" are mapped to numeric label values (either 0 or 1).

0 commit comments

Comments
 (0)