Skip to content

Commit

Permalink
CSP (#1584)
Browse files Browse the repository at this point in the history
  • Loading branch information
agsfer authored Nov 5, 2024
1 parent be1b27d commit 7c6f901
Show file tree
Hide file tree
Showing 20 changed files with 122 additions and 27 deletions.
6 changes: 6 additions & 0 deletions docs/_includes/head/custom.html
Original file line number Diff line number Diff line change
@@ -1,4 +1,10 @@
<!-- start custom head snippets -->
<meta http-equiv="Content-Security-Policy" content="img-src * data: nlp.johnsnowlabs.com;
style-src 'self' 'unsafe-inline' buttons.github.io nlp.johnsnowlabs.com sparknlp.org fonts.googleapis.com use.fontawesome.com;
script-src 'self' 'unsafe-inline' 'unsafe-eval' search.modelshub.johnsnowlabs.com nlp.johnsnowlabs.com www.googletagmanager.com www.youtube.com ajax.googleapis.com code.jquery.com www.google-analytics.com search.modelshub.johnsnowlabs.com sparknlp.org cdn.bootcss.com buttons.github.io;
font-src 'self' data: buttons.github.io fonts.gstatic.com use.fontawesome.com;
connect-src 'self' data: api.github.com sparknlp.org search.modelshub.johnsnowlabs.com www.google-analytics.com www.youtube.com nlp.johnsnowlabs.com;">

<link href="https://fonts.googleapis.com/css2?family=Montserrat:wght@300;400;500;600;700;800&display=swap" rel="stylesheet">
<link href="https://fonts.googleapis.com/css2?family=Roboto:wght@300;400;500;700&display=swap" rel="stylesheet">
<link href="https://fonts.googleapis.com/css2?family=Source+Code+Pro&display=swap" rel="stylesheet">
Expand Down
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
2 changes: 2 additions & 0 deletions docs/en/alab/annotation_configurations.md
Original file line number Diff line number Diff line change
Expand Up @@ -263,6 +263,8 @@ For users having multiple roles (_Annotator/Reviewer/Manager_) the labeling page

![Switch Role](/assets/images/annotation_lab/4.1.0/switch_role.png "lit_shadow")

</div><div class="h3-box" markdown="1">

## Annotation Instructions for Labels
Generative AI Lab 6.7 introduces a new feature allowing admin users to add annotation instructions to labels directly from the `Customize Labels` page. This enhancement ensures that annotators have clear and consistent guidelines, improving labeling accuracy and quality. The annotation guidelines are available for both NER (Named Entity Recognition) and VisualNER project types, offering flexibility across different project formats.

Expand Down
26 changes: 25 additions & 1 deletion docs/en/alab/annotation_labs_releases/release_notes_6_7_0.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,11 +22,15 @@ Generative AI Labs version 6.7 introduces improvements to the De-identification

This release also brings the ability for admin users to add annotation instructions to labels from within the project, allowing for improved label accuracy and consistency between annotators. This updated feature is available for NER and VisualNER project types.

</div><div class="h3-box" markdown="1">

## Support for De-identification Pipelines
Version 6.7.0 updates the existing de-identification feature, which has been significantly expanded to give more control over how de-identification is applied, how different entities are treated, and how to integrate pre-trained de-identification pipelines, models, rules, and zero-shot prompts to help identify and anonymize sensitive data.

De-identification has now moved from the Project Details page to the Content Type page during Project Configuration, where it is a separate project type.

</div><div class="h3-box" markdown="1">

### Creating a De-identification Project:
Users can use the de-identification feature if a valid license is available in the application:
1. **Create a New Project**:
Expand All @@ -36,6 +40,8 @@ Users can use the de-identification feature if a valid license is available in t

![670image](/assets/images/annotation_lab/6.7.0/1.png)

</div><div class="h3-box" markdown="1">

### New Pipeline Tab and Customization:
In the **Reuse Resource** page, a new **Pipelines Tab** is now available for de-identification projects. Here, all the downloaded de-identification pipelines are listed. Users can also use and apply pre-trained and trained models, rules, and zero-shot prompts.

Expand All @@ -49,6 +55,8 @@ Additionally, users can upload custom obfuscation files in JSON format on the Cu

![670image](/assets/images/annotation_lab/6.7.0/4.gif)

</div><div class="h3-box" markdown="1">

### De-identification Process:
The de-identification process remains similar to the existing pre-annotation workflow:

Expand All @@ -72,13 +80,17 @@ The de-identification process remains similar to the existing pre-annotation wor

![670image](/assets/images/annotation_lab/6.7.0/8.gif)

</div><div class="h3-box" markdown="1">

### Exporting De-identified Tasks:
Only de-identified completions submitted as **ground truth** are exported. Also, if a task has multiple ground truths from different users, the completion from the user with the **highest priority** will be exported.

![670image](/assets/images/annotation_lab/6.7.0/9.gif)

These updates are built on top of the current structure, ensuring ease of use and a smooth transition without disrupting productivity.

</div><div class="h3-box" markdown="1">

## Annotation Instructions for Labels
Generative AI Lab 6.7 introduces a new feature allowing admin users to add annotation instructions to labels directly from the `Customize Labels` page. This enhancement ensures that annotators have clear and consistent guidelines, improving labeling accuracy and quality. The annotation guidelines are available for both NER (Named Entity Recognition) and VisualNER project types, offering flexibility across different project formats.

Expand Down Expand Up @@ -117,31 +129,43 @@ Additionally, annotation guidelines are available for Assertion Labels as well.

![670image](/assets/images/annotation_lab/6.7.0/16.gif)

</div><div class="h3-box" markdown="1">

## Improvements
### Automatically turn off the "wizard mode" after the user trains the model using wizard mode

Once the training is completed, the wizard mode is automatically turned off, and users are navigated to the regular **Train** page. Here, all relevant information is displayed along with a message indicating whether the training was successful or not.

![670image](/assets/images/annotation_lab/6.7.0/17.gif)

</div><div class="h3-box" markdown="1">

### Clicking on the direction arrow for a relation should jump to the respective relation in the region panel
A new improvement has been introduced which allows users to click on any of the relation lines, which will take them directly to the corresponding relation in the **Relation** section.

![670image](/assets/images/annotation_lab/6.7.0/18.gif)

</div><div class="h3-box" markdown="1">

### Escape key should close the dialog boxes and warnings
Users can now simply press the **Esc** key to close dialog boxes and warnings that appear in the top banner. Instead of clicking the ‘x’ every time.


</div><div class="h3-box" markdown="1">

### The name of the model should be shown in the playground heading
The model names are shown, providing users with a clearer insight into which models are being tested.

![670image](/assets/images/annotation_lab/6.7.0/19.gif)

</div><div class="h3-box" markdown="1">

### Add Quick Submit button for Visual NER task
A new ability to "Submit completions without Saving" can be enabled on the **Advanced Configuration** page when setting up Visual NER projects. This feature allows users to see and use the "Submit" button on the labeling page right from the start, enabling them to submit their completions directly without the need to save them first.

![670image](/assets/images/annotation_lab/6.7.0/20.gif)

</div><div class="h3-box" markdown="1">

### Bug Fixes:
- **Unexpected behavior corrected for relations when added in the first line of the tasks**

Expand Down
8 changes: 8 additions & 0 deletions docs/en/alab/de_identify.md
Original file line number Diff line number Diff line change
Expand Up @@ -88,11 +88,15 @@ During the export process, de-identification is executed based on the type of an

This new de-identification feature significantly enhances data privacy by anonymizing sensitive document information. We are confident that this feature will empower users to handle sensitive data responsibly while maintaining the integrity and usability of their datasets.

</div><div class="h3-box" markdown="1">

## Support for De-identification Pipelines
Version 6.7.0 updates the existing de-identification feature, which has been significantly expanded to give more control over how de-identification is applied, how different entities are treated, and how to integrate pre-trained de-identification pipelines, models, rules, and zero-shot prompts to help identify and anonymize sensitive data.

De-identification has now moved from the Project Details page to the Content Type page during Project Configuration, where it is a separate project type.

</div><div class="h3-box" markdown="1">

### Creating a De-identification Project:
Users can use the de-identification feature if a valid license is available in the application:
1. **Create a New Project**:
Expand All @@ -115,6 +119,8 @@ Additionally, users can upload custom obfuscation files in JSON format on the Cu

![670image](/assets/images/annotation_lab/6.7.0/4.gif)

</div><div class="h3-box" markdown="1">

### De-identification Process:
The de-identification process remains similar to the existing pre-annotation workflow:

Expand All @@ -138,6 +144,8 @@ The de-identification process remains similar to the existing pre-annotation wor

![670image](/assets/images/annotation_lab/6.7.0/8.gif)

</div><div class="h3-box" markdown="1">

### Exporting De-identified Tasks:
Only de-identified completions submitted as **ground truth** are exported. Also, if a task has multiple ground truths from different users, the completion from the user with the **highest priority** will be exported.

Expand Down
25 changes: 25 additions & 0 deletions docs/en/alab/release_notes.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,11 +20,15 @@ Generative AI Labs version 6.7 introduces improvements to the De-identification

This release also brings the ability for admin users to add annotation instructions to labels from within the project, allowing for improved label accuracy and consistency between annotators. This updated feature is available for NER and VisualNER project types.

</div><div class="h3-box" markdown="1">

## Support for De-identification Pipelines
Version 6.7.0 updates the existing de-identification feature, which has been significantly expanded to give more control over how de-identification is applied, how different entities are treated, and how to integrate pre-trained de-identification pipelines, models, rules, and zero-shot prompts to help identify and anonymize sensitive data.

De-identification has now moved from the Project Details page to the Content Type page during Project Configuration, where it is a separate project type.

</div><div class="h3-box" markdown="1">

### Creating a De-identification Project:
Users can use the de-identification feature if a valid license is available in the application:
1. **Create a New Project**:
Expand All @@ -34,6 +38,8 @@ Users can use the de-identification feature if a valid license is available in t

![670image](/assets/images/annotation_lab/6.7.0/1.png)

</div><div class="h3-box" markdown="1">

### New Pipeline Tab and Customization:
In the **Reuse Resource** page, a new **Pipelines Tab** is now available for de-identification projects. Here, all the downloaded de-identification pipelines are listed. Users can also use and apply pre-trained and trained models, rules, and zero-shot prompts.

Expand All @@ -47,6 +53,8 @@ Additionally, users can upload custom obfuscation files in JSON format on the Cu

![670image](/assets/images/annotation_lab/6.7.0/4.gif)

</div><div class="h3-box" markdown="1">

### De-identification Process:
The de-identification process remains similar to the existing pre-annotation workflow:

Expand All @@ -70,13 +78,17 @@ The de-identification process remains similar to the existing pre-annotation wor

![670image](/assets/images/annotation_lab/6.7.0/8.gif)

</div><div class="h3-box" markdown="1">

### Exporting De-identified Tasks:
Only de-identified completions submitted as **ground truth** are exported. Also, if a task has multiple ground truths from different users, the completion from the user with the **highest priority** will be exported.

![670image](/assets/images/annotation_lab/6.7.0/9.gif)

These updates are built on top of the current structure, ensuring ease of use and a smooth transition without disrupting productivity.

</div><div class="h3-box" markdown="1">

## Annotation Instructions for Labels
Generative AI Lab 6.7 introduces a new feature allowing admin users to add annotation instructions to labels directly from the `Customize Labels` page. This enhancement ensures that annotators have clear and consistent guidelines, improving labeling accuracy and quality. The annotation guidelines are available for both NER (Named Entity Recognition) and VisualNER project types, offering flexibility across different project formats.

Expand Down Expand Up @@ -115,31 +127,44 @@ Additionally, annotation guidelines are available for Assertion Labels as well.

![670image](/assets/images/annotation_lab/6.7.0/16.gif)

</div><div class="h3-box" markdown="1">

## Improvements

### Automatically turn off the "wizard mode" after the user trains the model using wizard mode

Once the training is completed, the wizard mode is automatically turned off, and users are navigated to the regular **Train** page. Here, all relevant information is displayed along with a message indicating whether the training was successful or not.

![670image](/assets/images/annotation_lab/6.7.0/17.gif)

</div><div class="h3-box" markdown="1">

### Clicking on the direction arrow for a relation should jump to the respective relation in the region panel
A new improvement has been introduced which allows users to click on any of the relation lines, which will take them directly to the corresponding relation in the **Relation** section.

![670image](/assets/images/annotation_lab/6.7.0/18.gif)

</div><div class="h3-box" markdown="1">

### Escape key should close the dialog boxes and warnings
Users can now simply press the **Esc** key to close dialog boxes and warnings that appear in the top banner. Instead of clicking the ‘x’ every time.

</div><div class="h3-box" markdown="1">

### The name of the model should be shown in the playground heading
The model names are shown, providing users with a clearer insight into which models are being tested.

![670image](/assets/images/annotation_lab/6.7.0/19.gif)

</div><div class="h3-box" markdown="1">

### Add Quick Submit button for Visual NER task
A new ability to "Submit completions without Saving" can be enabled on the **Advanced Configuration** page when setting up Visual NER projects. This feature allows users to see and use the "Submit" button on the labeling page right from the start, enabling them to submit their completions directly without the need to save them first.

![670image](/assets/images/annotation_lab/6.7.0/20.gif)

</div><div class="h3-box" markdown="1">

### Bug Fixes:
- **Unexpected behavior corrected for relations when added in the first line of the tasks**

Expand Down
Loading

0 comments on commit 7c6f901

Please sign in to comment.