Skip to content

Commit b8f20fb

Browse files
committed
update readme
1 parent 2802f2c commit b8f20fb

File tree

2 files changed

+15
-9
lines changed

2 files changed

+15
-9
lines changed

README.md

+15-9
Original file line numberDiff line numberDiff line change
@@ -2,18 +2,24 @@
22
<p align="center" width="100%">
33
<a href="" target="_blank">
44

5-
# FLASK: FINE-GRAINED LANGUAGE MODEL EVALUATION <br>BASED ON ALIGNMENT SKILL SETS
5+
# FLASK: Fine-grained Language Model Evaluation Based on Alignment Skill Sets
66

77
[![Python 3.9+](https://img.shields.io/badge/python-3.9+-blue.svg)](https://www.python.org/downloads/release/python-390/)
88
[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)
99

10+
This is the official github repository for [FLASK: Fine-grained Language Model Evaluation Based on Alignment Skill Sets](https://arxiv.org/abs/2307.10928).
11+
12+
<p align="center">
13+
<img src="assets/overall_fig.png" width="80%" height="80%">
14+
</p>
15+
1016

1117
## News
1218
[July 21, 2023] Initial release: We released the first version of FLASK! Also check out the <a href="https://kaistai.github.io/FLASK">interactive demo</a>.
1319

1420

1521
## Overview
16-
This is the repository for the KAIST FLASK project, a task-agnostic evaluation protocol of language model with fine-grained instance-wise skill set as metrics.
22+
This is the repository for the FLASK project, a task-agnostic evaluation protocol of language model with fine-grained instance-wise skill set as metrics.
1723

1824
## Evaluation
1925
TBA
@@ -34,12 +40,12 @@ We release the evaluation code of the FLASK. We also plan to release the pip ver
3440
Please cite if you use the data or code in this repo.
3541

3642
```
37-
@misc{flask2023,
38-
title = {FLASK: Fine-grained Language Skillset \\ Evaluation for Alignment of \\Foundation Models},
39-
url = {https://lklab.kaist.ac.kr/},
40-
author = {Ye, Seonghyeon$^*$ and Kim, Doyoung$^*$ and Kim, Sungdong and Hwang, Hyeonbin and Kim, Seungone and Jo, Yongrae and Thorne, James and Kim, Juho and Seo, Minjoon},
41-
month = {July},
42-
year = {2023},
43-
note = {$^*$ indicates equal contribution}
43+
@misc{ye2023flask,
44+
title={FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets},
45+
author={Seonghyeon Ye and Doyoung Kim and Sungdong Kim and Hyeonbin Hwang and Seungone Kim and Yongrae Jo and James Thorne and Juho Kim and Minjoon Seo},
46+
year={2023},
47+
eprint={2307.10928},
48+
archivePrefix={arXiv},
49+
primaryClass={cs.CL}
4450
}
4551
```

assets/overall_fig.png

638 KB
Loading

0 commit comments

Comments
 (0)