Merge branch 'main' of https://github.com/kaistAI/FLASK

Author: seonghyeonye

README.md

@@ -1 +1,45 @@
-#FLASK
+
+<p align="center" width="100%">
+<a href="" target="_blank">
+
+# FLASK: FINE-GRAINED LANGUAGE MODEL EVALUATION <br>BASED ON ALIGNMENT SKILL SETS
+
+[![Python 3.9+](https://img.shields.io/badge/python-3.9+-blue.svg)](https://www.python.org/downloads/release/python-390/)
+[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)
+
+
+## News
+[July 21, 2023] Initial release: We released the first version of FLASK! Also check out the <a href="https://kaistai.github.io/FLASK">interactive demo</a>.
+
+
+## Overview
+This is the repository for the KAIST FLASK project, a task-agnostic evaluation protocol of language model with fine-grained instance-wise skill set as metrics.
+
+## Evaluation
+TBA
+
+## Online demo
+Check out the <a href="https://kaistai.github.io/FLASK">interactive demo</a>!
+
+### Team members
+<a href="https://seonghyeonye.github.io/">Seonghyeon Ye*</a>,  <a href="https://github.com/doeyoungkim">Doyoung Kim*</a>, <a href="https://github.com/DSKSD">Sungdong Kim</a>, <a href="https://github.com/hbin0701">Hyeonbin Hwang</a>, <a href="https://github.com/seungonekim">Seungone Kim</a>, <a href="https://github.com/dreamgonfly">Yongrae Jo</a>, <a href="https://jamesthorne.com/">James Thorne</a>, <a href="https://juhokim.com/">Juho Kim</a>, and <a href="https://seominjoon.github.io/">Minjoon Seo</a>. <br/>
+(* denotes equal contribution)
+
+### Release
+We release the evaluation code of the FLASK. We also plan to release the pip version of FLASK including analysis code in the near future. Stay Tuned!
+
+
+### Citation
+
+Please cite if you use the data or code in this repo.
+
+```
+@misc{flask2023,
+title = {FLASK: Fine-grained Language Skillset \\ Evaluation for Alignment of \\Foundation Models},
+url = {https://lklab.kaist.ac.kr/},
+author = {Ye, Seonghyeon$^*$ and Kim, Doyoung$^*$ and Kim, Sungdong and Hwang, Hyeonbin and Kim, Seungone and Jo, Yongrae and Thorne, James and Kim, Juho and Seo, Minjoon},
+month = {July},
+year = {2023},
+note = {$^*$ indicates equal contribution}
+}
+```