Skip to content

Commit 2961d45

Browse files
SweetStanleyLSweetStanleyL
committed
Refactor: update dataloader and ignore large files
1 parent 1e8285c commit 2961d45

37 files changed

+1232
-6429455
lines changed

‎.gitignore‎

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change

‎.luogj.sh.swo‎

12 KB
Binary file not shown.

‎.luogj.sh.swp‎

4 KB
Binary file not shown.

‎=10.1‎

Whitespace-only changes.

‎DataDistribution/wikipedia/wikipedia_distribution.csv‎

Lines changed: 0 additions & 6407815 deletions
This file was deleted.

‎DataDistribution/wikipedia/wikipedia_distribution.png‎

-53.6 KB
Binary file not shown.

‎DataDistribution/wikipedia/wikipedia_distribution_count.csv‎

Lines changed: 0 additions & 20965 deletions
This file was deleted.

‎configs/7B_isp_sft.py‎

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change

‎configs/7B_llama2.py‎

Lines changed: 30 additions & 20 deletions
Original file line numberDiff line numberDiff line change

‎data_demo.py‎

Lines changed: 231 additions & 126 deletions
Original file line numberDiff line numberDiff line change

0 commit comments

Comments
 (0)