Skip to content

dsc-sookmyung/2023-YeonJeans-SolutionChallenge

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

35 Commits
 
 
 
 
 
 
 
 

Repository files navigation

image


Saera is providing educational solutions based on the app's high accessibility to help North Koreans make a smooth transition to South Korea.

❗️ Introduction

North and South Korea use the same writing system and have similar grammar, but they have developed linguistic differences over the years due to their different environments and societies where they lived for many years after the division. For North Koreans adjusting to life in South Korea, pronunciation and accent can be some of the most challenging differences, leading to discrimination. To bridge this gap, we created SAERA, an app that enables users to learn pronunciation and accent. In pronunciation learning, we provide word examples with standard pronunciation and tips on how to pronounce words and what to pay attention to when pronouncing words based on the differences between South and North Korean. For intonation learning, SAERA presents the target intonation and voice audibly and visually through a Korean TTS and pitch graph generation model. It also visualizes the user's recorded voice in a graph and evaluates it with a rating for each graph.

With SAERA, we hope North Korean defectors can quickly learn the South Korean language system and overcome language barriers to settle into South Korean society stably.


🗒 Role division

Name Role
김도은
(Doeun Kim)
- UI Screen
(Splash & Login Screen, Persistent TabBar, Today Learn Screen, Pronunciation Learn Screen, Accent Learn Screen, Create Custom Sentence Screen, MyPage Screen)
- Automatic login
- Today Learn
- Pronunciation Learn
- Accent Learn
남수연
(Suyeon Nam)
- Extract pitch graph from voice using SPICE
- Similarity Search
- Calculate similarity between two pitch graphs
- Deploy FastAPI + Nginx environment to GCP Virtual Machine
- UX/UI Design
- Train a model to classify end-of-speech pitch (deprecated)
이주은
(Jueun Lee)
- Deploy spring server with GCP Virtual Machine
- Manage MySql DB with GCP SQL
- Server APIs
황연진
(Yeonjin Hwang)
- UI Screen
(Home Screen, Bookmark Screen, Learn Screen, Accent Main Screen, Pronunciation Main Screen, Search Learn Screen, Custom Sentence Loading & Done Screen, Custom Sentence Home Screen, Today Learn Word & Sentence List Screen)
- Home
- Search & Filter
- Learn Pronunciation & Accent Retrieve

🛠 Project Architecure

structure

📽 Demo Video Link

Sae:ra


👩🏼‍💻 User Guide

01 Initial Screen

Android Screen iOS Screen Explanation
Enjoy Saera Through Your Google Account.                                       

02 Home Screen

Screen Explanation
Learn the 5 most learned sentences and today's lesson.                                                                              

03 Learn Screen

Screen Explanation
1) Pronuciation Learning

To help you learn pronunciation systematically, there are 6 categories organized by pronunciation.

[ User Guide ]
1. Listen example speech for the word.
2. Look at the example sentences to see how this word would be used.
3. Record your voice.
4. Press the next button to practice as many times as you want.
5. Click stop button and check out the learning report.
2) Accent Learning

[ User Guide ]
1. We provide example speech for the sentence.
2. Record your voice.
3. You will be given an intonation graph and rating for your voice.
3) Custom Sentence

Create intonation practice content by entering sentences and tags that you want to practice.
You can create the intonation content in 3 seconds.

[ User Guide ]
1. Press the ‘+’ floating button in the bottom right corner.
2. Write down a sentence you want to learn and enter the appropriate tags.
3. Press the "Generate Sentence" button.
4) Search
(Provide Similarity Search)

We have introduced similarity search to recommend sentences that include similar meanings by understanding the user’s intent.

[ User Guide ]
1. Search the word you want to learn.
2. You can select a situation or sentence type tag to choose the sentences you want to practice on.
3. Click the sentence you want to study.

04 Bookmark Screen

Screen Explanation
You can view your bookmarked contents in Bookmark tab.                                                                             

[ User Guide ]
You can mark sentences and words for the following three pieces of content.
1. Pronunciation
2. Accent
3. Custom Sentence

05 My Information Screen

Screen Explanation
You can level up with experience points gained through learning.

[ Level Up System ]
For each pronunciation and accent, you can gain experience points upon initial learning.                                       

* You can gain 1 level for every 1000 xp
1. Today learn
- Pronunciation : +250 xp / se
- Accent : +750 xp / set
2. Pronunciation learn : +25 xp
3. Accent learn : +100 xp

📲 Execution Method

For Android User

  1. Download the apk file at Releases tab.
  2. Run the apk file on your phone.

For iOS User

Update Soon!


👥 Contributors

김도은 남수연 이주은 황연진