Wei Jin

About

As part of a project from the ASEAN Leadership Programme, my group and I built an eBook reader that allows for the incorporation of an additional auditory stimulant to eBooks. eMello takes any ePUB file and selects appropriate background music for each page by analysing its text and embeds them into the book to enhance the reading experience. As an additional feature, pop-ups are also created and tagged to difficult words, explaining their meanings to the user, in order to improve the child’s command of the language.

eMello was submitted for the Mobile Application Innovation Contest 2018 and placed top 30 out of more than 200 participating groups. We were later invited back to China for the finals of the competition, but unfortunately had to withdraw due to prior school commitments.

How We Built It

Using XCode, we built an iOS application that uses children’s eBooks uploaded into it and by passing them through a Natural Language Processing (NLP) tool, IBM’s Watson, we attained a tonal score. Using the tone and score provided for each page, the application accesses the relevant music databases to attain a corresponding track to tag to each page of the eBook. The final result is an eBook that plays a set track on each page. The book is then placed within the users’ library for them enjoy and experience with the music.

eMello Thesis Paper

We wrote a detailed explanation of our methodology. All references can also be found in the thesis paper.

Learn more

GitHub Repository

Here are the source files for the project.

Learn more