Repository logo
  • Log In
Repository logo
  • Log In
  1. Home
  2. NIE Publications & Research Output
  3. Electronic Academic Papers
  4. Conference Papers
  5. Using computer vision and machine learning with a view to building children's vocabulary
 
  • Details
Options

Using computer vision and machine learning with a view to building children's vocabulary

URI
https://hdl.handle.net/10497/25004
Loading...
Thumbnail Image
Type
Conference Paper
Files
 RPIC-2022-6.pdf (546.66 KB)
Citation
Lim, K. Y. T., Kaushal Rajesh, & Pek, A. (2022). Using computer vision and machine learning with a view to building children's vocabulary. In Redesigning Pedagogy International Conference 2022: Transforming education & strengthening society: Conference proceedings (pp. 6-17). Nanyang Technological University, National Institute of Education (Singapore).
Author
Lim, Kenneth Yang Teck 
•
Kaushal Rajesh
•
Pek, Alastair
Abstract
This paper describes an independent research project carried out by a pair of junior college students under the mentorship of a Research Scientist at the National Institute of Education. Our project aimed to design a working device to aid kindergarten children in learning about common household equipment such as tables, chairs, and so on. We hoped that this device would help to solve the problem of kindergarten children not being able to learn during the Covid-19 pandemic due to the closure of kindergartens. We trained an Object Detection model and ran it on a Raspberry Pi with screen, speakers and camera connected to it. We took photos of different household equipment and labelled them using software in order to train these images for our Object Detection model. We made use of the Google Open Images and COCO image datasets to sift out the related images of the objects we wanted to train in the model. Overall, the use of the software such as TensorFlow helped us with the training of the different types of objects for the model and the use of Text-to-Speech software allowed us to incorporate the use of sound to project the pronunciation of the objects. Eventually, there are many more aspects we could explore with our prototype. We could make it so that it can say out the object names in different languages to help teach Mother Tongue to kindergarten children.
Date Issued
2022
  • Contact US
  • Terms of Use
  • Privacy Policy

NTU Reg No: 200604393R. Copyright National Institute of Education, Nanyang Technological University (NIE NTU), Singapore

Built with DSpace-CRIS software - Extension maintained and optimized by 4Science