


Case Study Overview
Case Study Overview
Koka is a groundbreaking iPadOS application designed as the final project at the Apple Developer Academy. It addresses the unique challenges faced by hearing parents in educating their deaf children particularly in abstract concepts. offering a user-friendly platform that facilitates vocabulary expansion through short stories and engaging content.
Koka is a groundbreaking iPadOS application designed as the final project at the Apple Developer Academy. It addresses the unique challenges faced by hearing parents in educating their deaf children particularly in abstract concepts. offering a user-friendly platform that facilitates vocabulary expansion through short stories and engaging content.
Position
Position
Design Lead
Design Lead
Illustrator
Illustrator
Timeline
Timeline
Sept - Nov 2023
Sept - Nov 2023
(3 months)
(3 months)
Tools Used
Tools Used
Figma
Figma
Procreate
Procreate
Adobe After Effects
Adobe After Effects
Challenges
Challenges
Deaf children are difficult in learning language due to limitations in absorbing linguistic exposure from their environment and often misinterpret linguistic input. A major challenge deaf face is a limited vocabulary, especially when it comes to expressing abstract ideas because it needs context and lack of visualization. Traditional educational resources may not adequately address their unique learning needs. Parents, being the primary educators, require effective tools to bridge this gap and enhance their children's language development. Enhancing their grasp of abstract language can contribute to the advancement of their literacy skills and self actualization.
Deaf children are difficult in learning language due to limitations in absorbing linguistic exposure from their environment and often misinterpret linguistic input. A major challenge deaf face is a limited vocabulary, especially when it comes to expressing abstract ideas because it needs context and lack of visualization. Traditional educational resources may not adequately address their unique learning needs. Parents, being the primary educators, require effective tools to bridge this gap and enhance their children's language development. Enhancing their grasp of abstract language can contribute to the advancement of their literacy skills and self actualization.
Goals
Goals
Expanding abstract vocabulary, highlight the effectiveness in introducing and reinforcing vocabulary in a way that is engaging and accessible.
Expanding abstract vocabulary, highlight the effectiveness in introducing and reinforcing vocabulary in a way that is engaging and accessible.
Supporting hearing parents by provides a valuable resource to parents, facilitating their role in teaching abstract concepts and fostering language development.
Supporting hearing parents by provides a valuable resource to parents, facilitating their role in teaching abstract concepts and fostering language development.
Ensures that deaf children have equal opportunities to expand their vocabulary and understanding of reading in a way that is enjoyable and engaging.
Ensures that deaf children have equal opportunities to expand their vocabulary and understanding of reading in a way that is enjoyable and engaging.
Research
Research
10+
Interviews
10+
Interviews
Presidential Special Staff
Head of Starbucks Sign Store
Sign Language Interpreter
Linguistic Expert
Hearing and Deaf Parents
Teacher (SLB and Santirama)
Presidential Special Staff
Head of Starbucks Sign Store
Sign Language Interpreter
Linguistic Expert
Hearing and Deaf Parents
Teacher (SLB and Santirama)
13+
Journals
13+
Journals
International and National Journals Relevant
(Keywords — Deaf, Learning Method, SIBI, Bisindo, Literasi Anak Tuna Rungu)
International and National Journals Relevant
(Keywords — Deaf, Learning Method, SIBI, Bisindo, Literasi Anak Tuna Rungu)
5+
Communities
5+
Communities
Starbucks
Sunyi Coffee
Keluarga BISINDO
Yayasan Sayap Ibu
Rumah Disabilitas
Starbucks
Sunyi Coffee
Keluarga BISINDO
Yayasan Sayap Ibu
Rumah Disabilitas
2+
Events
2+
Events
Nowfest 2023 — Menuju Indonesia Inklusi
Peringatan Hari Bahasa International @Grab
Nowfest 2023 — Menuju Indonesia Inklusi
Peringatan Hari Bahasa International @Grab
Based on in-depth interviews and surveys to understand their experiences, preferences, and pain points, my team and I found that most of deaf children are born to hearing parents who do not have sufficient knowledge of effective communicate with deaf people struggle on understanding their child about abstract concept. Apart from that, hearing parents also want to improve their deaf child literacy skills, so it will be easier to receive information and learn. Also, it is easier for deaf children to learn or understand something by using more visuals and repeating them many times.
Based on in-depth interviews and surveys to understand their experiences, preferences, and pain points, my team and I found that most of deaf children are born to hearing parents who do not have sufficient knowledge of effective communicate with deaf people struggle on understanding their child about abstract concept. Apart from that, hearing parents also want to improve their deaf child literacy skills, so it will be easier to receive information and learn. Also, it is easier for deaf children to learn or understand something by using more visuals and repeating them many times.
User Persona
User Persona



Bu Santi and her deaf child
Bu Santi and her deaf child
👤 Background
👤 Background
Parents of deaf children often face unique challenges in nurturing their child's language development. The struggle arises from the difficulty deaf children encounter in grasping linguistic nuances from their surroundings, leading to occasional misinterpretations. A significant hurdle is the limited vocabulary, especially when expressing abstract ideas that required context and visualization. Strengthening deaf children's understanding of abstract concepts contributes not only to the advancement of their literacy skills but also to their overall self-actualization.
Parents of deaf children often face unique challenges in nurturing their child's language development. The struggle arises from the difficulty deaf children encounter in grasping linguistic nuances from their surroundings, leading to occasional misinterpretations. A significant hurdle is the limited vocabulary, especially when expressing abstract ideas that required context and visualization. Strengthening deaf children's understanding of abstract concepts contributes not only to the advancement of their literacy skills but also to their overall self-actualization.
🧩 Needs
🧩 Needs
Parents with intact hearing seek to improve their deaf child's understanding of abstract notions.
Parents with intact hearing seek to improve their deaf child's understanding of abstract notions.
🎯 Motivations
🎯 Motivations
Earlier they (deaf-children) exposed to vocabularies, more efficient the communication between parents and their child and increase their academic potential to growth.
Earlier they (deaf-children) exposed to vocabularies, more efficient the communication between parents and their child and increase their academic potential to growth.
💢 Frustrations
💢 Frustrations
The parents have had difficulty finding easily accessible deaf-friendly educational materials and figuring out how to help their child comprehend.
The parents have had difficulty finding easily accessible deaf-friendly educational materials and figuring out how to help their child comprehend.
Findings Implementation
Findings Implementation
Based on research, my team and I found that in order to learn new concepts and skills children must be able to understand the words being used to describe them. Sometimes deaf children may not understand a new concept or skill because they don't know the meaning of the words being used not because the new skill or concept is too difficult. Deaf children may take longer to learn new words because they don't overhear new words as often as other children.
Based on research, my team and I found that in order to learn new concepts and skills children must be able to understand the words being used to describe them. Sometimes deaf children may not understand a new concept or skill because they don't know the meaning of the words being used not because the new skill or concept is too difficult. Deaf children may take longer to learn new words because they don't overhear new words as often as other children.
Interactive Learning by Storytelling
Interactive Learning by Storytelling
Implemented a storytelling-driven learning approach, creating a library of short stories within Koka that covered a range of abstract concepts. Each story was carefully crafted to be both educational and entertaining, such as show deaf child a picture of the new word, write it down, or use a sign.
Implemented a storytelling-driven learning approach, creating a library of short stories within Koka that covered a range of abstract concepts. Each story was carefully crafted to be both educational and entertaining, such as show deaf child a picture of the new word, write it down, or use a sign.



Learning Modules
Learning Modules
Ensured that sign language is used consistently in the application to reinforce vocabulary and abstract concept understanding. Also practice questions with a study method that is repeated many times and is easy to understand.
Ensured that sign language is used consistently in the application to reinforce vocabulary and abstract concept understanding. Also practice questions with a study method that is repeated many times and is easy to understand.
Design Systems
Design Systems

Interface Design
Interface Design
Easy to navigate the stories
Easy to navigate the stories
Feel the immersive ways to expand their knowledge. We implemented a story-driven learning approach, creating a library of short stories within Koka that covered a range of abstract concepts. We provide many categories to expand vocabulary and use a book parable so user feels the atmosphere of reading a story.
Feel the immersive ways to expand their knowledge. We implemented a story-driven learning approach, creating a library of short stories within Koka that covered a range of abstract concepts. We provide many categories to expand vocabulary and use a book parable so user feels the atmosphere of reading a story.

A fun way to learn vocabulary
A fun way to learn vocabulary
No more worries about tell your children a story with sign language.
No more worries about tell your children a story with sign language.

Learn non-physical concepts easily
Learn non-physical concepts easily
Make sure deaf children already understand about the word by do some quick quiz.
Make sure deaf children already understand about the word by do some quick quiz.








User Testing
User Testing






Who - the people who will use our app and experts, including the Apple team.
Where - through a combination of interviews and hands-on testing, we provide them with a prototype and a TestFlight link.
How - by assigning specific tasks, we observe their interactions, movements, and overall user experiences. This enables to gain valuable insights into how our intended audience engages with KoKa, identifying pain points, preferences, and areas for improvement.
Who - the people who will use our app and experts, including the Apple team.
Where - through a combination of interviews and hands-on testing, we provide them with a prototype and a TestFlight link.
How - by assigning specific tasks, we observe their interactions, movements, and overall user experiences. This enables to gain valuable insights into how our intended audience engages with KoKa, identifying pain points, preferences, and areas for improvement.
Design
Design
Emphasized the importance of the word highlight feature to aid in understanding sign language.
Animated images would be more engaging.
Questions should more accurately represent situations, reducing the need for users to rethink the meaning of images in the options.
Develop ideas that evoke feelings, enhance visuals, and stimulate sensory experiences.
Emphasized the importance of the word highlight feature to aid in understanding sign language.
Animated images would be more engaging.
Questions should more accurately represent situations, reducing the need for users to rethink the meaning of images in the options.
Develop ideas that evoke feelings, enhance visuals, and stimulate sensory experiences.
Idea
Idea
Consider developing an application for flashcards as it could be effective.
Aim for a learning approach where children can perform tasks because they understand, not just by memorization.
Needs to be an introduction, leveling for what kind of target user.
Consider developing an application for flashcards as it could be effective.
Aim for a learning approach where children can perform tasks because they understand, not just by memorization.
Needs to be an introduction, leveling for what kind of target user.
Conclusion
Conclusion
Throughout of this project, I have gained valuable insights and experiences that have significantly contributed to my professional development. The biggest lesson I learned was the paramount importance of adopting a user-centric approach such as the significance of accurate visual representation. User's confusion about the visuals emphasized the need for collaboration with visual storytelling to create images that genuinely resonate with the experiences of the target audience. This collaboration will be a focal point in future development to enhance the app's effectiveness and inclusivity.
Throughout of this project, I have gained valuable insights and experiences that have significantly contributed to my professional development. The biggest lesson I learned was the paramount importance of adopting a user-centric approach such as the significance of accurate visual representation. User's confusion about the visuals emphasized the need for collaboration with visual storytelling to create images that genuinely resonate with the experiences of the target audience. This collaboration will be a focal point in future development to enhance the app's effectiveness and inclusivity.
Made with empathy © 2024 Hannah Nur Azzahrah
Made with empathy © 2024 Hannah Nur Azzahrah