Country: New Zealand
Phase: Launched
Toi Ohomai Institute of Technology has used Cogniti to build a wide range of AI agents, for different programmes. As part of this, Toi Ohomai have inputted law and case studies from Aotearoa to make content relevant for students. These agents have included but may not be limited to:
Relevance for us:
- Despite the primary purpose of these AI agents being delivery, they demonstrate elements required for formal assessment (e.g., review of learner responses and provision of feedback).
- Toi Ohomai is one of few organisations who have well documented how they conducted evaluations of their agents, both in paper and video.
Key person(s): Josh Burrell, Jonathan Adams and Rochelle Flight
Country: New Zealand
Phase: Launched
Auckland University of Technology has also adopted Cogniti’s technology to create an agent which aids their postgraduate Nursing and Science students in writing research proposals for their Masters programme. This agent does so by bringing together a large set of example abstracts and provides students with feedback and possible edits.
Relevance for us:
- While this is not called an assessment tool, it technically is performing at least one of the functions our AI agent for learner oral assessment aims to do – it reviews someone’s work, compares it to other content, and provides feedback.
Key person(s): Kiri Hunter and Lucy Macnaught
Country: New Zealand
Phase: Launched
kahu.code specialises in creating bilingual text and voice models as well as large-scale translations, with a focus on reo hangarau (tech terminology). Their mission is to “facilitate seamless kōrero (communication) between technology and humans, enabling effective interactions and understanding, supporting the revitalisation of indigenous languages.” Their products include:
They are also in the early stages of developing a transcription tool (not yet named).
Relevance to us:
- Our agent speaks only in English and moreover, uses a speech-to-speech model, while these te reo AI products appear to be built using speech-to-text, text-to-speech and text-to-text models.
- Nevertheless, future AI agents in education could explore the option of agents that either use different voices (e.g., different accents, genders, ages), or can speak in te reo Māori or other languages in order to support all learners effectively.
Key person(s): Michael Puhara and Xaviere Murray-Puhara
Poipoia te kākano, kia puawai.
Country: New Zealand
Phase: Mature
Te Reo Irirangi o Te Hiku o Te Ika (Te Hiku Media), has created a suite of ‘te reo Māori’ natural language processing (NLP) tools that can enable the creation of new digital products and services that leverage te reo Māori speech recognition, including a speech-to-text system (audio transcription), text-to-speech system (TTS), and other pronunciation focussed language tools. For example, see the following products:
- Kaituhi (transcribes spoken Te Reo Māori and New Zealand English into audio and video files)
- Reo (synthesizes Te Reo Māori words, large bodies of text and utterances)
- Reo Ora (provides pronunciation feedback)
- Rongo (supplies users with specialised API keys to ensure kaitiakitanga of Indigenous data).
Relevance to us:
- Our agent speaks only in English and moreover, uses a speech-to-speech model, while these te reo AI products appear to be built using speech-to-text, text-to-speech and text-to-text models.
- Nevertheless, future AI agents in education could explore the option of agents that either use different voices (e.g., different accents, genders, ages), or can speak in te reo Māori or other languages in order to support all learners effectively.
Key person(s): Peter-Lucas Jones
Coach M, Lever Transfer of Learning
Country: Australia
Phase: Launched
Coach M is a text-based AI agent that workplaces can purchase to help employees learn critical skills and improve their on-the-job performance. Over eight weeks, employees engage in three 30-minute instant messaging chats with Coach M. This is possible due to it being based on a database of over 20,000 real-life coaching conversations. These sessions enable employees to reflect on goals and keep themselves accountable. Coach M then tracks their progress and provides insights on how employees are performing.
Relevance to us:
- Given that we are interested in piloting our AI chatbot for learner oral assessment, it is useful seeing how Coach M is incorporated into the workplace – with three 30-minute chats over 8 weeks. This may help us understand the best way to make the use of an AI chatbot in the workplace practical.
Key person(s): Unknown
Country: Australia
Phase: Launched
Deakin Genie is an AI agent developed in 2017 to help students throughout their academic journey, including answering questions about courses, keeping on top of their assignments and planning what to study. It employs advanced natural language processing and machine learning techniques to engage in more natural, context-aware conversations with students. This allows Deakin Genie to understand and respond to complex queries, maintain context throughout interactions, and provide personalised assistance based on individual student needs.
Four years later, Deakin University piloted a new AI automated feedback tool created by FeedbackFruits with students from the Faculty of Sciences and Built Environments. These students were able to upload draft assignments to the tool and get personalised feedback on how well their grammar, structure and referencing aligned with the assessment criteria. For example, if they used the correct tense or abbreviated scientific names accurately. By 2022, the tool had been adopted by 15 courses across multiple faculties and was available to 3800 students.
Relevance for us:
- While Deakin Genie is quite different to the AI agent for learner oral assessment we plan to make, it is impressive in that it was created in 2017. This demonstrates the number of years educators have been exploring AI to improve the student experience.
- The AI automated feedback tool highlights how these tools can be adapted and applied to a wide range of disciplines.
Key person(s): Unknown
Wesmigo, Wesley College
Country: Australia
Phase: Launched
Launched in 2022, Wesmigo is a custom-built generative AI chatbot powered by ChatGPT for international baccalaureate (IB) students at Wesley College. The College wanted to create a safe environment for their students to use AI as a coach for brainstorming and help with assignments, monitored from their existing learning management system. By developing this custom agent, they were able to tailor the responses to be age appropriate, safe for children, have knowledge of the school and the IB curriculum. They also created a companion guide to sit alongside the chatbot, to support students to critically evaluate the chatbot's outputs and understand the limitations of generative AI.
Relevance for us:
- As part of our project, we are also creating various resources to help users think critically about what outputs AI produces and the limitations of this technology through our own ethical considerations table and documenting our lessons learnt which will be published in a playbook at the end of the project.
Key person(s): Unknown