Our team in Indonesia has experimented with an artificial intelligence (AI) tool to enhance the collection and analysis of qualitative data from teachers and school leaders. Working in partnership with Fortell.ai and Bakti Barito Foundation, we used a digital avatar to capture rich qualitative data through a survey mechanism.
Objective: To explore the effectiveness and efficiency of an AI-powered tool in enhancing qualitative data collection and analysis within our organisation.
The survey was conducted using a digital avatar that interacted with respondents in the local language (Bahasa), making the process engaging and accessible for participants. We used WhatsApp to share the survey with respondents across two districts in East Java. The tool allowed for both selectable and spoken responses, facilitating a comprehensive collection of data. Advanced AI techniques were then employed for data cleaning, categorisation and analysis, ensuring high-quality insights. After efficiently processing the qualitative data, the tool generated detailed reports on various aspects of the educational environment.
Key findings
Programme
- The programme has significantly improved teacher-student interactions, fostering a more supportive and engaging classroom environment. In the interviews, teachers commonly used words like “interactive,” “collaboration,” “growth mindset,” “enthusiastic,” “creativity” and “motivation” to describe their experiences.
- There was a notable development in the formation of collaborative and supportive educational communities among educators.
- The programme enhanced educators’ resilience in overcoming professional challenges, with 68% of respondents attributing their success to the support networks established through the programme.
- Educators reported increased confidence in utilising their professional skills to address challenges, particularly in Kediri City district where 60% felt more competent in handling professional obstacles. They discussed strategies they had adopted to overcome challenges including time constraints, limited learning resources and meeting the needs of all students.
- Educators reported tangible improvements in student learning outcomes, reflecting the programme’s overall positive impact on educational practices.
“The STiR programme significantly aids in the self-development of teachers and principals through effective strategies for student engagement and enabling the implementation of innovative educational practices that prioritise children’s enjoyment of learning.” School Supervisor, Kediri City district
The AI tool
- The digital avatar survey significantly increased respondent engagement, leading to a high quality and quantity of data collected from 554 respondents across two districts.
- The AI tool effectively categorised and analysed the data, providing clear insights into teacher-student interactions, collaborative practices and professional development.
- The AI-driven analysis generated insightful reports that highlighted key areas of improvement and success, aiding better decision-making and strategy formulation.
- The use of AI tools demonstrated scalability and efficiency in data collection and analysis, suggesting potential for broader application in future educational projects.
- Conducting the survey in the local language via the AI tool ensured inclusivity and accuracy in capturing respondents’ perspectives and experiences.
- The user’s responses are recorded by the camera on their device. Consent for this can be challenging in some cultural contexts. The choice of the avatar and its naming and presentation also has to be culturally contextual.
- We experienced a high drop-off rate midway through the interview. We are investigating the underlying causes for this drop-off and will develop strategies to address them.
“My peers and I are thrilled at the prospect of working together to develop learning instruction, such as choosing appropriate and effective learning activities for students to reach their full potential.” Teacher, Lumajang district
Overall, the tool has provided valuable findings and significant learning about the effectiveness of our programme. We look forward to continuing to explore applications of AI tools as part of our monitoring and evaluation activities.
