Idea

AI Operators or Creators? Two visions of agency and learning

When seeking to understand how the notion of agency might evolve as learners interact with AI, scenarios play a useful part.
 Co-create with AI

By Kenneth Y. T. Lim, Ahmed Hazyl Hilmy, and Bryan Kuok Zi Wei

Vision 1: the AI Operators

Let us imagine a conversation between two high school students in the city-state of Singapore in the year 2035:

鈥淲hoa, is that GPTutor Pro?鈥 Chen Wei asks, pointing at the PRO icon at the corner of his friend鈥檚 tablet screen. 鈥淗ow did you convince your parents to pay the $200 a month subscription?鈥

鈥淥h they would never!鈥 Adam exclaims. 鈥淢y school got some kind of sponsorship deal with Edu AI. Someone from the company is coming down to make a speech next week.鈥

The two sixteen-year-olds sit across each other in a food court, tablet screens propped on their table next to half-finished bubble teas. 

鈥淯gh, I鈥檓 stuck with GPTutor Basic,鈥 Chen Wei sighed, tapping his own tablet. 鈥淚t crashes whenever I ask it anything complicated, and the token limit is so low. I need to wait鈥 eight more hours before I can finish my geography assignment.鈥

He brings up a dense table of weather data. 鈥淗ow am I supposed to analyse this myself? The metrics dashboard tells me my 鈥榤anual analysis efficiency鈥 is below-standard.鈥

鈥淭hat鈥檚 rough,鈥 Adam replies. 鈥淚f it makes you feel better, even GPTutor Pro has usage limits too. That鈥檚 why some of my classmates got their parents to upgrade to the Max subscription, it costs $2000 a month but they say it鈥檚 totally worth it, because they can basically use it 24/7, no limits on image, video or sound generation either!鈥

鈥淭hat鈥檚 insane!鈥 yells Chen Wei. 鈥淭hey鈥檒l have such an advantage on the upcoming 鈥楢I literacy鈥 exams. Ugh, what are we graded on again?鈥

鈥淟et me check鈥︹ Adam taps his screen. 鈥淧rompt optimization and response evaluation.鈥

鈥淗aha, they expect us to evaluate GPTutor鈥檚 responses? Why? It鈥檚 basically smarter than us,鈥 replies Chen Wei.

My teacher asked us to continue analysing the themes in some short story manually, she said all we needed was pen, paper and our brainpower. Half the class just took a nap.鈥

鈥淲ell, there was that network outage last month.鈥 Adam says. 鈥淚 was in class when it happened. My teacher asked us to continue analysing the themes in some short story manually, she said all we needed was pen, paper and our brainpower. Half the class just took a nap.鈥

鈥淪ame here鈥 laughs Chen Wei. 鈥淢r Lazar just said we needed to 鈥榯hink for ourselves,鈥 and went on and on about how he didn鈥檛 have AI tutors when he was in school. At first it was funny, but I got jealous when he told us about his learning metrics.鈥

鈥淥h what did they use back then?鈥 asks Adam.

鈥淣othing!鈥 says Chen Wei, taking a sip of his bubble tea. 鈥淣o metrics at all! No penalties for 鈥榮pending excessive time solving single problems鈥 or anything.鈥 

鈥淲ell, that was a different world,鈥 Adam frowns. 鈥淎 slower world, ya? It鈥檚 different now. We don鈥檛 need to understand things in detail, AI can do that better than us. We just need to learn how to work with AI effectively. That鈥檚 what my parents always tell me.鈥

鈥淵eah, I guess that makes sense.鈥 Chen Wei looks down at his tablet and sees the notification: 

Reminder: your GPTutor Basic access will refresh in 7 hours 50 minutes. Consider upgrading to Pro ($200/month) for an extra 4 hours of access time per day.

Possible future of AI in education

The above scenario illustrates a possible trajectory for the future of AI in education by extrapolating current trends. Much mainstream discourse around AI presents a narrow, technocentric approach that primarily benefits commercial interests, including calls for a version of AI literacy in which the focus is on mastering prompt engineering to optimize outputs from AI systems. This is frequently combined with fearmongering about how workers will lose their jobs if they do not train in such AI skills, effectively pushing them to become more efficient AI consumers. By treating tech as an inevitability and buying into narrative presented by tech companies (in service of their market expansion goals), such approaches risk turning students into passive consumers of black-box technologies, and ignore deeper questions about when AI should be used at all, how it impacts cognitive processes, and who benefits from its deployment. 

 Co-create with AI

Balzan et al.鈥檚 (2025) concept of the 鈥榓utonomy budget鈥 offers a useful framework....When AI systems are granted more autonomy over decisions, human autonomy decreases proportionally, unless the technology is deliberately designed to enhance rather than diminish human agency.

Recent research findings on the impact of AI technologies on learning provide insights into the risks of uncritical AI adoption. Lee et al. (2025) found that generative AI use significantly reduces users鈥 perceived cognitive effort in tasks requiring critical thinking, which is key to meaningful learning. Zhai and Wibowo鈥檚 (2024) systematic review identified several studies which highlight the risk of overreliance on AI systems, and how this can undermine students鈥 critical thinking and problem-solving skills and reduce their media literacy skills. Mei et al.鈥檚 (2025) study on Generative AI use in creative writing found that AI assistance can lead to a homogenization of ideas, potentially limiting diversity of views in educational settings.

Balzan et al.鈥檚 (2025) concept of the 鈥榓utonomy budget鈥 offers a useful framework. Drawing on self-determination theory, they posit that within any human-AI system, there is a finite 鈥榖udget鈥 of decision-making power. When AI systems are granted more autonomy over decisions, human autonomy decreases proportionally, unless the technology is deliberately designed to enhance rather than diminish human agency. This suggests that the way forward is to carefully consider how educational technologies should be designed to augment rather than supplant human agency.

Balzan et al.鈥檚 (2025) concept of the 鈥榓utonomy budget鈥 offers a useful framework

This approach is supported by UNESCO鈥檚 2024 AI Competency Frameworks for teachers and students. Rather than training efficient AI consumers, these frameworks emphasize the development of critical understanding and creative agency. The student framework in particular outlines 12 competencies across four dimensions (human-centred mindset, ethics of AI, AI techniques and applications, and AI system design) with three progression levels (Understand, Apply, Create) which offer a pathway to a more genuine AI literacy rather than mere AI dependency.

Building on UNESCO鈥檚 frameworks and a more equitable distribution of the 鈥榓utonomy budget,鈥 we can imagine a different future, in which students are creators rather than consumers of technology.

Vision 2: the AI Creators

鈥淗ow鈥檚 your community AI project coming along?鈥 Adam asked, taking a sip of his bubble tea.

鈥淗ere, let me show you,鈥 Chen Wei grins, swiping his tablet to show lines of code. 鈥淢y team managed to customise an open-source model to translate old Hokkien-language radio broadcasts. We鈥檙e applying for a grant from the National Archives to create a data repository which can preserve this part of our language heritage.鈥

鈥淐ool!鈥 Adam exclaims. 鈥淢ost commercial models ignore this kind of 鈥榚conomically insignificant鈥 languages, ya? I鈥檓 impressed you and your team managed this!鈥

鈥淵eah, we couldn鈥檛 have done it without the help of family members who still speak the language. Their input was essential.鈥 Chen Wei replies. 鈥淗ow about your big urban ecology project?鈥

鈥淪o we鈥檝e set up these acoustic sensors in green spaces across the city, right?鈥 Adam brings up a map of Singapore on his tablet, with points scattered across. 鈥淲e鈥檙e using a community-trained AI model which can identify local bird calls to keep track of which birds our sensors detect in the different spaces. It鈥檚 part of a citizen science initiative to monitor local biodiversity, see how it changes over time due to climate change and urban development.鈥 

鈥淲ow, that鈥檚 really cool! Could I set up sensors in my school garden? I hear bird calls there every morning, I just have no idea what kind of bird.鈥 Chen Wei laughs.

鈥淪ure, the source code and sensor schematics are available here, I鈥檒l send you the link.鈥 Adam replies.

鈥淣ice, I鈥檒l share this with my school鈥檚 AI Tinkering Club,鈥 says Chen Wei. 鈥淥h, check this out. Last week, our teacher showed us how to create our own custom language models. We modified the dataset to introduce biases and see how it affected the outputs. Guess what we did with this one!鈥

鈥淥h, it really likes ancient memes, huh?鈥 Adam smiles. 鈥淪end me the dataset sometime. I鈥檒l browse it when I鈥檓 bored. Oh I just remembered, there鈥檚 a community Hackathon this weekend! Have you signed up?鈥

鈥淭he one about coming up with solutions to help the elderly?鈥 says Chen Wei. 鈥淣ot yet, can I join your team?鈥

鈥淵eah, of course!鈥 smiles Adam.

鈥淣ice. I love working on projects like this. It鈥檚 so cool to use tech to make something which can help the community,鈥 says Chen Wei.

鈥淐ouldn鈥檛 agree more,鈥 says Adam. 

Conclusion

Where the first scenario created passive operators dependent on commercial AI systems, this alternative vision nurtures active creators who harness technology for community benefit.

To realize a vision like this for AI in education, it is crucial to move beyond the current chatbot-centric model towards approaches which support metacognition, facilitate deeper engagement, and foster critical thinking while respecting ethical principles (including environmental sustainability.) 

It is crucial to move beyond the current chatbot-centric model towards approaches which support metacognition, facilitate deeper engagement, and foster critical thinking while respecting ethical principles 

By distributing the 鈥渁utonomy budget鈥 in ways that empower rather than diminish the cognitive capacities of human learners, we can create learning environments in which technology serves rather than shapes educational goals. This vision of AI in education, in which students are creators rather than consumers, is intended to be a hopeful alternative to current trajectories, an ideal to strive for as we navigate the integration of AI technologies into education systems across the globe.

References

Balzan, F., Angeli, L., Meulenbroeks, R., & Russo, F. (2025). Tools or crutches? Budgeting human and machine autonomy when introducing GenAI in education. 10.13140/RG.2.2.30020.95368

Hao-Ping (Hank) Lee, Advait Sarkar, Lev Tankelevitch, Ian Drosos, Sean Rintel, Richard Banks, and Nicholas Wilson. 2025. The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort. CHI 鈥25, Yokohama, Japan. 

Lee, H.-P. (Hank), Sarkar, A., Tankelevitch, L., Drosos, I., Rintel, S., Banks, R., & Wilson, N. (2025, April 1). The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers. CHI 2025. 

Siu, A., & Fok, R. (2025). Augmenting Expert Cognition in the Age of Generative AI: Insights from Document-Centric Knowledge Work (No. arXiv:2503.24334). arXiv. 

UNESCO. (2024a). AI competency framework for teachers. UNESCO. 

UNESCO. (2024b). AI competency framework for students. UNESCO. 

Zhai, C., Wibowo, S. & Li, L.D. The effects of over-reliance on AI dialogue systems on students' cognitive abilities: a systematic review. Smart Learn. Environ. 11, 28 (2024). 
 

The ideas expressed here are those of the authors; they are not necessarily the official position of UNESCO and do not commit the Organization

Kenneth Y T Lim is a Senior Research Scientist at the National Institute of Education, Singapore. He leads a small team operating at the intersection of neuroergonomics, the Science of Learning, Data Science, and AI.

Ahmed Hazyl Hilmy works with a research team at Singapore's National Institute of Education that explores how technologies such as generative AI, machine learning and open-source sensors can empower students to be self-directed learners, enabling them to investigate their own well-being and the world around them.

Bryan Kuok Zi Wei is an ASEAN Undergraduate Merit Scholar and an incoming freshman at the National University of Singapore. He is also a student developer exploring the intersection of spatial computing and artificial intelligence for pedagogical applications.