A study from Charles Darwin University (CDU) warns that Artificial Intelligence (AI) isn’t fair, often showing biases based on race and gender. It also points out that using AI in education without caution is causing global problems.
The study suggests that we should look beyond the excitement about AI and carefully consider the risks of using it in education. AI became really popular in late 2022 and early 2023, but the study wants us to be more thoughtful about its impact.
Main misunderstandings
In the study, the author talks about two big misunderstandings about AI in education. First, many people think AI is neutral and just gives facts, but the author says AI is connected to certain beliefs and biases. Second, some think AI doesn’t treat people unfairly, but the study says AI is actually unfair by its nature. The study also mentions that there aren’t enough women in AI, which adds to the unfairness.
“If we think about how technology actually operates, we realize that there is not one point in the history of humanity when technology is not directly related to specific cultures and values, beliefs and biases, religious beliefs or gender stances,” the author argues.
“There is consistent research and books that are providing examples of AI algorithms that discriminate, grotesquely amplify injustice and inequality, targeting and victimizing the most vulnerable and exposing us all to unseen mechanisms of decision where we have no transparency and possibility of recourse.”
Divergent goals
The author is looking at how the goals of universities and big technology companies, known as “Big Tech,” are moving apart. This gap is particularly noticeable and risky when it comes to using automation, especially AI, in education. They are concerned that not enough thought is being given to using AI in education. This lack of attention is causing problems with how students’ information is used, affecting their privacy and their ability to think critically and be creative.
“Big Tech is driven by the aims of profits and power, control and financial gain. Institutions of education and teachers have very different aims: the advancement of knowledge and to nurture educated, responsible, and active citizens that are able to live a balanced life and bring a positive contribution to their societies,” they explain.
“It is deceiving to say, dangerous to believe, that artificial intelligence is… intelligent. There is no creativity, no critical thinking, no depth or wisdom in what generative AI gives users after a prompt.”
“Intelligence, as a human trait, is a term that describes a very different set of skills and abilities, much more complex and harder to separate, label, measure and manipulate than any computing system associated with the marketing label of AI.”
“If universities and educators want to remain relevant in the future and have a real chance to reach the aims of education, it is important to consider the ethical and intellectual implications of AI.”