The prototype I demo is still far from Gwin’s ethical ideal. It’s being built in two parts — a browser extension that flags biased writing and a large language model (LLM) for dialogue — both needing refinement before merging into a single tool. Gwin has me test the extension on Facebook, “because this is absolutely where it needs to be.”
Several comments on the mock profile page are already blurred by wâsikan. I’m mercifully given a problematic comment rather than having to invent one. The sentence — “You cannot be First Nations and Métis” — is immediately underlined. Scrolling over it, a textbox clarifies that while not explicit hate speech, it may reflect a misunderstanding of Indigenous identities and suggests a revision: “You can’t be a registered and treaty status Indian and have a Métis citizenship under the government of Canada, but you can have Métis and First Nations ancestry.” (This I did not know!)
The LLM works differently from other chatbots. Instead of entering a single question or prompt, you’re asked to describe the context in which a statement was made, followed by the statement. This time, I’m not spoon-fed a potentially racist scenario — but I don’t need to be.
Context: I correctly pronounced the app name wasikan kisewatisiwin on my first try but after the founder complimented me on my pronunciation I made a potentially problematic comment.
Comment: I’m practically a native speaker.
I pray “No whammy!” as it thinks and thinks, but the verdict comes back as unconscious bias. “The comment,” I’m told, “is dismissive and disrespectful. It undermines the complexity and depth of Indigenous languages by implying that correct pronunciation of a single phrase makes one ‘practically a native speaker.’”
Gwin beams with pride. Her “little helper” has helped me. But has it? I wonder if it risks making users lazy by offloading their critical thought to an app.
“That is a risk with AI in general,” admits Gwin. “What a lot of people don’t realize is, you do eventually start to learn through osmosis. Even if you’re being lazy about it, you’re still reading this, and it’s going to get through at some point, I hope.”
This article appears in the May 2025 issue of Edify