New ChatGPT Research Rates NPCs More Human Than Actual Humans

The research seeks to create fully believable NPCs that can interact with the world around them.

Story Highlights

  • New ChatGPT-based research by Stanford and Google researchers has attempted to create believable NPCs featuring memories and motivations alongside ChatGPT capabilities.
  • The NPCs were simulated in a small Sims-like town, where they performed various daily tasks, engaged in dialogues, hung out together, created plans, held opinions, and the like.
  • The NPCs could rate higher than humans during an interview discussing replays of specific actions. Moreover, they also held a Valentine’s Day event.
  • The new research could wildly accelerate immersion in open-world and MMORPG games featuring human-like NPCs if evolved and used in actual games.

New research has studied just how massively ChatGPT tech improves NPCs if factors like memory and motivation are counted. The experiment led by Google and Stanford researchers was done to create believable and natural NPCs in a Sims-like setting. The agents lived in a small town with many facilities to mimic real life. Moreover, NPCs were rated higher than humans during the study, which seems to be the first time this has happened.

Generative agents create believable simulacra of human behavior for interactive applications. In this work, we demonstrate generative agents by populating a sandbox environment, reminiscent of The Sims, with twenty-five agents. Users can observe and intervene as agents they plan their days, share news, form relationships, and coordinate group activities.”

The goal was to create fully adaptable characters who organically mingle with the player and other NPCs alongside the world around them. The ChatGPT-based generative agents emulated various personalities and communicated with the other NPCs through text. Although formal, the interactions felt natural; the research paper says the dialogues will evolve to feel even more organic in future language models.

Generative agents wake up, cook breakfast, and head to work; artists paint, while authors write; they form opinions, notice each other, and initiate conversations; they remember and reflect on days past as they plan the next day.”

The research paper states the day-to-day life of the ChatGPT-based NPCs in great detail, jotting out certain exchanges to give us a better idea of the immersive potential waiting to be implemented. For instance, NPCs are able to hold healthy and intriguing conversations and go about their day while making plans to meet up at a pub or other included entertainment venues. Moreover, the AI was able to achieve much more than mere dialogues.

A snippet from the research paper discussing an example of daily interaction between two agents.
A snippet from the research paper discussing an example of daily interaction between two agents.

The agents were able to respectively engage in a slew of complex tasks, such as discussing local politics and forming relationships, with these tasks only originating due to the initial motivation. Moreover, the simulation also led to some drastic incidents, such as looking forward to events only to miss out on them due to schedule conflicts. The ChatGPT-fueled NPCs even held a Valentine’s Day party without any direct human intervention. 

For example, starting with only a single user-specified notion that one agent wants to throw a Valentine’s Day party, the agents autonomously spread invitations to the party over the next two days, make new acquaintances, ask each other out on dates to the party, and coordinate to show up for the party together at the right time.”

To add more flavor to the platter, the ChatGPT-based NPCs were rated more human-like than actual humans during the research. At one point during the studies, the humans observed a replay of an NPC. Then they roleplayed interview responses with average performance in the voice of that agent, trying to explain what happened and why specific actions were performed that way.

The following snippet discusses the part where NPCs were rated higher than an average human attempt at an interview.
The following snippet discusses whether the AI can match an average human’s intellect while interviewing in the experiment.

The research continued with the AI agents participating in the interview and answering the thought process behind their decisions. The result saw the AI’s answer being rated as more believable. All of this was made possible with the benefit of added memory and the ability to plan, pursue motivations, and reflect on their actions. The test was conducted to study whether the NPCs could reach a basic level of behavioral competency.

It is worth noting that the research also brought its fair share of demerits; several errors and limitations were analyzed in the NPCs. Bias, inadequate data, safety, sometimes not recognizing that stores are closed, erratic behavior, and the like was noticed. Moreover, it was extremely expensive to run this experiment, as it cost thousands of dollars in ChatGPT tokens to simulate the test for two days.

The possibilities are endless with the new research, as it could fully revolutionize the gaming industry by making NPCs smarter and more pleasant than before. Natural exchanges with the player(s) and the world around them will make NPCs more credible and immersive in an open-world game, filling the world with life like never before. At the time of writing, the demo showcasing the agents can be watched online to observe their daily activities.

Similar Reads: Resident Evil Village’s New Update Removes Controversial Denuvo On Steam.

Did you find this helpful? Leave feedback below.

Thanks! Do share your feedback with us. ⚡

How can we make this post better? Your help would be appreciated. ✍

Subscribe to our newsletter and get up-to-speed gaming updates delivered to your inbox.

We don’t spam! Read more in our privacy policy.

Subscribe to our newsletter and get up-to-speed gaming updates delivered to your inbox.

We don’t spam! Read more in our privacy policy.

Complete Research PapersThe ChatGPT Research Demo

Shameer Sarfaraz is a Senior News Writer on eXputer who loves to keep up with the gaming and entertainment industries devoutly. He has a Bachelor's Degree in Computer Science and several years of experience reporting on games. Besides his passion for breaking news stories, Shahmeer loves spending his leisure time farming away in Stardew Valley. VGC, IGN, GameSpot, Game Rant, TheGamer, GamingBolt, The Verge, NME, Metro, Dot Esports, GameByte, Kotaku Australia, PC Gamer, and more have cited his articles.

Experience: 4+ Years || Education: Bachelor in Computer Science.

Related Articles

Join Our Community

Enjoyed this article? Discuss the latest gaming news, get expert help with guides and errors, and chat about all things gaming on eXputer Forums and Discord Server. Connect with fellow gamers who share your passion by becoming a part of eXputer's community.