i
Research
Review · 2026-09-20

How AI Simulates a User’s Thoughts

Cover: How AI Simulates a User’s Thoughts

When AI Starts to Understand Who It’s Talking To

An ordinary chatbot sees a message. A good assistant tries to understand who wrote it, what they want, and what has changed over the course of the conversation.

That is harder than it sounds. A user may ask for career advice while actually worrying about a loss of status. They may ask about budgeting while hiding a fear of conflict at home. An important part of the request often remains unspoken.

The Mind2Dialogue paper proposes teaching models this skill through simulation. Researchers create a virtual user with a personality, goals, emotions, and a changing internal state. They then start a conversation with an assistant that can see this state directly. That assistant serves as a teacher. Its responses are used to train an ordinary model that, at deployment time, no longer has access to the hidden data.

The idea resembles learning with information available to the teacher but not the student. The model does not receive a ready-made description of the user’s thoughts. Instead, it learns to respond as if it could reconstruct them from the conversation.

Overview of Mind2Dialogue: the simulator generates a changing user state, the teacher assistant responds with that state in mind, and the student model is trained without access to it.

The Problem of the Hidden User

Modern dialogue datasets are good at teaching models to answer individual questions. But they rarely show how to connect an answer to a person’s circumstances.

There are two obvious sources of data. The first is real conversations between people who know each other well. These contain plenty of useful context: friends remember each other’s past decisions, know their habits, and can infer their intentions. But collecting such conversations at scale would raise serious consent and privacy concerns.

The second source is public dialogue and synthetic data. These scale more easily, but they typically describe the user statically: their age, profession, interests, and a few preferences. Such a profile cannot explain why someone changed their mind, became irritated, or started trusting the other person more.

Mind2Dialogue divides the user’s state into several parts:

🟠 Persistent information — values, biography, constraints, and attitude toward the assistant.

🟠 Current information — mood, unresolved goals, immediate concerns, and conclusions drawn from the previous response.

🟠 Interaction history — a brief conversation summary, the level of trust, and changes caused by previous turns.

This is not a measurement of anyone’s actual psyche. The authors explicitly describe the state as an artificial structure defined by the simulator. Its purpose is to connect the cause of a behavior with the assistant’s response.

For example, a virtual user might be an engineer who values safety and is used to working with limited resources. They begin the conversation by asking about a project deadline. On the surface, it is a technical question. But the user’s state may also include anxiety over a past mistake and a reluctance to sacrifice quality for speed again.

The teacher assistant can see that state. So it responds not only with a schedule, but also with advice about risks, responsibility, and the user’s experience. The student model sees only the profile and message history. It must learn to reconstruct the relevant context on its own.

What Is Mind2Dialogue?

The framework has three parts: a simulator, a dataset, and a trained model.

First, the researchers create three types of scenarios for each persona:

everyday requests;
emotionally significant situations;
long-term questions about growth, relationships, and life decisions.

The simulator then selects the user’s behavior. It has 14 modes to choose from, including information seeking, clarification, analysis, requests for step-by-step help, content creation, and social conversation. This keeps the dialogues from turning into a series of identical questions.

At each turn, the pipeline works roughly as follows:

🟣 the user’s state is updated based on the conversation history;

🟣 a behavior mode is selected;

🟣 the simulator writes the user’s message;

🟣 the teacher assistant generates a response with access to the user’s state;

🟣 the new pair of messages is added to the conversation trajectory.

If the assistant’s response changes the user’s trust, mood, or goal, that change is reflected in the next turn.

Generation pipeline: the profile and scenario define the start of the conversation, the state changes after each turn, and validation checks discard incoherent trajectories.

After generation, each conversation goes through automatic and model-based checks. The system verifies that the structure is correct, the roles alternate properly, the full state trajectory has been recorded, and the user does not contradict their profile. Separate checks assess personality consistency and conflicts with the user’s persistent characteristics.

The conversations that pass the filters are used to create two types of examples:

dialogues containing responses from the teacher assistant;
questions and answers about the user’s preferences, memories, and beliefs.

The training mixture contains 8,244 examples in total: 3,312 dialogue examples and 4,932 question-and-answer examples. The researchers fine-tuned Qwen2.5-7B, Llama-3.1-8B, and OLMo-3-7B using lightweight adapters and four different dataset sizes.

One restriction was preserved throughout: the student model never saw the user’s structured state.

What the Researchers Found

The researchers first compared the new simulator with ordinary profile-based generation. The standard setup had no memory of the user’s changing state and no separate control over behavior.

The difference was small in the early turns. The longer the conversation continued, the more pronounced Mind2Dialogue’s advantage became. By turn 30, topic depth reached an effect size of 1.22, while the personalization of the assistant’s responses also continued to improve as the dialogue progressed. A simple profile was not enough: without a dynamic state, the virtual user gradually lost its connection to the original persona and scenario.

An evaluation of 1,240 filtered conversations found that 1,216 of them — 98.06% — met the criteria for consistency, coherence, alignment between the state and the responses, and relevance.

The models were then tested on three groups of tasks: remembering information about the user, following their preferences, and reasoning about other people’s beliefs and actions.

Personalization quality as the training mixture grows: the full dataset produced the best results for all three models.

Performance on personalization tasks improved for all three models:

🟠 Qwen’s preference-aware generation improved by 33.4 percentage points;

🟠 Llama’s improvement on the same task was 40.9 points;

🟠 OLMo’s improvement reached 26.6 points;

🟠 memory for the profile and hidden preferences improved by 5.6–13.6 points, depending on the model.

The most notable result was the models’ ability to follow preferences in open-ended responses. They became better not only at choosing the correct option, but also at writing an answer that independently took the relevant context into account.

That distinction matters because answer selection and generation are different skills. Qwen, for example, showed a clear improvement in classification with just half of the training mixture, but open-ended generation did not rise sharply until the full dataset was used.

Transfer to Reasoning About Other People

The authors also tested whether the effect went beyond personalization. They used belief-understanding tasks in which the model had to determine what another character knew, what they believed, and what action would follow.

For Qwen, belief prediction accuracy rose from 31% to 44%. Action prediction increased from 23.5% to 31%. Llama showed an even larger improvement: belief prediction rose from 18.5% to 43.3%, while action prediction increased from 39.5% to 57.3%.

Improved performance on tasks involving other people’s beliefs and actions as the amount of training data increases for Llama-3.1-8B.

But the transfer was not consistent across models. OLMo improved on personalization and on one of the belief-related tasks, yet lost 8.2 points on belief prediction and 7 points on action prediction on another test set.

That limits the broader conclusion. Simulation can teach a model to work better with an individual, but improvements in reasoning about other people’s mental states depend on the base model, its training mix, and the specific task.

The results of separate training were also revealing. Dialogue examples were more helpful for open-ended generation. Question-and-answer examples were better for selecting the correct option. The full mixture delivered the best average performance on reasoning tasks while preserving almost all of the generation quality.

Where the Boundaries Lie

Mind2Dialogue addresses the problem of scaling data, but it does not eliminate the risk of simulation errors.

All conversations were created by a single model, GPT-4o-mini. Its style, stereotypes, and mistakes may therefore have carried over into the training set. The researchers did not compare different teachers, model ensembles, or a more powerful simulator.

The user state was also designed in advance by people. It includes persistent and current characteristics, trust, goals, and mood, but it may leave out important details. In addition, an artificial framework does not necessarily match the way a real person’s beliefs change over time.

Finally, the tests do not show how the model would behave in a long conversation with a real user. The benchmarks evaluate individual skills, while the validation process assesses synthetic dialogues. That is not yet a test of an assistant’s long-term usefulness.

There are risks in applying the approach as well. A system that tries to infer a person’s goals and emotions could be used for intrusive profiling, pressure, or manipulation. Personalization should therefore come with clear memory controls, the option to disable it, and honest communication about uncertainty.

Conclusion

Mind2Dialogue proposes teaching AI to understand people through privileged learning. The teacher can see the user’s hidden state and produce a more meaningful response. The student receives only what would be available in an ordinary conversation, but it absorbs some of the teacher’s behavior.

The results point to three conclusions:

🟣 a dynamic state is more useful than a static profile in long conversations;

🟣 synthetic conversations can significantly improve personalization in smaller open models;

🟣 the ability to take an individual into account and the ability to reason about that person’s beliefs are related, but not identical.

For future assistants, this means moving beyond remembering facts to tracking change: what the user wants now, why they changed their mind, and how a previous response affected the conversation. Systems that can reliably understand people’s real long-term goals are still a long way off. But the direction is becoming clear: a model must learn not only to respond to messages, but also to take into account the person behind them.

AI reviews in simple way

Every day we read fresh AI papers and retell the essentials in plain human language — no hype, no fluff. If you want to see where AI agents are heading before everyone else, subscribe.

New reviews — every day

Follow on X