Architectural Facade Perpetual Motion Machine and Controller — Original Paper Explanation

• Memory Storage Method: Stored in an external database in JSON format.

• How Memory is Retrieved: When recalling memory, three weights are considered: Recency, Importance, and Relevance.
• –Recency: Memories closer to the current time have higher recency.
• –Importance: Higher entropy (content not overlapping with other memories, non-routine behavior) increases importance.
• –Relevance: Evaluates the semantic embedding relevance between the current dialogue and stored memories.

• Memory Storage Format: The basic storage unit in the memory stream is a "node," each containing a natural language description and timestamps for when it was created and last retrieved. Details can be found in the nodes.json file in each character's folder. An example of an object file format is as follows:

• Route Calculation: Initially, I thought GPT could fully understand spatial coordinates, allowing Agents to specify their desired coordinates when outputting. However, I realized I was mistaken 😂. In fact, Agents only indicate the destination name in their output, such as "cafe," and the actual movement path on the screen is entirely navigated and rendered automatically by the sandbox game engine.

• Map Storage: The map information is stored in a JSON file using a tree structure, as shown in the image below:

• Map Information Converted to Prompt: When an agent needs to decide whether to move to another area, they are informed of their current location, the areas included in their current location, and the areas they can move to, followed by a dialogue scenario for the agent to make a choice, as shown below:

• The environment itself can be slightly altered by the agents' actions; for example, a restroom can be occupied, and a kitchen stove can be turned on or off, and pipes can leak.

• Interactions between agents are determined by the sandbox game engine, and when the distance between two agents on the map is below a certain threshold, there is a high probability of triggering dialogue, which occurs through natural language interaction.

• Observation: Observational behavior includes both observing and storing the observed content in memory. Observed objects generally include the agents' own thoughts, behaviors of other agents in spatial and temporal overlap on the map, and the states of non-agent objects on the map. Here are some examples of observable content:

• Planning: Describes a sequence of activities the agent plans to undertake in the future, including location and start/end times. Plans are also stored in long-term memory, can be synchronously retrieved, and modified. Plans are generated recursively from broad to detailed: first, give the LLM a character description and an initial time frame for a plan, then let the LLM complete each hour; then recursively feed the LLM again to fill in the details for each hour. Here’s an example of driving the LLM to plan for an agent:

• Reflection: Agents perceive the world and store memories, deciding whether to change their original plans and react based on their memories. Below is a prompt case illustrating how an agent simulates its reaction when encountering another agent: