isle-portable/docs/multiplayer-world-state-assessment.md

Assessment: Sharing Overworld State in Multiplayer

Context

The multiplayer extension currently syncs only player character positions/animations (~48 bytes at 15 Hz per peer). Each player sees others walking around, but the world itself is completely independent -- everyone has their own copy of plants, buildings, characters, etc. The question is: what would it take to share some of this world state, and is it worth the complexity?

The Short Answer

Feasible, data is tiny (~3 KB total), but architecturally hard. The challenge isn't bandwidth -- it's introducing authority into a currently symmetric system, and intercepting mutations in code designed for single-player direct-mutation patterns. Tier 1 (plants + buildings) would be roughly 700-1,150 new lines across client and server, taking an estimated 2-3x the effort of the original MVP.

---

What State Exists to Share

Category	Count	Bytes (serialized)	Mutation Frequency	Visual Impact
Plants	81	972	Click-driven (low)	HIGH - variant, color, height visible
Buildings	16	161	Click-driven (low)	MEDIUM - mood, animation
Characters (NPCs)	66	1,056	Click-driven (low)	MEDIUM - hat, colors
Vehicle colors	43	~860	Build-screen only	LOW
Environment	2	~60	Rare	LOW
Total		~3,100 bytes

The entire syncable world state fits in a single WebSocket frame. Bandwidth is a non-issue.

The Core Problem: No Authority Model

The current system is fully symmetric -- all peers are equal, the relay server (extensions/src/multiplayer/server/relay.ts) just stamps peer IDs and broadcasts. For shared world state, exactly one peer must be the "source of truth."

Recommended: Server-Assigned Host

The relay server already assigns peer IDs incrementally. Adding host tracking is ~40-60 lines of TypeScript:

• First peer to connect becomes host; server sends MSG_HOST_ASSIGN
• On host disconnect, lowest-ID remaining peer becomes host; server broadcasts new MSG_HOST_ASSIGN
• New peers receive MSG_HOST_ASSIGN on connect so they know who the host is

This is clearly better than client-side election (no race conditions, no timeout-based detection). The server is the one entity that knows the full connection set.

Host Migration Risk

When the host disconnects, the new host has its own local copy of the world (which was being kept in sync). It immediately broadcasts a full snapshot to converge everyone. The data-loss window is tiny -- at most one unbroadcast click. For plants/buildings this is imperceptible.

The Second Core Problem: Intercepting Mutations

This is where the real complexity lives. State mutations happen via direct function calls with no event system:

Player clicks plant -> LegoEntity::Notify() -> SwitchVariant()
    -> PlantManager()->SwitchVariant(this)  // directly mutates g_plantInfo[81]

The Switch* methods in legoplantmanager.cpp, legobuildingmanager.cpp, and legocharactermanager.cpp modify global arrays in-place. There is no observer pattern, no event bus, nothing to hook into.

Recommended: Single Extension Hook in LegoEntity::Notify()

Add one Extensions::Call() invocation in LegoEntity::Notify() (in legoentity.cpp), following the established pattern already used in LegoWorld::Enable(). This is the natural chokepoint -- all click-driven mutations flow through here.

The extension hook would:

• If host: allow mutation locally, then broadcast a MSG_WORLD_EVENT (12 bytes: entity type, index, change type, actor ID)
• If non-host: block the local mutation, send a MSG_WORLD_EVENT_REQUEST (same 12-byte format as MSG_WORLD_EVENT) to the host via the relay, wait for the host's broadcast to apply it

Non-host click latency would be one relay round trip (20-100ms depending on region) -- imperceptible for clicking on plants.

Important edge case: host outside the Isle world. The host may not be in the Isle world when a non-host's MSG_WORLD_EVENT_REQUEST arrives (e.g., the host is in a building interior). The host's m_entity pointers are also NULL in this case, so the host cannot call Switch* methods either. The host must apply the mutation to its data arrays directly (same increment/cycle logic as the Switch* methods, without the ROI visual update), then broadcast the change-type event. This works because the data arrays (g_plantInfo[], g_buildingInfo[]) persist across world unloads.

Why change-type events, not value-based events: The Switch* methods are increment/cycle operations (e.g., SwitchColor does color = (color + 1) % 5), and they combine the data mutation with the visual update (ROI/LOD swap) in a single call. If MSG_WORLD_EVENT carried a resulting value like "color = RED", receivers couldn't easily use the existing Switch* methods -- they'd need separate visual-update-only helpers that don't exist today.

Instead, MSG_WORLD_EVENT carries a change type (e.g., "cycle color on plant 42"). Since WebSocket/TCP guarantees in-order delivery and all peers start from the same snapshot, applying the same sequence of change-type events keeps everyone in sync:

• In-world peers: call the same Switch* method, which increments the data AND updates the ROI
• Out-of-world peers: apply the same increment logic to the data arrays directly (no visual update needed; LoadWorldInfo() rebuilds visuals from the data when re-entering the Isle world)
• Host outside the Isle world: same as out-of-world peers -- apply data increment, then broadcast the event

Synchronization: Hybrid Approach

On join: New peer requests a snapshot from the host. Host serializes using the existing PlantManager::Write() / BuildingManager::Write() / CharacterManager::Write() methods via the existing LegoMemory class (a LegoStorage subclass at legostorage.h:194 that reads/writes to a uint8_t* buffer -- no new adapter class needed). New peer deserializes using the existing Read() methods. This reuses all existing serialization code.

During play: Individual mutations broadcast as 12-byte MSG_WORLD_EVENT messages. Receiving peers that are currently in the Isle world call the same Switch* methods locally to get both data mutation and visual update in one step. Peers that are NOT in the Isle world (in Act 2, a building, etc.) instead write the changed field directly to the g_plantInfo[] / g_buildingInfo[] arrays -- the visual update happens automatically when they re-enter the Isle world and LoadWorldInfo() rebuilds entities from the updated data.

Late joiner edge case: Queue any MSG_WORLD_EVENT messages that arrive between snapshot request and snapshot response, apply them after the snapshot.

Protocol Changes

New message types needed:
  MSG_HOST_ASSIGN          (13 bytes)  - server -> all, announces host peer ID
  MSG_REQUEST_SNAPSHOT      (9 bytes)  - client -> host, request full world state
  MSG_WORLD_SNAPSHOT       (~3.1 KB)   - host -> client, full world state blob
  MSG_WORLD_EVENT          (12 bytes)  - host -> all, single state mutation (change type, not value)
  MSG_WORLD_EVENT_REQUEST  (12 bytes)  - non-host -> host, request a mutation (same format)

Steady-state bandwidth addition: essentially zero (events are click-driven, ~0.1 Hz). Snapshot is a one-time 3 KB message on join.

Tiered Implementation

Tier 1: Plants + Buildings (recommended starting point)

• Value: HIGH -- most visible shared elements. Two players clicking the same flower and seeing each other's changes is the core "shared world" experience.
• Effort: ~700-1,150 new lines of C++ and TypeScript
• Scope: Host election, snapshot sync, event-based deltas, mutation interception hook, visual state application on receiving peers
• Estimated time: 2-3 weeks for someone familiar with the codebase

Tier 2: NPC Character Customization

• Value: MEDIUM -- less frequent but visible
• Effort: ~150-200 additional lines
• Risk: Character customization involves LOD cloning and texture swapping (legocharactermanager.cpp:807-858). Remote triggering could have subtle visual bugs.

Tier 3: Vehicle Colors + Environment

• Value: LOW -- vehicle colors are rarely changed during gameplay, environment changes are cosmetic
• Effort: ~100-150 additional lines

Tier 4: Vehicle World Presence (placement, enter/exit, visibility)

• Value: HIGH -- without this, each player sees all 7 vehicles sitting idle in the world even when another player is driving one. When Player A enters the helicopter, Player B should see it disappear (it's "in use"), and when Player A exits, it should reappear at the exit location for everyone.
• Effort: ~300-500 additional lines (MEDIUM-HIGH complexity)
• Scope:
  • Sync vehicle enter/exit events so vehicles disappear/reappear for all peers
  • Sync vehicle positions on exit (where the vehicle is "parked")
  • Sync custom textures for built vehicles (helicopter windshield, jetski front, etc.)

How vehicles work:

There are 7 vehicles in the Isle world: motorcycle, bike, skateboard, helicopter, jetski, dunebuggy, racecar. Their world state is stored in Act1State as LegoNamedPlane structs (76 bytes each: name + position + direction + up vector). Built vehicles (helicopter, jetski, dunebuggy, racecar) also have custom textures (LegoNamedTexture*).

Vehicle enter/exit lifecycle:

1. Idle: Vehicle is visible in the world via m_roi->SetVisibility(TRUE)
2. Enter (IslePathActor::Enter()): m_roi->SetVisibility(FALSE) -- vehicle disappears, player takes control
3. Active: Vehicle is invisible; dashboard UI is shown; vehicle is the UserActor
4. Exit (IslePathActor::Exit()): m_roi->SetVisibility(TRUE) -- vehicle reappears at exit position

The existing multiplayer MVP already syncs vehicleType in PlayerStateMsg (the remote player rendering knows which vehicle model to show). What's missing is the world-side effect: hiding/showing the idle vehicle entity when any player enters/exits it.

Sync approach:

• MSG_WORLD_EVENT with a new EVENT_VEHICLE_ENTER / EVENT_VEHICLE_EXIT type
• On enter: host broadcasts which vehicle was entered; all peers call SetVisibility(FALSE) on that vehicle's ROI
• On exit: host broadcasts the vehicle exit + new position (the LegoNamedPlane data -- boundary name, position, direction, up); all peers call SetVisibility(TRUE) and update the vehicle's transform
• On snapshot: include which vehicles are currently "in use" (a bitmask, 1 byte) plus the saved LegoNamedPlane for each parked vehicle

Key complexity: Built vehicles have custom textures that are serialized as bitmap data (variable size, potentially several KB each). For Tier 4, syncing textures on join would require including them in the snapshot. An alternative is to skip texture sync initially and use default textures for remote players' built vehicles -- visually imperfect but functional.

Out-of-world handling: Vehicle state is managed by Act1State, which persists across world transitions. RemoveActors() calls UpdatePlane() to save positions when leaving the Isle; PlaceActors() restores them on re-entry. The same direct-write approach from Tier 1 applies: update the LegoNamedPlane data in Act1State when the receiving peer is outside the Isle world.

Data size:

Component	Size
7 vehicle planes	~532 bytes (7 x 76)
Vehicle-in-use bitmask	1 byte
Custom textures (optional)	0-50+ KB (bitmap data)
43 vehicle color strings	~500-1,000 bytes

Estimated Effort Summary

Component	New Lines	Difficulty
relay.ts host tracking	40-60	Easy
protocol.h new messages	100-150	Easy
MemoryStorage adapter	0	LegoMemory already exists in legostorage.h
NetworkManager world sync	200-300	Medium
Mutation hooks + routing	200-400	Hard
Visual state application	100-150	Medium
Out-of-world state handling	50-100	Medium (NULL entity branching, direct array writes)
Extension hook in LegoEntity	5-10	Easy (but architecturally important)
Total (Tier 1)	~750-1,250
Total (Tiers 1-3)	~1,000-1,600
Tier 4: Vehicle enter/exit/visibility	300-500	Medium-Hard (Act1State integration, texture sync)
Total (Tiers 1-4)	~1,300-2,100

For comparison, the current MVP is ~1,620 lines across 8 files. Tier 1 is roughly 60-75% as much code but substantially more complex due to the authority model, two-way communication patterns, out-of-world state handling, and decompiled code hooks.

Open Questions and Risks

1. Sound on remote mutations: ClickSound() uses 3D positional audio via Lego3DSound. Sounds are anchored to the entity's world position and naturally attenuate with distance (min 15, max 100 units; effectively silent beyond ~100 units). This means sounds should be played on remote peers -- a player clicking a plant far away from you will be quiet or silent. The 3D sound system handles this correctly without any special networking logic. The ClickAnimation() visual effect should also play for the same reason.

2. Conflict resolution: Two players click the same plant simultaneously. With host authority, the host processes them sequentially -- the second click advances from the state the first click left it in. Both players see the same result. No special handling needed.

3. State sync for players not in the Isle world (IMPORTANT): When a player leaves the Isle world (enters Act 2, a building interior, etc.), PlantManager()->Reset() and BuildingManager()->Reset() set all m_entity pointers to NULL. Several Switch* methods access m_entity->GetROI() without NULL checks and will crash if called when the entity doesn't exist:

   • CRASHES outside Isle: SwitchColor(), SwitchVariant(), DecrementCounter() (both plant and building) -- access m_entity->GetROI() which is NULL
   • NO-OPS outside Isle: SwitchSound(), SwitchMove(), SwitchMood() -- these use GetInfo(p_entity) which searches g_plantInfo[].m_entity for a matching pointer. When entities are NULL, the search finds nothing and returns NULL, so the method does nothing. They don't crash, but they also don't apply the data change.

   Solution: When receiving state updates from other players while not in the Isle world, ALL methods require direct array writes -- not just the crash-prone ones. The data fields (variant, color, mood, sound, move, counter) persist across world unloads. When the player re-enters the Isle world, LoadWorldInfo() → CreatePlant() / CreateBuilding() reads these fields to create entities with the correct appearance. The receiving code must check info->m_entity != NULL and branch accordingly: if non-NULL, call the LegoEntity::Switch* method (which handles data + visual + sound + animation); if NULL, write the field directly to the data array by index.

4. Testing: Requires testing late-joiner sync, host migration, simultaneous clicks, snapshot + queued events ordering, and state application when players are in different worlds. The existing relay.ts dev server (via wrangler dev) helps, but automated multi-client testing would need a new test harness.

5. World reload: When a player leaves and re-enters the Isle world, PlantManager::LoadWorldInfo() re-creates plants from g_plantInfo[]. As noted in point 3, if the data arrays have been kept in sync via direct writes, the re-created entities will have the correct appearance. This is confirmed to work because CreatePlant() reads g_plantInfo[index].m_variant and g_plantInfo[index].m_color to select the correct LOD list.

Verified Findings & Additional Gotchas (code review)

The following were discovered by cross-checking every claim against the actual source code:

6. LegoMemory already exists (legostorage.h:194): The plan proposed creating a "MemoryStorage adapter" but LegoMemory is already a LegoStorage subclass that reads/writes to a uint8_t* buffer with position tracking. This eliminates ~50-80 lines of estimated work.

7. BuildingManager::SwitchVariant() is disabled by default: g_buildingManagerConfig is initialized to 1 (legobuildingmanager.cpp:222), and SwitchVariant() returns TRUE immediately when g_buildingManagerConfig <= 1. Building variant switching only works if this config is explicitly set to > 1 (via a registry/config setting from the original game). This means building variant sync may be a no-op in practice.

8. BuildingManager::SwitchVariant() creates a new entity: Unlike plant mutations (which swap LOD lists), SwitchVariant() at line 474 calls CreateBuilding(HAUS1_INDEX, CurrentWorld()), which requires the Isle world to be loaded. This mutation cannot be applied via direct array writes for out-of-world peers -- you can write m_variant to the data array, but the visual swap requires CreateBuilding(). For out-of-world peers, the data write is sufficient; LoadWorldInfo() will create the correct variant on re-entry.

9. ClickAnimation() blocks rapid clicks: ClickAnimation() sets m_interaction |= c_disabled (legoentity.cpp:340), preventing further clicks until the animation finishes. Both ClickSound() and ClickAnimation() check !IsInteraction(c_disabled) and skip if set. If a remote world event arrives while an entity is already animating, the data mutation (via the manager's Switch* method) still applies correctly, but the sound and animation for that remote event will be silently skipped. This is consistent with single-player behavior but means rapid multiplayer clicks may have fewer visual/audio effects than expected.

10. Every mutation decrements the interaction counter: ClickAnimation() triggers ScheduleAnimation(), which calls AdjustCounter(-1) for plants and AdjustCounter(-2) for buildings. This means every click-driven mutation decrements the entity's counter as a side effect through the animation system. When the counter reaches 0, the entity sinks and disappears. This is already correctly captured when calling LegoEntity::SwitchVariant() etc. (which call ClickAnimation() internally), but it means the receiving side must call the full LegoEntity::Switch* method (not just the manager method) to get the counter decrement and animation.

11. Plant Write() / Read() asymmetry: Write() saves m_initialCounter but Read() reads into m_counter (then copies to m_initialCounter and calls AdjustHeight()). The snapshot sender must be aware that what gets written is initialCounter, not the current counter. This matters if a plant has been partially decremented -- the snapshot should send the current state, not the initial state. The snapshot serialization should either use the existing Write()/Read() pair as-is (which saves/restores initialCounter and adjusts heights accordingly), or use a custom serialization that captures m_counter directly.

12. Snapshot Read() doesn't update visual positions: PlantManager::Read() calls AdjustHeight() which modifies g_plantInfo[].m_position[1] (Y coordinate) but does NOT call SetLocation() on the entity. If a snapshot is received while in the Isle world, the entity's visual position won't update until the player leaves and re-enters. An additional SetLocation() call per entity is needed after applying a snapshot in-world. Same issue applies to buildings via AdjustHeight() in BuildingManager::Read().

13. PlayerStateMsg is 52 bytes, not 48: Header(9) + actorId(1) + worldId(1) + vehicleType(1) + position(12) + direction(12) + up(12) + speed(4) = 52 bytes. The bandwidth estimate changes negligibly (from 720 to 780 bytes/s per peer at 15 Hz).

Impact Assessment of Verified Findings

None of the verified findings above are architectural blockers. Summary:

• #6 (LegoMemory exists): Positive — reduces work.
• #7 (SwitchVariant disabled): Neutral — less to sync; already handled if config changes.
• #8 (CreateBuilding for SwitchVariant): Already handled — out-of-world peers use direct array writes; LoadWorldInfo() creates the correct variant on re-entry.
• #9 (ClickAnimation blocks rapid clicks): Matches single-player behavior — data still applies, only sound/animation skipped. Prevents audio spam.
• #10 (Counter decrement side effect): Most important finding. Receiving peers must call LegoEntity::Switch*() methods (not PlantManager::Switch*() directly) to get the full effect chain (data + visual + sound + animation + counter decrement). For out-of-world peers, direct array writes must also decrement m_counter and call AdjustHeight().
• #11 (Write/Read asymmetry): Manageable — use existing Write()/Read() pair as-is for snapshots. The sequence "snapshot (initial state) + queued change-type events" produces the correct final state.
• #12 (Snapshot Read doesn't update visuals): Minor — add a SetLocation() loop (~10 lines) after applying a snapshot in-world.
• #13 (52 bytes not 48): Cosmetic correction, no design impact.

Opinion

The host/leader election concern you raised is valid -- it IS the main source of complexity. But in this case, the server-assigned approach keeps it manageable because:

1. The relay server already has the connection lifecycle (it knows who joined/left)
2. Adding host tracking to it is small (~50 lines)
3. Host migration is low-risk because the world state is small and changes are infrequent

The harder part is the mutation interception -- surgically hooking into decompiled game code. But the extension pattern already established a precedent for this (the LegoWorld::Enable() hook), so one more hook in LegoEntity::Notify() is consistent.

Bottom line: Tier 1 (plants + buildings) is a meaningful but manageable extension. It's 2-3x the complexity of the original MVP, not 10x. The architecture is clean (host authority, hybrid sync, single hook), the data volumes are trivial, and the existing serialization code can be reused wholesale. The main risk is the mutation interception in decompiled code, which requires careful testing but is architecturally sound.

I would recommend implementing Tier 1 as a natural next step. Tiers 2-3 are incremental. Tier 4 (vehicle world presence) is independently valuable and could be tackled in parallel with or after Tier 1 -- it addresses one of the most visible multiplayer artifacts (seeing idle vehicles that another player is actually driving).

Key Files

• extensions/src/multiplayer/server/relay.ts - host tracking additions
• extensions/include/extensions/multiplayer/protocol.h - new message types
• extensions/src/multiplayer/networkmanager.cpp - world sync logic
• extensions/include/extensions/multiplayer/networkmanager.h - new fields/methods
• LEGO1/lego/legoomni/src/entity/legoentity.cpp - extension hook in Notify()
• LEGO1/lego/legoomni/src/common/legoplantmanager.cpp - existing Write/Read to reuse
• LEGO1/lego/legoomni/src/common/legobuildingmanager.cpp - existing Write/Read to reuse
• LEGO1/lego/legoomni/include/legoplants.h - LegoPlantInfo struct definition
• LEGO1/lego/legoomni/include/legobuildingmanager.h - LegoBuildingInfo struct definition
• LEGO1/lego/legoomni/include/isle.h - Act1State with vehicle LegoNamedPlane fields
• LEGO1/lego/legoomni/src/worlds/isle.cpp - Act1State::Serialize(), RemoveActors(), PlaceActors()
• LEGO1/lego/legoomni/src/actors/islepathactor.cpp - Enter()/Exit() with SetVisibility toggle
• LEGO1/lego/legoomni/include/legonamedplane.h - LegoNamedPlane struct (position/direction/up)