feat: Add token data persistence across OpenSWE graphs

[open-swe]

Fixes #683

Overview

This pull request introduces a comprehensive token data persistence mechanism for OpenSWE graphs, enabling:

• Extracting token usage data from GitHub issues
• Initializing graph states with persisted token data
• Updating GitHub issues with current token usage
• Supporting both replace and merge modes for token data management

Key Changes

1. Token Data Reducer Enhancement

   • Added replaceMode to tokenDataReducer
   • Supports complete state replacement or merging
   • Maintains backward compatibility

2. GitHub Issue Utilities

   • Created functions to extract and persist token data
   • Added special XML-like tags for token data storage
   • Integrated with existing issue update mechanisms

3. Graph Initialization

   • Added token data initialization nodes for both planner and programmer graphs
   • Reads token data from GitHub issues at graph startup
   • Ensures clean state initialization

4. Graph Completion

   • Created token data update nodes for both graphs
   • Persists token usage back to the GitHub issue
   • Handles different graph completion scenarios

5. Type System Updates

   • Enhanced type definitions to support new token data format
   • Ensured type safety across reducers and graph nodes

Testing

• Comprehensive unit tests for token data reducer
• End-to-end tests for token data persistence
• Verified build and type compatibility
• Tested extraction, replacement, and merging behaviors

Benefits

• Improved token usage tracking across graph runs
• Persistent state management for AI-driven development
• Flexible and type-safe implementation
• Minimal changes to existing graph architectures

Resolves token data persistence and tracking challenges in the OpenSWE system.

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
open-swe-web	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Aug 6, 2025 6:26pm
open-swe-web-langgraph	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Aug 6, 2025 6:26pm