Features:
- ScreenshotAnalyzer class for VLM-based image analysis
- Real-time analysis during video recording
- Extract likes, comments, tags, category from screenshots
- Frontend display for category badges and tags
- Batch analysis API endpoint
Co-Authored-By: Claude <noreply@anthropic.com>
Features:
- Web Dashboard: FastAPI-based dashboard with Vue.js frontend
- Multi-device support (ADB, HDC, iOS)
- Real-time WebSocket updates for task progress
- Device management with status tracking
- Task queue with execution controls (start/stop/re-execute)
- Detailed task information display (thinking, actions, completion messages)
- Screenshot viewing per device
- LAN deployment support with configurable CORS
- Callback Hooks: Interrupt and modify task execution
- step_callback: Called after each step with StepResult
- before_action_callback: Called before executing action
- Support for task interruption and dynamic task switching
- Example scripts demonstrating callback usage
- Configuration: Environment-based configuration
- .env file support for all settings
- .env.example template with documentation
- Model API configuration (base URL, model name, API key)
- Dashboard configuration (host, port, CORS, device type)
- Phone agent configuration (delays, max steps, language)
Technical improvements:
- Fixed forward reference issue with StepResult
- Added package exports for callback types and configs
- Enhanced dependencies with FastAPI, WebSocket support
- Thread-safe task execution with device locking
- Async WebSocket broadcasting from sync thread pool
Co-Authored-By: Claude <noreply@anthropic.com>
