* fix: gracefully handle remote HTTP URLs for MCP and cache production static assets
* test(mcp): add remote http mcp integration test and fix static etag normalization and fallback error
* feat(storage): add team auto-archive assets policy and background job
* fix(storage): address code review feedback on lock safety, starvation, and permissions
* docs: update readme and expand archive storage documentation with auto-archive details
* feat(storage): log info message on auto-archive job start and finish with archived count
* style(storage): stack age threshold and grace period vertically with updated grace period description
* fix(storage): only log auto-archive info messages when candidate assets are found to process
* feat(storage): add archive storage support for assets
* fix(webui): show archive icon in front of file name in breadcrumb bar
* fix(webui): display archive icon in breadcrumbs when restoring
* refactor(transcode): simplify restore asset workflow to single while loop
* docs(configuration): add archive storage documentation and readme entries
* fix(webui): show archive icon in front of version names and prevent version card overflow
* fix(webui): fix overflow in manage versions dialog scroll area
* fix(webui): prevent manage versions dialog overflow on long file names
* docs(configuration): fix archive storage environment variables and defaults
* fix(storage): address code review findings for archive storage
* feat(mcp): add OAuth 2.1 support with dynamic client registration
* feat(api): alias bare oauth-authorization-server discovery endpoint
* fix(auth): preserve user session on OAuth sign-in redirect to consent
* feat(operations): move MCP to /mcp and add search, comment, metadata, version, and upload operations
- Serve the MCP server at /mcp instead of /api/mcp
- Add search_assets, copy_assets, get_folder_instructions, list_comments,
create_comment, resolve_comment, list_metadata_fields,
update_asset_metadata, create_version_stack, list_versions, and
remove_version on the agent, MCP, and CLI
- Add create_file and create_version (agent, MCP) with Creation Context
metadata, and complete_upload (MCP) for presigned two-step uploads
- Replace the native agent create_file/create_version tools with
Operation-backed ones
- Route the comment-complete, metadata, copy, version stack, and
AGENTS.md read REST endpoints through their Operations
* docs(readme): add built-in MCP server and CLI to features list
New tokens are 32 random bytes with a shumai_ prefix and are returned
only once at creation. The list endpoint returns a 4-character hint
instead of the plaintext. A migration hashes existing tokens in place so
they keep authenticating.
* feat(workflow): migrate workflow engine from temporal to dbos
Replace Temporal and LocalExecutor with DBOS Transact (@dbos-inc/dbos-sdk) as the unified workflow engine. Background tasks, media transcoding, and AI agent workflows now execute with durable steps and task queues directly against PostgreSQL, eliminating the need for an external Temporal cluster and separate polling executors.
* fix(workflow): submit tasks via DBOSClient to allow enqueueing from steps
Enqueuing workflows using DBOS.enqueueWorkflowWithOptions threw a
DBOSInvalidWorkflowTransitionError when triggered from within a running
step or activity (e.g. creating embedding or autofill tasks during
video transcoding).
Use DBOSClient to submit and cancel workflow tasks directly against the
system database, detaching execution from the ambient workflow/step
context.
* feat(web): support SHUMAI_WORKERS environment variable
* fix(workflow): ensure CLI tasks are enqueued to DBOS and run DBOS migrations in global setup
- Initialize workflows and wait for pending DBOS submissions in shumai regenerate-embeddings CLI
- Remove no-op submit bypass and enqueue tasks via DBOSClient in producer and CLI contexts
- Add DBOS migration runner in test global setup to avoid concurrent migration deadlocks across test forks
- Update changelog and add regression tests
* fix(workflow): ensure unique per-instance executor identity for worker replicas
- Derive unique per-instance DBOS executor IDs across worker replicas
- Support SHUMAI_WORKER_ID, DBOS__VMID, and POD_NAME (Kubernetes Downward API)
- Disambiguate multi-replica bare metal/container deployments with host, PID, and instance suffix
- Prevent startup recovery from re-enqueueing workflows actively executed by other live workers
- Add multi-instance startup recovery tests and update deployment documentation
* fix(workflow): only register listened queues and update concurrency on change
- Only register queues that the executor instance actively listens to
- Use always_update conflict resolution so environment variable changes take effect on restart
- Prevent dedicated workers from overwriting unmanaged queue concurrency configurations
- Add tests verifying concurrency updates and queue isolation across worker roles
* refactor(workflow): simplify activities to use defineStep and direct calls (#482)
* refactor(workflow): simplify activities to use defineStep and direct calls
- Wrap activities using defineStep from @shumai/workflow-core
- Remove obsolete getActivities, registerActivities, dynamic activity proxies, and workerQueue arguments
- Remove executor.ts and registry.ts, consolidating workflow registration into workflow.ts
- Call activities directly across transcode and agent workflows
- Update all corresponding workflow tests and developer guide documentation
* fix(workflow): properly detect DBOSWorkflowCancelledError in runOnCancel fallback
- DBOSWorkflowCancelledError in DBOS SDK does not set name, inheriting 'Error'
- Implement isDbosWorkflowCancelledError checking instanceof, constructor.name, and dbosErrorCode
- Update unit tests to verify real DBOS SDK cancellation error instances
* docs(workflow): update documentation and readme for dbos migration
- Rename docs/configuration/temporal.mdx to docs/configuration/distributed.mdx
- Document DBOS-based distributed worker architecture and task queues
- Remove obsolete docker-compose/temporal/
- Update environment variables documentation in docs/configuration/env-variables.mdx
- Update references in README.md, README_CN.md, docs/docs.json, and related guides
* feat(deploy): implement KEDA ScaledJob and scale-to-zero On-Demand transcoding (#483)
* feat(deploy): add shumai-transcode docker image and k8s autoscaling example with garage s3
* docs(k8s): document port-forwarding and in-cluster s3 domain mapping
* feat(storage): support public s3 endpoint for browser uploads and update k8s example
* fix(k8s): configure s3 bucket cors rules in garage initialization
* fix(k8s): increase transcode worker memory limit to 4Gi for 4K video encoding
* feat(deploy): add AWS EKS deployment with Graviton3 Spot nodegroups and autoscaling
* docs(deploy): redesign EKS documentation, rename k8s to eks, and add scalable deployment feature
* docs: rephrase DBOS feature bullet to Durable Workflows via DBOS
* docs(eks): upgrade default instances to Graviton5 c9g.large and c9g.xlarge
* feat(eks): use On-Demand for general nodegroup and add spot capacity diversification
* docs(eks): fix Architecture diagram to locate all transcode worker pods in Transcode Compute Pool
* feat(deploy): implement KEDA ScaledJob and scale-to-zero On-Demand transcoding
* feat(transcode): support idle-timeout auto-drain for KEDA scaled jobs
* fix(deploy): fix EKS deployment manifests and documentation based on cluster verification
* feat(embedding): update compose tiers, docs, and add regenerate-embeddings CLI
- Add Lite, Embedding, and Full Docker Compose configurations (and Aliyun mirrors)
- Set CONCURRENCY_AGENT to 1 for compose files containing embedding-server
- Update README and README_CN with compose options, recommended RAM, and semantic search links
- Add LiteRT-LM Embedding Server setup guide in docs/using-shumai/embedding-server.mdx
- Add shumai regenerate-embeddings CLI command and EmbeddingService to regenerate embeddings across teams
- Add comprehensive test coverage for EmbeddingService
* fix(docker): remove basic auth for turntable-renderer in full compose
* fix(agent): lock and disable embedding agent when ENABLE_EMBEDDING_AGENT is false
Ensure that when ENABLE_EMBEDDING_AGENT is set to 'false', existing embedding agents are automatically disabled on startup, marked as read-only, and blocked from manual API modifications or creations. Additionally guard background task creation and semantic search when the environment variable disables embedding agents.
* test(upload): remove flaky status assertion on workflow tasks
* feat(agent): support gemma-embedding-2-openai provider
Add support for local LiteRT-LM Gemma Embedding 2 provider with 768-dimensional vector embeddings, environment-configured read-only embedding agents, 16-frame uniform sampling for video chunks, and automatic WebP-to-JPEG conversion.
* refactor(agent): remove unused legacy generateEmbeddingActivity
* chore(agent): align sharp version to 0.35.4
* refactor(agent): rename embedding server env to GEMMA_EMBEDDING_OPENAI_BASE_URL
* refactor(agent,transcode): use native Bun.Archive for video chunk frames
* fix(transcode,agent): populate buffer entries in Bun.Archive and validate frame sizes
* feat(asset): show poster and hover preview while video is transcoding
Generate and persist the sprite (and its poster) before the proxy
transcodes run, so the poster/sprite are available in the file list
while the asset is still processing.
Render the preview in the file card behind a translucent processing
overlay instead of a blank skeleton, and replace hardcoded status text
with existing i18n keys.
* feat(asset): pulse the cover and show Preparing/Uploading labels while processing
Drop the processing text overlay on the file card preview in favour of a
subtle pulsing opacity on the cover, and show "Uploading..."/"Preparing..."
in the creator row so the real author and date only appear once the asset
is ready.
* feat(asset): use a hollow ring for the preparing placeholder
Match the geometry of the upload progress ring (empty inside, no
percentage) and hide the duration badge while processing, so the
upload-to-processing transition reads as one continuous animation.
* style(asset): shrink-only preparing ring in muted grey at fixed opacity
Animate only the ring size (1 -> 0.8 -> 1) and hold a constant 0.6
opacity, using a muted grey stroke instead of primary.
* feat(asset): improve Recently Deleted previews and retention indicators
- Include soft-deleted children when building folder previews for the
Recently Deleted view, and resolve deleted version stacks to their
latest version so a trashed folder shows what was inside it.
- Add a "days left" badge (clock + Nd) to file and folder cards in the
Recently Deleted view, placed to the left of the comments badge.
- Fix an issue where deleting or restoring a version stack from the file
list did nothing because the WebUI dropped version_stack items before
calling the API.
- Share the 30-day trash retention window through TRASH_RETENTION_DAYS.
* test(asset): use typed MediaInfo in recently-deleted preview tests
Replace the explicit any cast with a fully typed MediaInfo object so the new tests comply with the no-explicit-any policy.
* feat(sandbox): abstract SandboxService and hot-reload allowed domains
Introduce SandboxService with pluggable SandboxProvider in @shumai/core. Eliminate disruptive per-session sandbox resets by hot-reloading allowed domains via updateConfig, isolate violations per commandId, and eagerly initialize sandbox at worker/server boot.
* fix(sandbox): isolate command violations and serialize concurrent domain sync
Strictly isolate getBlockedHost per commandId to prevent false-positive blocked reporting on concurrent allowed commands. Serialize syncAllowedDomains to ensure concurrent requests during initialization or updates are never silently dropped. Add comprehensive unit tests for LocalSandboxProvider and concurrent bash commands.
* fix(agent): do not synchronize sandbox when allowedDomains is omitted
Make allowedDomains optional in CreateAgentSessionParams and only invoke sandboxService.syncAllowedDomains when allowedDomains is defined. Omit allowedDomains in generateSessionNameActivity so background chat title generation never overwrites the live sandbox allowlist.
* chore(deps): upgrade bun to 1.4.2 and update packages
- Upgrade Bun to 1.4.2 in Dockerfile, CI workflows, and release workflows.
- Update dependencies across workspace with Bun 1.4.2.
- Preserve @earendil-works/pi-agent-core at 0.82.1.
- Retain stable compatible versions for database adapters and pdfjs-dist.
- Add explicit Buffer type annotation in transcode service.
* chore(deps): upgrade prisma to 7.10.0, pg to 8.23.0, and pdfjs-dist to 6.3.289
* chore(deps): revert dotenv-expand to 13.0.0
* feat(agent): store preset avatars as real files in s3 storage
* fix(agent): use inline base64 previews in dialog and remove static avatar files
* feat(agent): add 4 avatar presets and track avatarPreset in agent config
* refactor(agent): consolidate preset avatar base64 data in dtos
* feat(provider): vendor and adapt pi model generator
- Vendor generate-models.ts, model-data.ts, and models-dev-reasoning-options.ts from @earendil-works/pi tag v0.82.1
- Adapt imports to use @earendil-works/pi-ai and expose generateModels programmatic function
- Add compare.test.ts to verify vendored generator against original built-in catalog
- Add packages/core/src/provider/generator to eslint ignores
* feat(provider): add provider and model sync api and ui
* feat(webui): add checkbox for existing providers and clean dialog description
* feat(webui): add expand all and collapse all to sync providers dialog
* refactor(provider): remove compare.test.ts and cli overhead from generate-models
* fix(provider): add 30s timeout and strict error handling to sync catalog fetching
* fix(e2e): eliminate drag-and-drop race condition on webkit
Allow requestAnimationFrame collision updates to settle in dragCard helper before releasing pointer, and scope fileCard locator via data-testid to avoid matching sidebar tree items.
* feat(provider): optimize provider and model configuration management
* style(provider): use default tabs variant in provider settings dialog
* style(provider): make tabs list full width
* feat(provider): make model card row clickable and remove pencil edit icon
* feat(settings): persist active settings tab in url hash
* feat(agent): add search box and alphabetical sorting for provider and model selectors
* refactor(providers): remove frontend pagination and display all models in scrollable list
* fix(providers): address code review findings for model editing, i18n, and api protocol propagation
* feat(project): add recent viewed files section to project folder tree
* feat(webui): disable toolbar buttons and context menu in recents page
* test(core): optimize recents cap test execution time
* feat(webui): show hint text in recents page top toolbar
* feat(webui): rename recents section to Recently Viewed
* refactor(core): consolidate recents methods into AssetService
* fix(api): forward pagination parameters in folder children endpoint (#349)
* fix(project-recents): scope views and disable recents mutations
* fix(api): allow recent views in demo mode
* fix(api): limit demo recent view exception to post
* feat(auth): add admin password reset CLI command and reset password web UI
* fix(auth): invalidate previous reset tokens and use AsyncLocalStorage for link capture
* fix(webui): update sidebar selection styling, kanban active state, and pointer cursors
* feat(webui): move dashboard to left sidebar and prevent mount animation
* fix(e2e): update create-project test to click Home button in sidebar
* feat(kanban): implement AI-native kanban database models, services, and REST APIs
* feat(webui): implement team kanban board and task management
* style(webui): increase kanban dialog widths and form container
* fix(webui): ensure kanban dialogs override sm:max-w-lg base class
* style(webui): set edit task dialog max width to 5xl
* chore: untrack kanban plan markdown files
* feat(webui): update kanban page layout to 2 columns and refine task activity UI
* fix(webui): constrain kanban column and board heights for vertical scrolling
* feat(kanban): unify task status transition into updateTask API and allow unconstrained human task transitions
* fix(webui): add optimistic updates to kanban drag-and-drop to eliminate flash
* refactor(webui): remove client-side search box from kanban header
* feat(kanban): redesign task dialog comments area and add attachment support
* refactor(webui): remove top status action bar from task info dialog
* fix(webui): narrow query cache predicate and add defensive guards for kanban drag optimistic update
* feat(kanban): add drag-and-drop task reordering with fractional indexing (#331)
* feat(kanban): add drag-and-drop task reordering with fractional indexing
* fix(kanban): improve card drop zones, snap indicators, and column highlight
* fix(kanban): enable card droppables only during active drag
* fix(kanban): refine hover styles and drop indicators for column boundaries
* fix(kanban): unify bottom drop indicator and fix top indicator clipping
* fix(kanban): ensure full column highlight and full coverage drop target
* minor change
* feat(kanban): allow agent tasks free drag-and-drop and enforce status change permissions (#332)
* refactor(kanban): rename task_type_agentic translation keys to task_type_agent
* feat(kanban): refactor task type enum to isAgentTask boolean (#333)
* refactor(kanban): remove phase 2 agent execution logic and streamline phase 1 kanban
* feat(kanban): add notifications and audit logging for kanban (#334)
* feat(kanban): redesign config area layout and add parent tasks multi-selector (#335)
* feat(webui): redesign kanban task dialog config area
* feat(kanban): simplify task dependencies with parent tasks multi-selector
* refactor(kanban): remove unused links routes and legacy dependency methods
* feat(kanban): connect assets and kanban tasks with many-to-many relationship (#336)
* feat(kanban): connect assets and kanban tasks with many-to-many relationship
* feat(kanban): improve asset picker layout, infinite scrolling, and breadcrumb icon styling
* fix(kanban): ensure asset picker scrollarea is scrollable with min-h-0 and shrink-0 flex styling
* fix(kanban): hide recently deleted in folder tree picker and adjust header padding
* fix(kanban): use lucide files icon instead of paperclip for linked assets
* feat(kanban): improve task deletion, goal sidebar interaction, and card styling (#337)
* feat(kanban): improve task deletion, goal sidebar interaction, and card styling
* feat(kanban): move agent task badge after priority and update to orange style
* feat(kanban): add status Compare-And-Swap (CAS) to prevent drag-and-drop race conditions (#338)
* feat(kanban): add status Compare-And-Swap (CAS) to prevent drag-and-drop race conditions
* style(kanban): rotate kanban icon 180 degrees in sidebar and top nav
* style(kanban): remove rotate-180 from SquareKanban icons
* feat(kanban): add unassigned goal record and fix all tasks count (#339)
* feat(kanban): add unassigned goal record and fix all tasks count
* feat(kanban): toggle task count with three-dot action button on goal card hover
* fix(ci): pin bun version to 1.3.14 across CI and Docker (#340)
* fix(webui): truncate goal name to max 2 lines in kanban sidebar (#341)
* feat(quota): add database-backed resource quota system
* feat(webui): add resource quota management in team settings (#319)
* feat(webui): add resource quota settings in team management
* refactor(webui): update quotas list to full row layout and restrict skill/mcp to select list
* feat(quota): refactor quota system to 2-level rules and records
* fix(webui): fix overflow and scroll area in quota usage records dialog
* fix(webui): ensure quota records scroll area has explicit max height
* feat(webui): improve quota cards interaction and restrict editable fields in edit mode
* fix(quota): serialize initial records, validate merged updates, and reset on dimension changes (#320)
* feat(quota): replace network quota with agent tools quota (#321)
* feat(webui): show remaining time until next refresh in quota usage records
* fix(webui): rename bash quota resource to Agent Bash Calls
* refactor(quota): remove unused reserved field from quota records
* refactor(quota): remove quota rule cache (#322)