* feat(operations): add create_project operation across agent, mcp, and cli
* fix(api): remove legacy team creation endpoint
* fix(api): preserve ProjectInfo response on POST /teams/:teamId/projects
* feat(cli): add standalone downloads and installers
* fix(cli): silence PowerShell download progress
* fix(cli): use framework APIs for Windows verification
* fix(cli): preserve null backup path during Windows updates
* docs(cli): translate native installation quickstart into Chinese
* refactor(agent)!: migrate sessions to Pi Durable
Replace patched AgentHarness storage with per-session SQLite and PostgreSQL commit mirroring. Migrate legacy history automatically and run agent queues with the main server.
BREAKING CHANGE: Remove standalone agent workers and return native Pi entry records from chat history APIs.
* fix(agent): constrain session log dialog scrolling
Keep the header visible and wrap long output while log entries and expanded records scroll within the dialog. Cover desktop and narrow viewports through the dashboard Sessions flow.
* fix(agent): hide entry IDs from session log card headers
Retain internal entry IDs in expanded raw records for debugging. Verify that card headers omit the IDs while raw JSON preserves them.
* test(e2e): handle browser wheel limits in session log checks
Verify that a normal wheel event moves the viewport before explicitly scrolling to the final record. Keep the dialog bounds, fixed header, wrapping, and expanded-record assertions.
* fix(agent): select model providers without inheriting unrelated auth
* fix(webui): prevent resize feedback when toggling agent panel
* test(agent): reproduce concurrent comment session races
* fix(agent): serialize comment sessions and deduplicate history
* docs(changelog): consolidate Pi Durable changes into one entry
* fix(share,file-browser): improve public share opening and multi-selection interactions
* docs(changelog): merge release notes into single entry with Frame.io behavior change details
* fix(file-browser,share): prevent duplicate double-click navigation and fix stale range anchor
* fix: gracefully handle remote HTTP URLs for MCP and cache production static assets
* test(mcp): add remote http mcp integration test and fix static etag normalization and fallback error
* fix(security): improve access control and storage security
* fix(security): set NODE_ENV in dockerfiles and sign local storage get urls with lru cache
* feat(storage): add team auto-archive assets policy and background job
* fix(storage): address code review feedback on lock safety, starvation, and permissions
* docs: update readme and expand archive storage documentation with auto-archive details
* feat(storage): log info message on auto-archive job start and finish with archived count
* style(storage): stack age threshold and grace period vertically with updated grace period description
* fix(storage): only log auto-archive info messages when candidate assets are found to process
* feat(storage): add archive storage support for assets
* fix(webui): show archive icon in front of file name in breadcrumb bar
* fix(webui): display archive icon in breadcrumbs when restoring
* refactor(transcode): simplify restore asset workflow to single while loop
* docs(configuration): add archive storage documentation and readme entries
* fix(webui): show archive icon in front of version names and prevent version card overflow
* fix(webui): fix overflow in manage versions dialog scroll area
* fix(webui): prevent manage versions dialog overflow on long file names
* docs(configuration): fix archive storage environment variables and defaults
* fix(storage): address code review findings for archive storage
* feat(upload): simplify upload file list display and add live speed and ETA
* fix(upload): retain authoritative server search results and handle local failed upload state gracefully
* feat(file): optimize upload and transcoding status polling with batch api
* fix(webui): throttle search invalidation during upload and fix stuck 100% progress ring
* fix(webui): deduplicate upload search invalidation and stabilize batch polling
* feat(upload): state-based retry tracking and resilient gateway error handling
* fix(upload): check non-retryable statuses before offline state in isNetworkIssue
* fix(core): strip trailing slashes when normalizing auth and MCP resource URLs
* docs: document BETTER_AUTH_URL in README and quickstart guides
* docs: prioritize AWS_ENDPOINT_URL_S3 and clarify applicability to local storage
* docs: refine AWS_ENDPOINT_URL_S3 guidance for local storage deployments
* feat(mcp): add OAuth 2.1 support with dynamic client registration
* feat(api): alias bare oauth-authorization-server discovery endpoint
* fix(auth): preserve user session on OAuth sign-in redirect to consent
* feat(operations): move MCP to /mcp and add search, comment, metadata, version, and upload operations
- Serve the MCP server at /mcp instead of /api/mcp
- Add search_assets, copy_assets, get_folder_instructions, list_comments,
create_comment, resolve_comment, list_metadata_fields,
update_asset_metadata, create_version_stack, list_versions, and
remove_version on the agent, MCP, and CLI
- Add create_file and create_version (agent, MCP) with Creation Context
metadata, and complete_upload (MCP) for presigned two-step uploads
- Replace the native agent create_file/create_version tools with
Operation-backed ones
- Route the comment-complete, metadata, copy, version stack, and
AGENTS.md read REST endpoints through their Operations
* docs(readme): add built-in MCP server and CLI to features list
* feat(asset-read): expose read_asset on MCP and the CLI
Enable the mcp and cli surfaces for read_asset and get_asset_render.
- MCP: add per-Operation tool extensions. The read presenter attaches up
to 8 images (2 MB each) inline, lists image links, supports
inlineImages: false, and tells the model to call get_asset_render when
a render is pending. Storage keys are stripped from the result.
- CLI: generated commands can flatten object inputs into prefixed flags
(cli.flatten) and omit fields (cli.omit); add per-command extensions.
New `read` and `render` commands print image links, download them with
--out, and support --no-wait with a printed `render <taskId>` hint.
- Round frame timestamps in labels to 3 decimals.
* fix(mcp): make tool input schemas portable to single-type dialects
Nullable inputs were emitted as `type: ["number", "null"]` (or a `null`
anyOf branch), which clients that map tool schemas onto an OpenAPI-style
subset (e.g. Gemini function declarations) may reject.
- Make read_asset's startPage, endPage, and degree optional instead of
nullable.
- Move null handling into a shared dropNullOptionals helper in
@shumai/operations that also strips nulls inside nested config
objects. The agent uses it, and the MCP server applies it before the
SDK validates arguments, so models that send null keep working.
- Test that no Operation input schema (and no listed MCP tool) uses a
nullable type.
* feat(asset-download): share download_asset across agent, MCP and CLI
Turn the agent-only download_asset tool into an Operation on all three
surfaces.
- download_asset takes up to 50 file or version stack IDs and returns
presigned links. proxy (default true) picks the web preview when there
is one, as the agent always did; proxy: false returns the original.
Folders are rejected. Read is checked on every ID before anything runs.
- Agent: an extension saves the files into the .pi sandbox and keeps the
agent-only storage key mode (e.g. frames from read_asset). Agent tool
extensions gain description, parameterOverrides and intercept.
- CLI: `shumai-cli download <assetId...> [--out <dir>] [--original]`
streams files to disk without overwriting existing names.
- read_asset's unsupported-type error now names the right way to
download on each surface (download_asset, or `shumai-cli download`).
- Add the Download Asset toggle to agent settings.
Replace the monolithic agent read_asset tool with a reader registry in
@shumai/core/src/asset-read (model3d, image, video, document) behind a
shared pipeline that handles access checks, version stacks, annotations,
render tasks, and waiting.
- Add read_asset and get_asset_render Operations (agent surface only).
Renders that outlast the caller's wait budget return "pending" with the
workflow task ID; the read request is stored on the task payload so
get_asset_render works across restarts and instances (requester only).
- Add workflowService.waitFor and presign expiry support.
- Keep agent output compatible via an agent tool extension (s3KeyOnly,
image blocks, session image details); autofill keeps its team-scoped tool.
- Cap video frames at 20 per call; add the get_asset_render agent toggle.
Rebuild the CLI on commander. Commands for every cli-surface Operation
(project ls, ls, mkdir, rename, move/mv, delete/rm) are generated from
@shumai/operations: positionals, options, choices, numeric parsing and
help text come from the Zod input schema. They call POST /api/ops/:name
with x-shumai-client: cli.
Existing invocations keep working. Adds --json, ls --type/--first/
--after, typo suggestions, and generated help. upload and create-version
stay hand-written. Drops the unused @shumai/core dependency.
Add a stateless Streamable HTTP MCP server at /api/mcp that exposes every
mcp-surface Operation with its input/output schemas and annotations, and
POST /api/ops/:name for the CLI. Both require an API token (session
cookies are rejected), run Operations as the token's user, honor demo
read-only mode, and record via mcp/cli/api in audit logs.
Also make list_projects toggleable in agent settings and document MCP
client setup.
Introduce @shumai/operations (pure definitions: Zod schemas, metadata,
CLI hints) and @shumai/core/src/operations (implementOperation and the
runOperation pipeline: validate, authorize, prepare, execute, validate
output, audit).
Migrate list_assets, create_folder, rename_asset, move_assets and
delete_asset to Operations, and add list_projects. The agent now builds
these tools from the registry, and the folder create/rename, file
rename and reparent routes call the same Operations.
Audit logs gain a nullable via column recording the surface. A lint
rule keeps the Prisma client out of Operation implementations.
read_thread returned any comment thread by ID. It now requires Read on
the thread's asset for the acting user, and confines system agents
without a user to their own team.
create_file and create_version uploaded to storage before checking Edit
permission, leaving orphaned objects on denied calls. The permission
check now runs first.
New tokens are 32 random bytes with a shumai_ prefix and are returned
only once at creation. The list endpoint returns a 4-character hint
instead of the plaintext. A migration hashes existing tokens in place so
they keep authenticating.
* fix(webui): prevent clipping of long text overlay and date picker in cards
* docs: update DeepWiki badge url in README and README_CN
* fix(webui): preserve expanded overlay height and textarea style in LongTextField
* fix(webui): add bottom padding to file list to prevent screen clipping of expanded fields
* fix(webui): expand directly into edit mode on single click for LongTextField
* fix(webui): prevent file selection when interacting with metadata fields in cards and list rows
* feat(dashboard): add workflow tasks monitoring and stopping to team dashboard
* fix(asset): retain workflow tasks on asset purge and mark active tasks as failed
* style(webui): add edge padding to audit logs and workflow tasks tables
* fix(workflow): atomically update asset status to failed when task is stopped
* fix(workflow): propagate cancellation errors, guard concurrent task stop, and localize UI
* docs(changelog): keep only added log for workflow tasks dashboard
* test(provider): mock upstream catalog api calls using saved fixtures
* feat(dashboard): show file name, size, and project name in workflow tasks list
- Upgrade Bun to 1.4.4 across Dockerfiles, CI workflows, and release configurations.
- Update @types/bun and bun-types.
- Remove eslint-plugin-prettier and update format script to use native bun fmt.
- Configure .prettierignore to exclude packages/webui/public and minified files.
* fix(webui): fix loading skeleton layout mismatches and keep left carousel visible
* fix(webui): update mobile file list skeleton to match card layout
* fix(webui): blur video poster before playback with instant cut on play
* docs: consolidate webui changelog entries into single line
* fix(transcode): ensure durable file exchange and crash recovery across workflow steps
* fix(transcode): recognize AWS SDK NoSuchKey by name and add workflow E2E recovery test
* feat(workflow): migrate workflow engine from temporal to dbos
Replace Temporal and LocalExecutor with DBOS Transact (@dbos-inc/dbos-sdk) as the unified workflow engine. Background tasks, media transcoding, and AI agent workflows now execute with durable steps and task queues directly against PostgreSQL, eliminating the need for an external Temporal cluster and separate polling executors.
* fix(workflow): submit tasks via DBOSClient to allow enqueueing from steps
Enqueuing workflows using DBOS.enqueueWorkflowWithOptions threw a
DBOSInvalidWorkflowTransitionError when triggered from within a running
step or activity (e.g. creating embedding or autofill tasks during
video transcoding).
Use DBOSClient to submit and cancel workflow tasks directly against the
system database, detaching execution from the ambient workflow/step
context.
* feat(web): support SHUMAI_WORKERS environment variable
* fix(workflow): ensure CLI tasks are enqueued to DBOS and run DBOS migrations in global setup
- Initialize workflows and wait for pending DBOS submissions in shumai regenerate-embeddings CLI
- Remove no-op submit bypass and enqueue tasks via DBOSClient in producer and CLI contexts
- Add DBOS migration runner in test global setup to avoid concurrent migration deadlocks across test forks
- Update changelog and add regression tests
* fix(workflow): ensure unique per-instance executor identity for worker replicas
- Derive unique per-instance DBOS executor IDs across worker replicas
- Support SHUMAI_WORKER_ID, DBOS__VMID, and POD_NAME (Kubernetes Downward API)
- Disambiguate multi-replica bare metal/container deployments with host, PID, and instance suffix
- Prevent startup recovery from re-enqueueing workflows actively executed by other live workers
- Add multi-instance startup recovery tests and update deployment documentation
* fix(workflow): only register listened queues and update concurrency on change
- Only register queues that the executor instance actively listens to
- Use always_update conflict resolution so environment variable changes take effect on restart
- Prevent dedicated workers from overwriting unmanaged queue concurrency configurations
- Add tests verifying concurrency updates and queue isolation across worker roles
* refactor(workflow): simplify activities to use defineStep and direct calls (#482)
* refactor(workflow): simplify activities to use defineStep and direct calls
- Wrap activities using defineStep from @shumai/workflow-core
- Remove obsolete getActivities, registerActivities, dynamic activity proxies, and workerQueue arguments
- Remove executor.ts and registry.ts, consolidating workflow registration into workflow.ts
- Call activities directly across transcode and agent workflows
- Update all corresponding workflow tests and developer guide documentation
* fix(workflow): properly detect DBOSWorkflowCancelledError in runOnCancel fallback
- DBOSWorkflowCancelledError in DBOS SDK does not set name, inheriting 'Error'
- Implement isDbosWorkflowCancelledError checking instanceof, constructor.name, and dbosErrorCode
- Update unit tests to verify real DBOS SDK cancellation error instances
* docs(workflow): update documentation and readme for dbos migration
- Rename docs/configuration/temporal.mdx to docs/configuration/distributed.mdx
- Document DBOS-based distributed worker architecture and task queues
- Remove obsolete docker-compose/temporal/
- Update environment variables documentation in docs/configuration/env-variables.mdx
- Update references in README.md, README_CN.md, docs/docs.json, and related guides
* feat(deploy): implement KEDA ScaledJob and scale-to-zero On-Demand transcoding (#483)
* feat(deploy): add shumai-transcode docker image and k8s autoscaling example with garage s3
* docs(k8s): document port-forwarding and in-cluster s3 domain mapping
* feat(storage): support public s3 endpoint for browser uploads and update k8s example
* fix(k8s): configure s3 bucket cors rules in garage initialization
* fix(k8s): increase transcode worker memory limit to 4Gi for 4K video encoding
* feat(deploy): add AWS EKS deployment with Graviton3 Spot nodegroups and autoscaling
* docs(deploy): redesign EKS documentation, rename k8s to eks, and add scalable deployment feature
* docs: rephrase DBOS feature bullet to Durable Workflows via DBOS
* docs(eks): upgrade default instances to Graviton5 c9g.large and c9g.xlarge
* feat(eks): use On-Demand for general nodegroup and add spot capacity diversification
* docs(eks): fix Architecture diagram to locate all transcode worker pods in Transcode Compute Pool
* feat(deploy): implement KEDA ScaledJob and scale-to-zero On-Demand transcoding
* feat(transcode): support idle-timeout auto-drain for KEDA scaled jobs
* fix(deploy): fix EKS deployment manifests and documentation based on cluster verification
* feat(embedding): update compose tiers, docs, and add regenerate-embeddings CLI
- Add Lite, Embedding, and Full Docker Compose configurations (and Aliyun mirrors)
- Set CONCURRENCY_AGENT to 1 for compose files containing embedding-server
- Update README and README_CN with compose options, recommended RAM, and semantic search links
- Add LiteRT-LM Embedding Server setup guide in docs/using-shumai/embedding-server.mdx
- Add shumai regenerate-embeddings CLI command and EmbeddingService to regenerate embeddings across teams
- Add comprehensive test coverage for EmbeddingService
* fix(docker): remove basic auth for turntable-renderer in full compose
* fix(agent): lock and disable embedding agent when ENABLE_EMBEDDING_AGENT is false
Ensure that when ENABLE_EMBEDDING_AGENT is set to 'false', existing embedding agents are automatically disabled on startup, marked as read-only, and blocked from manual API modifications or creations. Additionally guard background task creation and semantic search when the environment variable disables embedding agents.
* test(upload): remove flaky status assertion on workflow tasks
* feat(search): render results in responsive card grid with sprite preview and new-tab navigation
* fix(search): align semantic matched duration badge style with standard duration badge
* fix(webui): use pointer cursor instead of crosshair cursor for sprite scrubber on hover
* fix(agent): adaptively set video embedding frame count based on aspect ratio
Adjust sampled video frame counts between 15 and 14 based on the video's aspect ratio. Standard aspect ratios (1:1, 4:3, 3:4, 16:9, 9:16, 21:9) stay within the 2048 token signature bucket when using 15 frames, while non-standard or custom aspect ratios use 14 frames to guarantee that sequence length never exceeds 2048 tokens, preventing out-of-memory errors on the embedding server.
* feat(agent): persist video chunk embeddings incrementally and resume on retry (#478)
* feat(search): generate query embeddings directly for semantic search
* fix(search): resolve embedding provider from env, redact query logs, and preserve case in cache
* feat(agent): support gemma-embedding-2-openai provider
Add support for local LiteRT-LM Gemma Embedding 2 provider with 768-dimensional vector embeddings, environment-configured read-only embedding agents, 16-frame uniform sampling for video chunks, and automatic WebP-to-JPEG conversion.
* refactor(agent): remove unused legacy generateEmbeddingActivity
* chore(agent): align sharp version to 0.35.4
* refactor(agent): rename embedding server env to GEMMA_EMBEDDING_OPENAI_BASE_URL
* refactor(agent,transcode): use native Bun.Archive for video chunk frames
* fix(transcode,agent): populate buffer entries in Bun.Archive and validate frame sizes
* feat(agent): support AI embedding, autofill, and read_asset for 3D assets
* feat(agent): support 3D degree comments, markup annotations, and config3d in read_asset
* fix(agent): resolve 3D session annotations to turntable degree frame time
* feat(team): add integrations settings with turntable and gotenberg
* fix(upload): pass teamId to gotenberg availability check during upload preflight
* feat(transcode): add 3D asset support and turntable viewer
* perf(turntable): stream file via Bun.file and increase upload timeout
* feat(turntable): increase upload timeout to 15m to support 5GB uploads
* fix(webui): align 3D model viewer layout and full-width control bar with video viewer
* feat(webui): unify 3D viewer bottom bar and redesign cyclic ruler slider
- Place RulerSlider in single row with playback and zoom controls, centered with max 320px width
- Flank RulerSlider with minus and plus buttons to step angle by 15°
- Redesign RulerSlider with fixed center indicator and moving cyclic track with continuous 360° wrapping
- Render major ticks longer at 60° intervals without numeric text labels on track
- Display floating degree tooltip above center indicator only during dragging
* fix(webui): prevent RulerSlider from collapsing to 0px width in control bar
- Use flex layout with flex-1 on left and right clusters to preserve center cluster width
- Enforce min-w-[140px] and w-full on RulerSlider
- Fix tooltip positioning and remove outer overflow-hidden
* feat(webui): snap RulerSlider track directly to discrete 15° ticks during drag
* fix(webui): prevent ruler snap-back caused by floating point second truncation
- Use Math.round instead of Math.floor in secondToDegree to avoid 0.999996 dropping to previous frame
- Ensure final dragDegree is committed on pointer up
* fix(webui): fix arrow key frame rounding and duplicate event bubbling
- Use Math.round instead of Math.floor for keyboard arrow frame navigation in ModelViewer
- Add e.stopPropagation() to RulerSlider keyboard events to prevent duplicate bubbling to window listener
* feat(webui): redesign RulerSlider with encapsulated step buttons and capsule pill track
* feat(webui): make RulerSlider responsive on mobile and remove bottom bar reset button
* fix(webui): load 3d video directly without poster and invert drag rotation to counterclockwise
* fix(webui): fix 3d asset viewer frame seeking and drag jitter
* feat(transcode): show 3D asset poster preview immediately after render start
* fix(viewer): synchronize 3D turntable playback via frame callback to prevent skipped degrees
* fix(viewer): handle touchpad zoom gestures and prevent page zoom in 3D viewer
* fix(viewer): eliminate 3D model rotation jitter at 345 degrees
* fix(share): watermark 3D asset turntable video on share links
* fix(share): preserve video transcode resolution on watermarked share links
* fix(viewer): download original 3D model file instead of rendered turntable MP4
* feat(transcode): add hardware decoding support for nvenc, qsv, and rkmpp
* refactor(transcode): eliminate redundant hardware decode gating and dead condition
* fix(asset): mark asset as failed and display failure state in webui when transcoding fails
* fix(transcode): do not mark asset as failed if media processing already succeeded
* test(workflow): add e2e test for video transcode failure status transition
* fix(webui): update failed file card badge to top-right Transcoding Failed label with error tooltip
* fix(transcode): avoid selecting attached picture streams for video transcoding
Filter out attached picture streams (disposition.attached_pic) during video probing and stream selection, matching Immich's default and bitrate selection strategy. Forward explicit primary video and audio stream indices to FFmpeg pipelines to prevent picking embedded cover art or thumbnail streams.
* fix(transcode): skip poster and sprite generation for audio-only assets and add multi-stream e2e tests
* test(workflow): scope pixel format to h264 stream and use yuvj420p for mjpeg cover art
* feat(settings): redesign video transcoding settings into dedicated cards and rename team AI settings
* feat(settings): rename Video Strategy to MP4 Transcoding with sub-description
* feat(transcode): add multi-resolution strategy with configurable ladders and fallback
* feat(settings): show toast on settings update and add manual verification plan to PR template
* fix(webui): preserve video resolution and fix 480p label in download dropdowns
* fix(webui): display standard short-side resolution for vertical videos in seekbar
* fix(webui): fix portrait transcode resolution labeling and serialize settings toggles
- Add centralized RAW file extension set and detection helper for 23 common camera RAW formats
- Update getProxyType and EXTENSION_MIME_TYPES to route RAW formats into the image pipeline
- Add exiftool-vendored runtime dependency and mark as external in build-npm script
- Implement embedded JPEG extraction to temporary file with priority JpgFromRaw2 -> JpgFromRaw -> PreviewImage
- Read and apply EXIF orientation from RAW container to prevent rotation/mirroring issues
- Integrate into TranscodeService.getImageInfo and transcodeImage with proper temporary file cleanup
- Add hasUsablePreview guard in transcodeImageWorkflow to gracefully handle RAW files without embedded previews
- Add unit, service, workflow, and E2E tests for RAW processing
AlertDialogAction from Radix UI auto-closes the dialog on click.
Added e.preventDefault() so the dialog stays open and shows the
'Deleting...' loading state until the operation finishes.
Fixes both desktop and mobile file browsers.