* feat(transcode): decode and scale on the GPU for VA-API transcodes
When the selected encoder is h264_vaapi, decode with -hwaccel vaapi and
scale with scale_vaapi so frames stay in GPU memory, instead of decoding
and scaling on the CPU and hwupload-ing before the encoder. On a Haswell
iGPU this makes 4K proxy/HLS renditions 3-5x faster.
Fallback order: GPU decode + VA-API encode -> software decode + VA-API
encode (previous behavior) -> libx264. Watermark overlays, HDR sources
and rotated sources skip GPU decode: ffmpeg cannot auto-insert its
rotation filter on hardware frames, so rotated input would otherwise come
out sideways instead of failing. SHUMAI_VAAPI_HW_DECODE=false disables it.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
* docs(transcode): document VA-API GPU decoding and SHUMAI_VAAPI_HW_DECODE
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
* refactor(transcode): generic hardware decode config, stall watchdog, reuse probed rotation
Follow-ups from comparing with Immich and Jellyfin:
- Replace the VA-API-specific helpers with a per-encoder HW_DECODE_CONFIGS
table (input args, output args, GPU scale filter) and build the MP4 and
HLS input/filter graph in one shared method so the paths cannot drift.
Only h264_vaapi has an entry; other backends can be added once tested on
real hardware. The opt-out is now SHUMAI_HW_DECODE=false.
- Kill a GPU-decode attempt with SIGKILL when its output stops growing for
SHUMAI_HW_DECODE_STALL_TIMEOUT (default 120s) and fall back, since some
VA-API driver failures hang ffmpeg instead of exiting (immich#31933).
- Add -noautoscale on the GPU-decode path so a mid-stream decoder reinit
(e.g. 1080 -> 1088) cannot auto-insert a software scaler into the GPU
graph (jellyfin#17133).
- Pass the rotation already probed into MediaMetadata through the workflow
and activities as sourceRotation; ffprobe only runs when it is missing.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
* fix(asset): mark asset as failed and display failure state in webui when transcoding fails
* fix(transcode): do not mark asset as failed if media processing already succeeded
* test(workflow): add e2e test for video transcode failure status transition
* fix(webui): update failed file card badge to top-right Transcoding Failed label with error tooltip
* fix(transcode): avoid selecting attached picture streams for video transcoding
Filter out attached picture streams (disposition.attached_pic) during video probing and stream selection, matching Immich's default and bitrate selection strategy. Forward explicit primary video and audio stream indices to FFmpeg pipelines to prevent picking embedded cover art or thumbnail streams.
* fix(transcode): skip poster and sprite generation for audio-only assets and add multi-stream e2e tests
* test(workflow): scope pixel format to h264 stream and use yuvj420p for mjpeg cover art
* feat(transcode): add multi-resolution strategy with configurable ladders and fallback
* feat(settings): show toast on settings update and add manual verification plan to PR template
* fix(webui): preserve video resolution and fix 480p label in download dropdowns
* fix(webui): display standard short-side resolution for vertical videos in seekbar
* fix(webui): fix portrait transcode resolution labeling and serialize settings toggles
* feat(transcode): add HDR output proxy support
* fix(transcode): auto-detect MoltenVK Vulkan ICD on macOS for libplacebo filters
* fix(transcode): split filter in generateSprite to ensure poster uses tone-mapped stream
* docs(changelog): update docs/changelog.mdx and ignore in prettier
* fix(transcode): respect video rotation metadata to preserve display aspect ratio
* fix(webui): render native video with hardware EDR acceleration instead of 2D canvas
* fix(webui): show HDR label on mobile video control bar
* fix(share): preserve hdr flag on watermarked video transcodes
* fix(webui): differentiate HDR download options in video player
* fix(transcode): handle Dolby Vision Profile 5 via standard HDR pipeline without libplacebo
* fix(transcode): prepend setparams filter to prevent zscale colorspace path error for DV P5
* refactor(transcode): simplify HDR proxies to always produce HDR without SDR setting
* feat(asset): show poster and hover preview while video is transcoding
Generate and persist the sprite (and its poster) before the proxy
transcodes run, so the poster/sprite are available in the file list
while the asset is still processing.
Render the preview in the file card behind a translucent processing
overlay instead of a blank skeleton, and replace hardcoded status text
with existing i18n keys.
* feat(asset): pulse the cover and show Preparing/Uploading labels while processing
Drop the processing text overlay on the file card preview in favour of a
subtle pulsing opacity on the cover, and show "Uploading..."/"Preparing..."
in the creator row so the real author and date only appear once the asset
is ready.
* feat(asset): use a hollow ring for the preparing placeholder
Match the geometry of the upload progress ring (empty inside, no
percentage) and hide the duration badge while processing, so the
upload-to-processing transition reads as one continuous animation.
* style(asset): shrink-only preparing ring in muted grey at fixed opacity
Animate only the ring size (1 -> 0.8 -> 1) and hold a constant 0.6
opacity, using a muted grey stroke instead of primary.
* fix(transcode): preserve trashed status during background jobs and handle permanent purge
* fix(workflow): clear heartbeat and add info logs on task cancellation
* fix(transcode): terminate media processes and guard task activities on cancellation
- Pass AbortSignal to ffmpeg and pdftoppm child processes in transcodeService to terminate processes on task cancellation
- Add local task AbortController context and cancellation guards in executeActivity to prevent subsequent workflow activities
- Forward taskId and cancellation signals in transcode, screenshot, and PDF activities
- Use updateMany instead of update in task activities to eliminate Prisma P2025 errors on purged task records
* fix(workflow): allow cleanup activities in finally blocks during task cancellation
Remove blanket cancellation check in executeActivity so that workflows can execute cleanup and failure handling activities in catch and finally blocks upon cancellation, while relying on AbortSignal in active activities to abort execution.
* docs(changelog): improve user friendliness of changelog entries and formatting example
* docs(agents): update changelog guidelines to emphasize end-user friendly descriptions
* fix(transcode): handle queued cancellation and delete races in media workflow
* feat(transcode): optimize video operations using ffmpeg http range requests
* fix(transcode): preserve non-retryable errors and ensure mapConcurrent settles on rejection
* feat(transcode): add hardware-accelerated video transcoding support
* feat(transcode): use encoder quality modes and source-capped maxrate for video transcode
* fix(transcode): scale max bitrate for downsampled preview framerates
* fix(transcode): propagate videoBitRate in getMediaInfoActivity and update auto description
* feat(webui): remove original-file display fallbacks, use proxies only
WebUI now never uses the raw original file for display. All viewers
(image, video, compare, pdf) render exclusively from transcoded proxies;
when no proxy exists the viewer shows an unavailable placeholder instead
of falling back to media.original.
- getBestTranscode: drop the isRaw fallback candidates
- video-viewer / compare-video-pane: remove the synthetic 'Original'
resolution entry and the original.downloadUrl hasMedia gate
- image-viewer / compare-image-pane: remove original.downloadUrl default
- pdf-viewer: require pdfTranscode.url (no original fallback)
- download menus (video-control-bar, breadcrumb-nav): use
media.original.key for the 'Original' download option instead of the
isRaw transcode marker entry
Backend:
- transcode-video workflow no longer pushes the isRaw:true marker entry
into videoTranscodes (it pointed at the original file key)
- remove media.original.downloadUrl from the DTO, asset service mapping,
MediaInfo DB type, and transcode workflows/activities (it was only
consumed by the removed display fallbacks; downloads already use key
via the download-url endpoints)
Tests/fixtures updated; docs updated to state the proxy-only display
policy.
* refactor: remove isRaw field via data migration, clean legacy media JSON
Add a Prisma data migration that cleans legacy media JSONB on both
assets and watermark_files:
- drop the raw-original marker entries (isRaw: true) from
videoTranscodes / imageTranscodes — they pointed at the original file
key and were only used by the removed display fallbacks / download
menus, which now use media.original.key directly
- strip the isRaw field from remaining transcode entries
- drop original.downloadUrl (removed from the AssetInfo DTO)
The migration is generated via prisma migrate dev --create-only and
applied automatically by migrate deploy in production. It is guarded by
a test (packages/db/src/clean-media-migration.test.ts) that seeds legacy
media JSON, runs the migration SQL, and asserts the transform on both
tables.
With the data cleaned, remove the isRaw field entirely from the codebase:
- DTO schemas + ImageTranscode/VideoTranscode interfaces
- PrismaJson MediaInfo transcode types
- watermark activity isRaw skip (and its test), watermark proxy mapping,
agent-embedding transcode selection, webui transcode filters, and all
test fixtures
AGENTS.md: clarify that the no-manual-migration rule applies to DDL;
data migrations (pure SQL transforms, no schema change) are allowed
inside a --create-only generated migration and must be tested.