2024-12-12
Release 3.12.0
Features
Include Files Patterns
added to theScan settings
on the storage view page to set patterns for files to be included by scanner. Scan include patterns are only applied to files, not directories.Transcode Include Patterns
added to theTranscode settings
on the storage view page to set patterns for files to be included by transcoder.Sidecar Includes Original Extension
added to theExport Locations
view. The sidecar file will have the original file extension included in it's name on export if enabled. Example: video.mp4.json- For ffmpeg transcoder to control video quality you can now select the control rate mode. More info on the advanced options page.
Bug fixes
- Fixed slow deletion queue job processing introduced in 3.11.
- Fixed a bug with hdr to sdr keyframe conversion for the ffmpeg transcoder
- Fixed LucidLink API integration.
- Allow rediscovery of versioned files.
- Packaged bento4 for arm systems.
- Fixed faulty files ingest delay.
- Added collection keyframes generation request on finished transcode.
- Fixed a bug with Vantage transcoder nickname. The "original" nickname will from now always be excluded when selecting Vantage output. Nickname matching for Vantage is done case-insensitive.
2024-10-17
Release 3.11.3
Bug fixes
- Fixed a bug where in some cases regexp ignore patterns where not applied on the scanner result
2024-10-10
Release 3.11.2
Bug fixes
- Fix for some smb mounts causing download jobs to go missing
2024-10-03
Release 3.11.1
Bug fixes
- Fix for intel Mac builds
2024-10-02
Release 3.11.0
Features
- New transcoder support: HiScale FLICS Transcoder
- Added expiration date for delete jobs that remove originals with default set to 90 days. New value can be set through the config.ini:
fail-deletion-jobs-after-days = 90
- General scanner performance improvements
- Faster transcoder selection. Transcoder selection is now also based on the file extension which allows faster selection of the correct transcoder.
Bug fixes
- Fixed include and exclude patterns for image transcoder
- Fixed a bug that changed asset's name on moving an edit proxy
- Fixed a bug that showed wrong online status for archived assets with delete from ISG
- Fixed a bug in missing directory handling
2024-09-17
Release 3.10.10
Features
- Allow scanner to resume from the last scan position on application restart. This can be disabled by setting
resume-scan-on-restart = false
in the config.ini
Bug fixes
- Fix frequent transcoder restarts due to wrong Vantage job status
- Fix a bug that limited the number of supported scan directories
- Fix a bug causing scanner failure because of specific scan folder layout
- Fix empty bit_rate in proxy metadata failing Vantage transcode jobs
- Fix a bug where a user request to mark files and directories as missing dit not complete successfully
2024-09-03
Release 3.10.9
Features
- Added a new option for config.ini
wait-for-ongoing-jobs-on-restart = true
(true by default). If set to false ISG will terminate all ongoing jobs on shutdown/restart.
Bug fixes
- Fixed a bug in Edge transcoder where some temporary files were not deleted if a transcode job crashed
2024-08-21
Release 3.10.8
Bug fixes
- Fixed a rare issue with prioritized directories when some of the new files skip ingest until ISG is restarted
2024-08-20
Release 3.10.7
Bug fixes
- Optimization of ingest priority of prioritized directories
- Fixed a bug where in some TIFF image transcoding jobs failed even though ImageMagick produced a proxy
2024-08-08
Release 3.10.6
Bug fixes
- Fixed ingest of large red sequences
- New config.ini attribute that adds support for color conversion of thumbnails for upcoming EditReady Server
editready-apply-rec709-to-thumbnails = true
(disabled by default)
2024-07-10
Release 3.10.5
Bug fixes
- Fixed a bug introduced in 3.10.2 where subtitles ingested on an ISG were not transcoded.
2024-07-09
Release 3.10.4
Bug fixes
- Fixed an issue where ingest could get slow or stuck that was introduced in 3.10.2 (Reverts the fix for: Fixed cases were ingest did not respect the priority of prioritized directories)
2024-07-01
Release 3.10.3
Bug fixes
- Fixed a bug where use of crc32 checksum from GCS scans could lead to files being re-ingested
- Fixed a bug where setting a local destination path for iconik Edit Proxy transcoder breaks Edge transcoder
- Remove keyframe map generation for audio files in iconik transcoder
2024-06-13
Release 3.10.2
Features
- Allow setting max jobs per transcoder type in config.ini
Bug fixes
- Fixed cases were ingest did not respect the priority of prioritized directories
- Fixed a bug where restore uses wrong path for restore permission check
- Fix sidecar edit proxies ingest without original present
- Removed a workaround for IPCM audio for ffmpeg 5 and newer
- Fixed a case where the color space of images was not correctly identified as CMYK
2024-06-03
Release 3.10.1
Features
- Added packages for Ubuntu 24.04
- Added deletion of remote file copies on archive with enabled "Delete after archive" option
- Added new config attributes for redline proxy color transforms
- Added a new config attribute to set image proxy resolution for ISG & Edge Transcoder
- Added a new config attribute:
scan-folder-timeout = 600
- timeout in seconds for a single folder scan. - Added a new config attribute:
update-title-on-filename-change = True
- if true update asset's title when a file is renamed. - Added ICC profile metadata for profile description
Bug fixes
- Fixed direct transfer SSL certificate verification failures.
- Fixed checksum queue report numbers.
- Fixed proxies of transparent vector images not being created with checkerboard background.
- Fixed a bug where mediainfo could not be read from audio files leading to failed transcode jobs.
- Fixed a bug where some video were incorrectly identified as HDR.
- Fixed transferring files priority update on changing priority of directories.
2024-05-07
Release 3.9.7
Bug fixes
- Add more error retries on small file uploads
2024-04-25
Release 3.9.6
Bug fixes
- Fixed a bug in Edge Transcoder where cache for file cache proxy is left after completed transcode job.
- Fixed a bug in iconik Storage Gateway where wrong EditReady Server path could lead to silent crash on start.
2024-04-10
Release 3.9.5
Bug fixes
- Fixed a bug in iconik Storage Gateway where adding a large number of files for ingest would consume too much memory on application start.
2024-04-08
Release 3.9.4
Bug fixes
- Fixed a bug in Edge Transcoder where uploads to keyframe and proxy storages set by the
keyframe-storage-id
andproxy-storage-id
config attributes did not work.
2024-03-18
Release 3.9.2
Bug fixes
- Fix broken scan stats on the logs tab
- Fix progress total for EditReady transcode jobs
- Improve GCS upload speed for high bandwidth networks. Disabled by default, to enable add the line to a config.ini:
prefer-multiprocessing-for-multipart-uploads = true
2024-03-08
Release 3.9.1
Bug fixes
- Fix broken ISG dependency on Mac x86_64 systems.
2024-03-05
Release 3.9.0
Features
- Set priorities per custom directory
- New context action on a storage's admin page to mark files missing outside scan directories.
- Use Ffmpeg HDR to SDR conversion options when possible for ISG & Edge transcoder
Bug fixes
- Increased the max value for the configurable proxy bitrate. This is currently the only way to change the bitrate for a web proxy produced by the iconik Edge Transcoder
- Fix timecode track not present on edit proxies
- Fixed an issue where moving a RED sequence with multiple copies could cause archive failures
2024-02-02
Release 3.8.7
Bug fixes
- Fix collection mapping issue caused in a previous patch 3.8.6
2024-01-29
Release 3.8.6
Bug fixes
- Fix iptc metadata extraction for certain images
2023-12-15
Release 3.8.5
Bug fixes
- Fixed an issue where thumbnails for still images were scaled incorrectly creating blurry previews
2023-12-11
Release 3.8.4
Bug fixes
- Fixed a problem where an unmounted mount point could require a restart of the application
2023-12-06
Release 3.8.3
Bug fixes
- Remove
storage_id
as a default remote path for auto-upload transfers. For backward compatibility the "Remote path" field will be set to a currentstorage_id
value, removing that will make ISG(3.8.2) upload to the root - Fix Watch Folder transcoder skips time out if proxy folder is missing
- Fix Watch Folder transcoder job getting stuck occasionally on crash
- Fix transfer and export jobs failing on fresh ISG with an empty mount point
- Fix subtitles occasionally skip transcoding
- Fix re-transcode job fail on mediainfo timeout
- Only use yadif filter if video is interlaced in the default iconik transcoder
- Fix occasional mediainfo timeouts on Centos 7 and Ubuntu 20.04 with libmediainfo upgrade to 23.10
- ISG can now detect instance-id's used in LucidLink Client, for builds later than #5127.
Features
- Add a new option to skip auto-upload if a file is already present on any cloud storage, different to selected destination storage
- Add a config attribute to use symlink for adding originals to a watch folder for Watch Folder transcoder. By default, a hard link is used that fallbacks to copy a whole file to the watch folder if it's on another file system.
2023-11-22
Release 3.8.1
Bug fixes
- On upgrading the iconik Edge Transcoder rpm package on Centos 7 the existing iconik Edge Transcoder config file was not moved correctly to new path.
2023-11-20
Release 3.8.0
Bug fixes
- Local database partition to avoid database is locked errors for large storages
- Improve transcode subprocess monitoring to fix some occurrences of stuck transcoding queue
- Improve transcode job cleanup workflow
- Fix overwriting existing edit proxy on re-transcode
- Fix keyframe aspect ratio for certain video resolutions
- Fix Watch Folder in some cases not removing proxies on cleanup
- Fix proxy export for local export jobs
- Fix transfer error handling on existing local path
- Fix checksum propagation on cloud to ISG transfer
- Fix missing assets left in collection
- Fix transcoder picker include & exclude patterns logic. A previous behaviour would pick first transcoder matching the include pattern and if none found default to first one that doesn't match any exclude patterns. With 3.8.0 first any exclude patterns are applied, then include patterns are checked for a match. If no match was found the first transcoder without an include pattern is chosen as default.
- Replaced legacy "cantemo" with "iconik" in file paths on Linux distributions.
The default config file location is now
/etc/iconik/iconik_storage_gateway/config.ini
, log files in/var/log/iconik/
and data files in/var/iconik/
. - Improved transcoding performance when iconik Edge Transcoder is used with the file caching proxy. The amount of data that is prefetched by the caching proxy is now configurable, see the Edge Transcoder documentation.
Features
- Add support for Enterprise Linux 9
- Add RED sequence support for the Watch Folder transcoder (the "Use unique sub-folder workflow" must be turned on)
- Single sidecar files (metadata, subtitles, etc.) without linked media file are now ingested as ORIGINAL format
- Improve default local video transcoder performance
2023-09-20
Release 3.7.4
Bug fixes
- Fixed files in removed scan directories not marked as missing
- Format metadata now updates when a file is retranscoded automatically
- Fix an issue with some files getting stuck on metadata extraction, on linux, introduced in 3.7.2
2023-09-11
Release 3.7.2
- Discontinued support of Ubuntu-18.04
Features
- An Archive purpose support added for ISG storage
- Re-transcode of asset on file change with auto-version enabled in storage settings
Bug fixes
- Improvements in handling of unmounted volumes and missing files
- Added timeouts for all metadata extraction calls (EXIF, XMP, etc.)
- Reduced some redundant debug logging
- Fix occasional stuck Edge transcode jobs
- Removed preview transcode queues that would generate a keyframe before proxy
2023-07-11
Release 3.6.8
Bug fixes
- Stop marking files missing if outside scan directory
2023-07-05
Release 3.6.7
Bug fixes
- Fix ambiguous error on Watch Folder transcoder job failure
- Fix custom path restore with keep collection structure
- Resize before compose for faster image transcoding
2023-06-28
Release 3.6.5
Bug fixes
- Scanner optimisations
- Fix ImageMagick for Edge transcoder on Centos
- Add timeout for FFProbe
- Apply default 709 target color space for EditReady server web proxies
- Add imagemagick policy and delegates in Edge transcoder
- Fix metadata extraction for Edge transcoder
- Avoid stuck transcode queue on network error
2023-06-08
Release 3.6.4
Bug fixes
- Fix Edge Transcoder error on the application start
2023-06-01
Release 3.6.3
Features
- Add new config param
ingest-concurrency-value
- Add new config param
scanner-concurrency-value
- Add new config param
file-download-parallel-downloads-threads-num
Bug fixes
- Increase timeouts for uploads to Azure
- Fix slower ingest of large folders
2023-05-24
Release 3.6.2
Bug fixes
- Fix wrong path for source file on edge transcoder
- Remove size limit for images on reading IPTC/EXIF
2023-05-16
Release 3.6.1
Bug fixes
- Fix stuck queue in transfer/archive jobs processing
- Fixed an issue with Redline transcoding jobs where the status was not updated correctly if the asset already had a proxy
- Fix some transfer jobs getting stuck in waiting
- Fix pdf transcode on Linux systems
2023-05-09
Release 3.6.0
Features
- EditReady transcoder. New transcoder adds support for the EditReady Server
- Auto-version files support
- Custom edit proxy support based on filename pattern
- Local destination path for edit proxies for transcoders
- Custom video encoder for local edit proxies
- ISG will use embedded images to create proxies of RAW formats, see configurable options
- Reuse existing edit proxy format for iconik Edit Proxy transcoder
- Asset Versions Suffix now disabled by default
2023-04-24
Release 3.5.11
Bug Fixes
- For Ubuntu a new certificate is required in order to update: Ubuntu certificate update
- Fix Centos7 stuck transcode jobs
- Add timecode to edit proxy
2023-04-12
Release 3.5.9
Bug Fixes
- Fix Edge transcoder bug on handling 416 HTTP error response
2023-03-23
Release 3.5.8
Bug Fixes
- Smaller default chunk sizes and longer timeout for uploads
- Fix permission errors on handling edit proxy result
- Set correct edit proxy extension for Watch Folder transcoder
- Add timeouts for default video and image transcoders
2023-02-13
Release 3.5.7
Features
- Update of Watch Folder Transcoder adds support for Media Encoder transcoding
Bug Fixes
- Automatically re-upload a file that was changed during upload
- Use checkerboard background for transparency in image proxies
- Ignore audio tracks if mux mode is DV (Audio is embedded in DV/DVCPRO source)
- Allow MXF extension to be used, and use it for MXF sources when creating edit proxies with PCM audio
2023-01-25
Release 3.5.6
Features
- Support for LucidLink remote upload indicator
- this allows ISG to detect slow growing files on LucidLink and avoid closing them before they are done
2023-01-12
Release 3.5.5
Bug Fixes
- Fix for an empty format left on a file replacement
- Fix for a collection content left on moving content between folders
2023-01-10
Release 3.5.4
Bug Fixes
- Fix for skipped transfers and transcode jobs on aggregation. ISG will schedule transfer and transcode jobs for each file found, unless a remote copy or a proxy is already present for the matched asset. The job that gets executed first will upload/transcode a file, while other scheduled jobs will search for a remote copy or a proxy and skip instead of repeating the transfer/transcode
- Fix ingest for changing path from file to directory and then back to file
2022-12-16
Release 3.5.3
Bug Fixes
- Update TrueNAS plugin version
- Fix for Centos7 transcoding bug with ImageMagick using libcurl of a wrong version
- Fix Edge transcoder for not setting directory_path for edit proxy uploads
- Stop ingested files monitoring if storage scan option is disabled
2022-11-17
Release 3.5.2
Features
- Archive/Restore improvements
- Possibility to delete and restore to a specific mapped collection
- File caching proxy for Edge Transcoders to improve performance
Bug Fixes
- Fix for image keyframes for CMYKA TIFF files
- Export of VTT works
2022-10-01
Release 3.4.4
Bug Fixes
- Bug fixes for watch folder transcoder
- Bug fixes for Red edit proxy job status updates
- General stability improvements
2022-09-22
Release 3.4.3
Bug Fixes
- Fixed CentOS 7 crash because of old SQLite library. No change compared to 3.4.2 for other platforms.
2022-09-14
Release 3.4.2
Features
- Support edit proxy audio codec overrides
- Support for adding the -white-balance flag for certain raw image formats
Bug Fixes
- Fix for bitrate on intel macs using Videotoolbox
2022-09-02
Release 3.4.0
Features
- Option to delete edit proxies from local storage after upload
- Watch folder transcoder (For use with for example Blackmagick Proxy Generator)
Bug Fixes
- Add metadata fields to index red files properly
- Collection map fixes
- Non-blocking re-map job
- Use Recycle Bin for quick restore of deleted collections
- Support PSD files without extension
- Add bitrate option for videotoolbox encoder to improve quality
- Keep collection mapping if only edit proxy remains
- Retry uploads on file rediscovery
- Set the default max checksum workers to 5 instead of number o CPUs
Other
- Upgrade Python to 3.10
- Cache uses a separate database file for performance
2022-07-01
Release 3.3.9
Bug Fixes
- Fix audio mapping for AAC for editproxy for some 5.1 audio files
- Fix AttributeError on empty media_info
- Simplify collection map condition
- Download NEF files by default (Edge transcoder only)
2022-06-29
Release 3.3.8
New Features
- Support for custom color profiles
Bug Fixes
- Better image proxy quality
2022-06-15
Release 3.3.7
New Features
- Support for the new Edit Proxies transcoder type.
- Support for WAL (Write Ahead Logging) mode for the local database. This can improve performance for large ISG with many files.
Bug Fixes
- Exempi XMP extraction on MacOS was not working correctly if Exempi was not installed on the OS
- Asset history entry for proxy generation
- Files in iconik are now created when a transfer to ISG start instead of after it is finished.