libime data format upgrade in next version (libime 数据格式变更)

14 views
Skip to first unread message

Weng Xuetian

unread,
Sep 18, 2023, 1:31:21 PM9/18/23
to fcitx, fcitx-dev
Hi all,
libime will upgrade the date format for pinyin dict, table dict, user
history to ZSTD compressed.

This will give us the following benefits for free:
1. less disk space but almost the same speed.
3. checksum on corrupted files.

Though, there's a few caveats:
1. the new file format will not be readable by old libime
2. tools (libime_*) of the new version will only produce new file formats.

So if you are copying files around different systems, or you downgrade libime.

The old format will still be readable on the new version, but when the
data is saved with the new version (e.g. user dict), it will
automatically be written with the new format.

The change is planned at libime 1.1.2.

libime 的数据格式(拼音词库,码表,用户输入历史)将采用 ZSTD 进行压缩。

这个变化将提供以下改善:
1、占用更少空间,但读取速度接近不压缩的版本
2、为损坏的文件进行校验

但是有以下问题需要注意:
1、新格式无法在旧版本上读取
2、新版本的工具只会写入新版本的格式

如果你在不同的系统之间复制你的数据文件,或者你进行降级,就需要注意。

旧版本的文件在新版仍然可读,但是当新版本写入的时候,将会自动按照新版本的格式进行写入。

此项更新将包含在 libime 1.1.2 当中。

CS Slayer

unread,
Sep 18, 2023, 1:50:22 PM9/18/23
to fcitx-dev
specially for nightly users (AUR libime-git , or flatpak from fcitx5-unstable) may get the upgrade very soon since it's just pushed to git repo.

特别提醒使用 nightly 构建的用户(例如 AUR libime-git ,或者 fcitx5-unstable 的 flatpak),可能很快就会收到对应更新。
Reply all
Reply to author
Forward
0 new messages