[PATCHSET] expand last partition script and its usage

[Roberto A. Foglietta]

Hi all,

all these patches are just sent by elastic mail SMTP and they are
waiting in moderation.

* 9ab1ca3 - In expand last partition few improvements and a bugfix
* 565e850 - In expand last partition trap exitnlog EXIT logs with simpler code
* b207566 - The expand last partition might support full volumes also, to test
* 0e1748e - In expand last partition checking the size is useless
* 4112390 - If expand last partition fails, unsupervised systems reboot
* f5a72cd - In expand last partition script btrfs support added
* d3aded1 - In expand last partition wait for udev have finished

I am going to attach them for immediate reviewing and they can also be
found in this branch

https://github.com/robang74/isar/tree/rafnext

or they can be found in this branch which has been merged with the
current ISAR next head

https://github.com/robang74/isar/tree/next

Files changed list:

meta/recipes-support/expand-on-first-boot/expand-on-first-boot_1.2.bb
meta/recipes-support/expand-on-first-boot/files/expand-last-partition.sh
meta/recipes-support/expand-on-first-boot/files/expand-on-first-boot.service

Best regards, R-

[Roberto A. Foglietta]

On Thu, 15 Dec 2022 at 19:06, Roberto A. Foglietta
<roberto....@gmail.com> wrote:
>
> Hi all,
>
> all these patches are just sent by elastic mail SMTP and they are
> waiting in moderation.
>
> * 9ab1ca3 - In expand last partition few improvements and a bugfix

Version 2 of the last patch

* 082d8af - In expand last partition few improvements and a bugfix

I forgot to mention Henning on which code I took inspiration from.

Best regards, R-

[Roberto A. Foglietta]

Hi all,

this is the single patch for rework and generalisation of last
partition expansion.
As usual has been sent by elastic mail SMTP and it went in moderation.

UPDATE: the unpartition volume resizing has been tested in this way

git clone https://github.com/robang74/isar-nvidia-debian.git
cd isar-nvidia-debian
source .profile
build basic-os
wicshell
cd /boot
cp -arf vmlinuz-5.10.0-19-amd64 initrd.img-5.10.0-19-amd64 /work
exit
wicinst file:image.wic
sudo losetup -P $(losetup -f) image.wic
sudo dd if=/dev/loop3p2 bs=1M > disk.wic
dd if=/dev/zero bs=1 seek=$[4*1024*1024*1024] count=1 oflag=append
conv=notrunc,sparse status=none of=disk.wic
sudo qemu-system-x86_64 --cpu host --enable-kvm -smp 4 -m 1024 -drive
format=raw,file=disk.wic -device sdhci-pci -kernel
build/tmp/work/vmlinuz-5.10.0-19-amd64 -initrd
build/tmp/work/initrd.img-5.10.0-19-amd64 -append "root=/dev/sda
console=ttyS0" --nographic; echo ">>> press ENTER"; read; reset
dmesg | grep expand
df -h
poweroff

Best regards, R-

===========================================

The script has been reworked to simplify its code:

- the last partition free space is not computed anymore because useless
- on exit a function take care of some final tasks and logs in /dev/kmsg

and to extend its functionalities supporting new filesystems:

- filesystem type is managed by a switch-case block of code
- temporary directory to mount is created relying on TMPDIR
- unsupervised systems have the option to reboot because error
- if temporary directory creation fails 2nd try with /dev/shm
- additional ext2, ext3 and btrfs filesystems supported
- udev support: udevadm settle is the first task to run
- unpartitioned volumes are resized as well (tested)

This patch has been created by a collection of 7 patches to be applied on
ilbers ISAR, branch next, commit d26660b724b034b602f3889f55a23cd9be2e87bd

Author: Roberto A. Foglietta <roberto....@gmail.com>

This code has been developed taking inspiration by suggestions and code from:

Felix Moessbauer <felix.mo...@siemens.com>
Tobias Schmidl <tobias...@siemens.com>
Henning Schild <henning...@siemens.com>

Signed-off-by: Roberto A. Foglietta <roberto....@gmail.com>

[Roberto A. Foglietta]

On Fri, 16 Dec 2022 at 00:00, Roberto A. Foglietta
<roberto....@gmail.com> wrote:
>
> Hi all,

> - udev support: udevadm settle is the first task to run

[...]

> - unpartitioned volumes are resized as well (tested)

about these points the latency introduced by udevadm settle is
irrelevant in most cases about 0.1 seconds and because I commented the
code that checks for the free space in the last partition (all
resizing tools do that more efficiently) - in general the execution
time will be smaller - faster. In those platforms in which the boot
time grows up - most probably are the same that would fail because
they boot from a small internal storage device and might use
unpartitioned devices for rootfs or RW. Likely the qemu test that I
presented here in which vmlinuz and initrd image are separated from
the unpartitioned volume. In such a case the mount cannot trigger the
kernel to map the device because rootfs and bootfs are on different
devices. This is also the reason because I denominated the patch
"generalisation" - not only for having added btrfs. That support was
been in place since September 30th.

Best regards, R-

[Roberto A. Foglietta]

On Fri, 16 Dec 2022 at 09:14, Roberto A. Foglietta

<roberto....@gmail.com> wrote:
>
> On Fri, 16 Dec 2022 at 00:00, Roberto A. Foglietta
> <roberto....@gmail.com> wrote:
> >
> > Hi all,
>
> > - udev support: udevadm settle is the first task to run
>

A dependency needed added, this grants that udevd and udevadm will be installed

Many systems might not need udevadm settle for expanding last partition but few
others which rely on separated couple of bootfs/rootfs where last
partition is on
a volume connected through a kind of bus which not be fully ready at boot time
until udevd will end to populate the /dev tree.

Moreover, expanding the last partition is a single time task which runs only on
the first machine boot and then will be disabled forever. Thus, even if it
would take some time on some systems, it is acceptable in order to grant to the
widest variety of systems this service. Alternative is to accept that some
system will be left unprovided of the storage space they have been designed for.

This patch is for applying on top of the other previous 7 patches

- In expand last partition few improvements and a bugfix

- In expand last partition trap exitnlog EXIT logs with simpler code

- The expand last partition might support full volumes also, to test

- In expand last partition checking the size is useless

- If expand last partition fails, unsupervised systems reboot

- In expand last partition script btrfs support added

- In expand last partition wait for udev have finished

or their combination:

- The expand last partition rework and generalisation

Sent by elastic mail SMTP and went in moderation, here in attachment.

Best regards, R-

[Roberto A. Foglietta]

On Fri, 16 Dec 2022 at 12:38, Roberto A. Foglietta

I decided to leverage the MIT license to change the copyright notice
and license after the work and generalisation.
As usual, I sent this patch by elastic mail SMTP so it went on
moderation. Here in attachment.
This patch applies on the top of the patches listed above.

From aeb885595b53d08ed101ccc08032a6dfcfe3decb Mon Sep 17 00:00:00 2001
From: "Roberto A. Foglietta" <roberto....@gmail.com>
Date: Sun, 18 Dec 2022 14:10:40 +0100
Subject: [PATCH] Copyright changes of expand last partition script after
rework

Script to resize last partition to full medium size, changed the copyright
and the license by the author of the rework and generalisation as following:

. This software was originally a part of ISAR
. Copyright (c) Siemens AG, 2018-2022
. SPDX-License-Identifier: MIT
.
. After its rework and generalisation this file was relicensed
. (C) 2022, Roberto A. Foglietta <roberto....@gmail.com>
. SPDX-License-Identifier: all rights reserved, but fair use allowed
. Fair use includes test, learning and marketing but not sales, redistribution
. leasing, renting or every other commercial/business activities without the
. consent of the author. Every company or individual allowed to use this
. code behind these limitations will be listed here below, if any.

Signed-off-by: Roberto A. Foglietta <roberto....@gmail.com>

Best regards, R-