Advanced installation
This section describes steps that are automatically done by the install-redpesk-localbuilder.sh script we suggested to use in Simple installation chapter, in order to let user to manually setup and configure its Local builder container by itself.
Setup your environnement:
Install LXD
Ubuntu
sudo apt install lxd
OpenSUSE
sudo zypper addrepo --refresh https://download.opensuse.org/repositories/system:/snappy/openSUSE_Leap_15.2 snappy
sudo zypper –gpg-auto-import-keys refresh
sudo zypper dup –from snappy
sudo zypper install snapd
sudo systemctl enable snapd
sudo usermod -aG lxd ${USER}
Close your session and open a new one
sudo systemctl start snapd
sudo snap refresh
sudo snap install lxd
Fedora
# make sure that any previous LXC version are uninstalled
sudo dnf remove lxc
# now install LXD
sudo dnf copr enable ganto/lxc4
sudo dnf install lxc lxd
sudo systemctl enable --now lxc lxd
sudo usermod -aG lxd ${USER}
# fix to be able to use systemd inside container
sudo sed -i -e 's:systemd.unified_cgroup_hierarchy=0 ::' -e 's:rhgb:systemd.unified_cgroup_hierarchy=0 rhgb:' grub /etc/default/grub
sudo grub2-mkconfig -o /etc/grub2.cfg
Initialize and configure LXD
LXD allows auto-configuration with a preseed file.
cat << EOF | lxd init --preseed
config:
images.auto_update_interval: "0"
networks:
- config:
ipv4.address: auto
ipv6.address: none
description: ""
managed: false
name: lxdbr0
type: ""
storage_pools:
- config: {}
description: ""
name: default
driver: dir
profiles:
- config: {}
description: ""
devices:
eth0:
name: eth0
nictype: bridged
parent: lxdbr0
type: nic
root:
path: /
pool: default
type: disk
name: default
cluster: null
EOF
Being able to map user directory inside the container
# allowing the LXD daemon which is running as root to remap my host’s user ID inside a container:
echo "root:$(id -u):1" | sudo tee -a /etc/subuid /etc/subgid
Adding IotBzh LXD image store
Now, we have to add the Iot.Bzh LXC Image store as remote to the daemon:
lxc remote add iotbzh download.redpesk.bzh
Certificate fingerprint: ba56e65b627ecca7d652a91f2cbd784e1295bd5ac9491398d07424e6c6f22084
ok (y/n)? y
Password: <password>
lxc image list iotbzh:
+---------------------------+--------------+--------+--------------------------------------------------+--------------+-----------+----------+------------------------------+
| ALIAS | FINGERPRINT | PUBLIC | DESCRIPTION | ARCHITECTURE | TYPE | SIZE | UPLOAD DATE |
+---------------------------+--------------+--------+--------------------------------------------------+--------------+-----------+----------+------------------------------+
| redpesk-builder/28 | 21f6ca33ef5d | yes | Redpesk Devel 28 (Builder) | x86_64 | CONTAINER | 386.64MB | Mar 17, 2021 at 4:56pm (UTC) |
+---------------------------+--------------+--------+--------------------------------------------------+--------------+-----------+----------+------------------------------+
| redpesk-builder/arz-1.0 | 02f6188ccf53 | yes | Redpesk Devel Arz 1.0 (Builder) | x86_64 | CONTAINER | 446.90MB | Jul 29, 2021 at 1:41pm (UTC) |
+---------------------------+--------------+--------+--------------------------------------------------+--------------+-----------+----------+------------------------------+
| redpesk-cloud-publication | 4bf8d0646810 | yes | Redpesk Cloud Publication Binding Host Container | x86_64 | CONTAINER | 250.29MB | Mar 22, 2021 at 8:44am (UTC) |
+---------------------------+--------------+--------+--------------------------------------------------+--------------+-----------+----------+------------------------------+
Create a redpesk LXD profile
Create a redpesk profile to add custom configuration
# created only one time
lxc profile create redpesk
# add /dev/loop-control device to support mock 2.x
lxc profile device add redpesk loop-control unix-char path=/dev/loop-control
lxc profile set redpesk security.privileged true
lxc profile set redpesk security.nesting true
lxc profile set redpesk security.syscalls.blacklist "keyctl errno 38\nkeyctl_chown errno 38"
Setting up the LXC container
Import and start
Download and import the redpesk builder image:
container_name=<container_name>
export container_name
lxc launch iotbzh:redpesk-builder-devel/arz ${container_name} -p default -p redpesk
Retrieve and add a host entry in your system to easily reach the container:
lxc network list-leases lxdbr0
# retrieve local address of your container
lxc ls -c 4
MY_IP_ADD_RESS=……
# OR
MY_IP_ADD_RESS=$(lxc ls --format json |jq -r '.[0].state.network.eth0.addresses[0].address')
echo "${MY_IP_ADD_RESS} ${container_name}" | sudo tee -a /etc/hosts
Mapping your user directory inside the container
You will have three repositories in your container (gitsources, gitpkgs, and build).
To have files on your host and retrieve them in the container, you can precise directories path.
# Import your SSH key
lxc config device add ${container_name} my_ssh disk source=~/.ssh path=/home/devel/.ssh
# Add your applications sources directory, example:
gitsources=$HOME/my_rp_builder_dir/gitsources
# Add your gitpkgs directory (where is the specfile), example:
gitpkgs=$HOME/my_rp_builder_dir/gitpkgs
# Add your build directory (files generated by rpmbuild), example:
build=$HOME/my_rp_builder_dir/rpmbuild
# Directories will be created if they don't exist
mkdir -p {$gitsources,$gitpkgs,$build}
# Mapping of host directories to retrieve your files in the container
lxc config device add ${container_name} my_gitsources disk source=${gitsources} path=/home/devel/gitsources
lxc config device add ${container_name} my_gitpkgs disk source=${gitpkgs} path=/home/devel/gitpkgs
lxc config device add ${container_name} my_build disk source=${build} path=/home/devel/rpmbuild
Enter in your container and watch permission inside the imported directory:
ssh devel@${container_name}
ls -l ~/gitsources
ls -l ~/gitpkgs
ls -l ~/build
If your files and directories are owned by the user nobody then you won’t be able to build directly from theses directories. You have to remap the uid/gid and restart the container:
lxc config set ${container_name} raw.idmap "$(echo -e "uid $(id -u) $(lxc exec ${container_name} -- su devel -c 'id -u')\ngid $(id -g) $(lxc exec ${container_name} -- su devel -c 'id -g')")"
lxc restart ${container_name}
Setup your HOST for local crossbuild
Ubuntu
-
Install qemu-user-static and remove qemu-user-binfmt from your host:
sudo apt install qemu-user-static binfmt-support sudo apt remove qemu-user-binfmt -
Stop and disable automount of binfmt_misc:
sudo systemctl stop proc-sys-fs-binfmt_misc.automount sudo systemctl disable proc-sys-fs-binfmt_misc.automount sudo systemctl stop binfmt-support.service -
Manually mount binfmt_misc (if not already mounted):
sudo mount -t binfmt_misc none /proc/sys/fs/binfmt_misc/ -
Modify /var/lib/binfmts/qemu-aarch64 with this exact content :
sudo vim /var/lib/binfmts/qemu-aarch64sudo cat << EOF | sudo tee /var/lib/binfmts/qemu-aarch64 qemu-user-static magic 0 \x7f\x45\x4c\x46\x02\x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\xb7\x00 \xff\xff\xff\xff\xff\xff\xff\x00\xff\xff\xff\xff\xff\xff\xff\xff\xfe\xff\xff\xff /usr/bin/qemu-aarch64-static yes EOF -
Update qemu-aarch64 support:
sudo update-binfmts --disable qemu-aarch64 sudo update-binfmts --enable qemu-aarch64 -
Verify the support of qemu-aarch64:
cat /proc/sys/fs/binfmt_misc/qemu-aarch64You might have this content:
enabled interpreter /usr/bin/qemu-aarch64-static flags: F offset 0 magic 7f454c460201010000000000000000000200b700 mask ffffffffffffff00fffffffffffffffffeffffffNOTE: flags can be set to ‘0CF’. This is correct too.
-
Enable automount of binfmt.service:
sudo systemctl enable proc-sys-fs-binfmt_misc.automount sudo systemctl start proc-sys-fs-binfmt_misc.automount
Fedora
-
Just install the qemu-user-static package:
sudo dnf install qemu-user-static -
Verify the support of qemu-aarch64:
cat /proc/sys/fs/binfmt_misc/qemu-aarch64You might have this content:
enabled interpreter /usr/bin/qemu-aarch64-static flags: F offset 0 magic 7f454c460201010000000000000000000200b700 mask ffffffffffffff00fffffffffffffffffeffffff