Performance Test Report

General

The table provides an overview of the comparison between two selected commits from the same branch.

	Current commit	Comparing with
Hostname	perf-debian12-vk	perf-debian12-vk
Branch	master	master
Commit number	78074	78059
Commit	b223b6d533a	79fa12ae4b7
Number of test runs	7	3

Test result summary

The test summary presents a thorough breakdown of each test conducted on the branch, including details such as build time and disk space consumption. Additionally, it gives insights into the average time taken for test execution, along with absolute and relative values for a better understanding.

Test name	Measurement description	Mean value	Absolute difference	Relative difference
test1: Build core-image-sato	build time	1:00:32	-0.48 s	-0.0 %
	tmpdir size	109.37 GiB	+3.44 MiB	+0.0 %
	rootfs size	535.74 MiB	+0.0 kiB	+0.0 %
test12: Build virtual/kernel	build time	4:16.6	+4.0 s	+1.6 %
test13: Build core-image-sato with rm_work enabled	build time	1:00:41	+8.5 s	+0.2 %
	tmpdir size	19.04 GiB	+1.23 MiB	+0.0 %
test2: Run core-image-sato do_rootfs with sstate	do_rootfs time	1:11.5	+0.67 s	+0.9 %
test3: Bitbake parsing (bitbake -p)	parse_1 time	11.1 s	+0.85 s	+8.3 %
	parse_2 time	10.1 s	+0.10 s	+1.0 %
	parse_3 time	2.1 s	-0.05 s	-2.4 %
test4: eSDK metrics	installer_bin size	545.84 MiB	+376.5 kiB	+0.1 %
	deploy time	47.9 s	+0.67 s	+1.4 %
	deploy_dir size	3.25 GiB	+1.40 MiB	+0.0 %

Test details

The following section provides details of each test, accompanied by charts representing build time and disk usage over time or by commit number.

test1: Build core-image-sato

build time

1:00:32 -0.48 s (-0.0 %)

Test runs	7
-/+	-15.3 s / +13.8 s
Min	1:00:17
Max	1:00:46
Stdev	12.1 s

Task resource usage

Number of tasks

Top consumers of cputime

9372 (+0)

llvm-native.do_compile	20629 s
llvm.do_compile	19410 s
rust-llvm-native.do_compile	8918 s
rust-native.do_install	3894 s
gcc.do_compile	2104 s

Biggest increase in cputime

Biggest decrease in cputime

llvm.do_compile	+206 s
cmake-native.do_compile	+47 s
gtk4.do_compile	+12 s
rust-native.do_install	+11 s
rust-llvm-native.do_compile	+7 s

llvm-native.do_compile	-31 s
qemu-native.do_compile	-12 s
mesa-native.do_compile	-10 s
harfbuzz-native.do_compile	-10 s
icu-native-76.do_compile	-9 s

Recipe version changes

Version changed
perl	5.40.1 → 5.40.2
perl-native	5.40.1 → 5.40.2
perlcross-native	1.6.1 → 1.6.2

tmpdir size

109.37 GiB +3.44 MiB (+0.0 %)

Test runs	7
-/+	-620.6 kiB / +639.4 kiB
Min	109.36 GiB
Max	109.37 GiB
Stdev	493.7 kiB

rootfs size

535.74 MiB +0.0 kiB (+0.0 %)

Test runs	7
-/+	-0.0 kiB / +0.0 kiB
Min	535.74 MiB
Max	535.74 MiB
Stdev	0.0 kiB

test12: Build virtual/kernel

build time

4:16.6 +4.0 s (+1.6 %)

Test runs	7
-/+	-1.3 s / +0.62 s
Min	4:15.3
Max	4:17.2
Stdev	0.72 s

test13: Build core-image-sato with rm_work enabled

build time

1:00:41 +8.5 s (+0.2 %)

Test runs	7
-/+	-14.1 s / +14.9 s
Min	1:00:27
Max	1:00:56
Stdev	9.5 s

Task resource usage

Number of tasks

Top consumers of cputime

9940 (+0)

llvm-native.do_compile	20285 s
llvm.do_compile	20039 s
rust-llvm-native.do_compile	8860 s
rust-native.do_install	3916 s
gcc.do_compile	2123 s

Biggest increase in cputime

Biggest decrease in cputime

llvm.do_compile	+135 s
rust-llvm-native.do_compile	+17 s
bluez5.do_compile_ptest_base	+11 s
cmake-native.do_compile	+11 s
qemu-system-native.do_compile	+9 s

llvm-native.do_compile	-80 s
linux-yocto.do_compile_kernelmodules	-16 s
spirv-tools-native.do_compile	-8 s
gcc-cross-i686.do_compile	-8 s
glibc-locale.do_package	-7 s

Recipe version changes

Version changed
perl	5.40.1 → 5.40.2
perl-native	5.40.1 → 5.40.2
perlcross-native	1.6.1 → 1.6.2

tmpdir size

19.04 GiB +1.23 MiB (+0.0 %)

Test runs	7
-/+	-86.3 kiB / +177.7 kiB
Min	19.04 GiB
Max	19.04 GiB
Stdev	119.6 kiB

test2: Run core-image-sato do_rootfs with sstate

do_rootfs time

1:11.5 +0.67 s (+0.9 %)

Test runs	7
-/+	-1.1 s / +1.6 s
Min	1:10.4
Max	1:13.2
Stdev	0.96 s

test3: Bitbake parsing (bitbake -p)

parse_1 time

11.1 s +0.85 s (+8.3 %)

Test runs	7
-/+	-0.55 s / +0.84 s
Min	10.5 s
Max	11.9 s
Stdev	0.54 s

parse_2 time

10.1 s +0.10 s (+1.0 %)

Test runs	7
-/+	-0.35 s / +1.0 s
Min	9.7 s
Max	11.1 s
Stdev	0.48 s

parse_3 time

2.1 s -0.05 s (-2.4 %)

Test runs	7
-/+	-0.04 s / +0.06 s
Min	2.1 s
Max	2.2 s
Stdev	0.03 s

test4: eSDK metrics

installer_bin size

545.84 MiB +376.5 kiB (+0.1 %)

Test runs	7
-/+	-13.9 kiB / +28.1 kiB
Min	545.83 MiB
Max	545.87 MiB
Stdev	16.5 kiB

deploy time

47.9 s +0.67 s (+1.4 %)

Test runs	7
-/+	-1.4 s / +0.96 s
Min	46.5 s
Max	48.9 s
Stdev	0.80 s

deploy_dir size

3.25 GiB +1.40 MiB (+0.0 %)

Test runs	7
-/+	-142.9 kiB / +134.1 kiB
Min	3.25 GiB
Max	3.25 GiB
Stdev	81.4 kiB