Performance Test Report

General

The table provides an overview of the comparison between two selected commits from the same branch.

	Current commit	Comparing with
Hostname	perf-debian12-vk	perf-debian12-vk
Branch	master	master
Commit number	76140	76139
Commit	38c2a44f724	47b0a946262
Number of test runs	8	2

Test result summary

The test summary presents a thorough breakdown of each test conducted on the branch, including details such as build time and disk space consumption. Additionally, it gives insights into the average time taken for test execution, along with absolute and relative values for a better understanding.

Test name	Measurement description	Mean value	Absolute difference	Relative difference
test1: Build core-image-sato	build time	41:01.6	-15.3 s	-0.6 %
	tmpdir size	89.89 GiB	-360.5 kiB	-0.0 %
	rootfs size	346.02 MiB	+0.0 kiB	+0.0 %
test12: Build virtual/kernel	build time	4:11.2	-0.89 s	-0.4 %
test13: Build core-image-sato with rm_work enabled	build time	43:14.7	-12.0 s	-0.5 %
	tmpdir size	17.01 GiB	-716.5 kiB	-0.0 %
test2: Run core-image-sato do_rootfs with sstate	do_rootfs time	56.8 s	+0.31 s	+0.5 %
test3: Bitbake parsing (bitbake -p)	parse_1 time	7.9 s	+0.19 s	+2.5 %
	parse_2 time	7.2 s	+0.15 s	+2.1 %
	parse_3 time	1.2 s	+0.01 s	+0.5 %
test4: eSDK metrics	installer_bin size	415.94 MiB	+3.6 kiB	+0.0 %
	deploy time	33.4 s	+0.27 s	+0.8 %
	deploy_dir size	2.39 GiB	-17.4 kiB	-0.0 %

Test details

The following section provides details of each test, accompanied by charts representing build time and disk usage over time or by commit number.

test1: Build core-image-sato

build time

41:01.6 -15.3 s (-0.6 %)

Test runs	8
-/+	-16.8 s / +10.5 s
Min	40:44.8
Max	41:12.1
Stdev	10.7 s

Task resource usage

Number of tasks

Top consumers of cputime

9325 (+0)

rust-llvm-native.do_compile	8850 s
llvm-native.do_compile	8536 s
rust-native.do_install	3144 s
gcc.do_compile	2011 s
linux-yocto.do_compile	1862 s

Biggest increase in cputime

Biggest decrease in cputime

llvm-native.do_compile	+153 s
rust-native.do_install	+91 s
glibc-locale.do_package_write_rpm	+25 s
gstreamer1.0-plugins-bad.do_compile	+22 s
mesa.do_compile	+19 s

rust-llvm-native.do_compile	-136 s
linux-yocto.do_compile	-48 s
gcc.do_compile	-31 s
mesa.do_package_write_rpm	-26 s
spirv-tools-native.do_compile	-22 s

No recipe version changes detected

tmpdir size

89.89 GiB -360.5 kiB (-0.0 %)

Test runs	8
-/+	-231.5 kiB / +384.5 kiB
Min	89.89 GiB
Max	89.89 GiB
Stdev	220.1 kiB

rootfs size

346.02 MiB +0.0 kiB (+0.0 %)

Test runs	8
-/+	-0.0 kiB / +0.0 kiB
Min	346.02 MiB
Max	346.02 MiB
Stdev	0.0 kiB

test12: Build virtual/kernel

build time

4:11.2 -0.89 s (-0.4 %)

Test runs	8
-/+	-1.2 s / +1.2 s
Min	4:09.9
Max	4:12.3
Stdev	0.92 s

test13: Build core-image-sato with rm_work enabled

build time

43:14.7 -12.0 s (-0.5 %)

Test runs	8
-/+	-1:28.0 / +1:38.7
Min	41:46.7
Max	44:53.4
Stdev	1:26.3

Task resource usage

Number of tasks

Top consumers of cputime

9891 (+0)

rust-llvm-native.do_compile	8969 s
llvm-native.do_compile	8676 s
rust-native.do_install	2905 s
gcc.do_compile	1951 s
qemu-system-native.do_compile	1942 s

Biggest increase in cputime

Biggest decrease in cputime

rust-llvm-native.do_compile	+47 s
cmake-native.do_compile	+40 s
gcc.do_compile	+26 s
librsvg.do_compile	+21 s
rust-native.do_install	+13 s

llvm-native.do_compile	-46 s
linux-yocto.do_compile	-18 s
gcc-cross-i686.do_compile	-13 s
binutils.do_package_write_rpm	-12 s
spirv-tools-native.do_compile	-11 s

No recipe version changes detected

tmpdir size

17.01 GiB -716.5 kiB (-0.0 %)

Test runs	8
-/+	-543.5 kiB / +1.39 MiB
Min	17.01 GiB
Max	17.01 GiB
Stdev	620.5 kiB

test2: Run core-image-sato do_rootfs with sstate

do_rootfs time

56.8 s +0.31 s (+0.5 %)

Test runs	8
-/+	-0.66 s / +1.8 s
Min	56.2 s
Max	58.7 s
Stdev	0.81 s

test3: Bitbake parsing (bitbake -p)

parse_1 time

7.9 s +0.19 s (+2.5 %)

Test runs	8
-/+	-0.62 s / +0.55 s
Min	7.3 s
Max	8.5 s
Stdev	0.36 s

parse_2 time

7.2 s +0.15 s (+2.1 %)

Test runs	8
-/+	-0.49 s / +0.68 s
Min	6.7 s
Max	7.8 s
Stdev	0.37 s

parse_3 time

1.2 s +0.01 s (+0.5 %)

Test runs	8
-/+	-0.02 s / +0.04 s
Min	1.2 s
Max	1.3 s
Stdev	0.02 s

test4: eSDK metrics

installer_bin size

415.94 MiB +3.6 kiB (+0.0 %)

Test runs	8
-/+	-8.1 kiB / +8.9 kiB
Min	415.93 MiB
Max	415.94 MiB
Stdev	5.8 kiB

deploy time

33.4 s +0.27 s (+0.8 %)

Test runs	8
-/+	-0.78 s / +0.56 s
Min	32.6 s
Max	34.0 s
Stdev	0.48 s

deploy_dir size

2.39 GiB -17.4 kiB (-0.0 %)

Test runs	8
-/+	-64.6 kiB / +30.4 kiB
Min	2.39 GiB
Max	2.39 GiB
Stdev	38.8 kiB