Performance Test Report

General

The table provides an overview of the comparison between two selected commits from the same branch.

	Current commit	Comparing with
Hostname	perf-debian12-vk	perf-debian12-vk
Branch	master	master
Commit number	77168	77157
Commit	cf616cbae71	cfb975c62e5
Number of test runs	8	3

Test result summary

The test summary presents a thorough breakdown of each test conducted on the branch, including details such as build time and disk space consumption. Additionally, it gives insights into the average time taken for test execution, along with absolute and relative values for a better understanding.

Test name	Measurement description	Mean value	Absolute difference	Relative difference
test1: Build core-image-sato	build time	39:55.1	+38.0 s	+1.6 %
	tmpdir size	96.91 GiB	+242.8 kiB	+0.0 %
	rootfs size	348.80 MiB	+0.0 kiB	+0.0 %
test12: Build virtual/kernel	build time	3:43.6	+1.4 s	+0.6 %
test13: Build core-image-sato with rm_work enabled	build time	41:50.5	+51.0 s	+2.1 %
	tmpdir size	17.68 GiB	-89.3 kiB	-0.0 %
test2: Run core-image-sato do_rootfs with sstate	do_rootfs time	59.0 s	+0.45 s	+0.8 %
test3: Bitbake parsing (bitbake -p)	parse_1 time	8.7 s	-0.41 s	-4.5 %
	parse_2 time	8.8 s	-0.01 s	-0.1 %
	parse_3 time	2.7 s	-0.01 s	-0.3 %
test4: eSDK metrics	installer_bin size	416.84 MiB	-2.0 kiB	-0.0 %
	deploy time	37.3 s	+0.72 s	+2.0 %
	deploy_dir size	2.42 GiB	+54.2 kiB	+0.0 %

Test details

The following section provides details of each test, accompanied by charts representing build time and disk usage over time or by commit number.

test1: Build core-image-sato

build time

39:55.1 +38.0 s (+1.6 %)

Test runs	8
-/+	-35.4 s / +31.5 s
Min	39:19.7
Max	40:26.6
Stdev	25.4 s

Task resource usage

Number of tasks

Top consumers of cputime

9316 (+0)

rust-llvm-native.do_compile	8965 s
llvm-native.do_compile	8506 s
rust-native.do_install	3698 s
gcc.do_compile	2022 s
linux-yocto.do_compile	1876 s

Biggest increase in cputime

Biggest decrease in cputime

gcc.do_compile	+23 s
cargo-native.do_compile	+22 s
librsvg.do_compile	+20 s
cmake-native.do_compile	+9 s
glib-2.0.do_compile	+9 s

llvm-native.do_compile	-332 s
rust-native.do_install	-81 s
mesa-native.do_compile	-77 s
qemu-system-native.do_compile	-44 s
cargo-c-native-0.10.5+cargo.do_compile	-41 s

No recipe version changes detected

tmpdir size

96.91 GiB +242.8 kiB (+0.0 %)

Test runs	8
-/+	-313.5 kiB / +382.5 kiB
Min	96.91 GiB
Max	96.91 GiB
Stdev	213.2 kiB

rootfs size

348.80 MiB +0.0 kiB (+0.0 %)

Test runs	8
-/+	-0.0 kiB / +0.0 kiB
Min	348.80 MiB
Max	348.80 MiB
Stdev	0.0 kiB

test12: Build virtual/kernel

build time

3:43.6 +1.4 s (+0.6 %)

Test runs	8
-/+	-1.1 s / +0.63 s
Min	3:42.5
Max	3:44.2
Stdev	0.67 s

test13: Build core-image-sato with rm_work enabled

build time

41:50.5 +51.0 s (+2.1 %)

Test runs	8
-/+	-51.0 s / +1:19.2
Min	40:59.5
Max	43:09.7
Stdev	53.6 s

Task resource usage

Number of tasks

Top consumers of cputime

9881 (+0)

rust-llvm-native.do_compile	9001 s
llvm-native.do_compile	8774 s
rust-native.do_install	3696 s
gcc.do_compile	2036 s
qemu-system-native.do_compile	1946 s

Biggest increase in cputime

Biggest decrease in cputime

qemu-system-native.do_compile	+25 s
mesa.do_compile	+17 s
perl.do_compile	+15 s
glib-2.0.do_compile	+7 s
linux-yocto.do_package_qa	+7 s

rust-native.do_install	-102 s
cargo-native.do_compile	-78 s
llvm-native.do_compile	-60 s
cargo-c-native-0.10.5+cargo.do_compile	-49 s
linux-yocto.do_compile	-40 s

No recipe version changes detected

tmpdir size

17.68 GiB -89.3 kiB (-0.0 %)

Test runs	8
-/+	-380.0 kiB / +1.16 MiB
Min	17.68 GiB
Max	17.68 GiB
Stdev	492.8 kiB

test2: Run core-image-sato do_rootfs with sstate

do_rootfs time

59.0 s +0.45 s (+0.8 %)

Test runs	8
-/+	-1.0 s / +0.70 s
Min	58.0 s
Max	59.7 s
Stdev	0.54 s

test3: Bitbake parsing (bitbake -p)

parse_1 time

8.7 s -0.41 s (-4.5 %)

Test runs	8
-/+	-0.48 s / +0.56 s
Min	8.2 s
Max	9.3 s
Stdev	0.32 s

parse_2 time

8.8 s -0.01 s (-0.1 %)

Test runs	8
-/+	-0.76 s / +0.36 s
Min	8.0 s
Max	9.1 s
Stdev	0.36 s

parse_3 time

2.7 s -0.01 s (-0.3 %)

Test runs	8
-/+	-0.02 s / +0.01 s
Min	2.6 s
Max	2.7 s
Stdev	0.01 s

test4: eSDK metrics

installer_bin size

416.84 MiB -2.0 kiB (-0.0 %)

Test runs	8
-/+	-33.6 kiB / +30.4 kiB
Min	416.81 MiB
Max	416.87 MiB
Stdev	21.5 kiB

deploy time

37.3 s +0.72 s (+2.0 %)

Test runs	8
-/+	-0.64 s / +0.41 s
Min	36.7 s
Max	37.8 s
Stdev	0.32 s

deploy_dir size

2.42 GiB +54.2 kiB (+0.0 %)

Test runs	8
-/+	-65.2 kiB / +22.8 kiB
Min	2.42 GiB
Max	2.42 GiB
Stdev	27.5 kiB