Performance Test Report

General

The table provides an overview of the comparison between two selected commits from the same branch.

	Current commit	Comparing with
Hostname	perf-debian11	perf-debian11
Branch	master	master
Commit number	74904	74896
Commit	058465859ed	918c66d8e6d
Number of test runs	7	4

Test result summary

The test summary presents a thorough breakdown of each test conducted on the branch, including details such as build time and disk space consumption. Additionally, it gives insights into the average time taken for test execution, along with absolute and relative values for a better understanding.

Test name	Measurement description	Mean value	Absolute difference	Relative difference
test1: Build core-image-sato	build time	1:22:10	+12.4 s	+0.3 %
	tmpdir size	95.29 GiB	+677.0 kiB	+0.0 %
	rootfs size	342.13 MiB	+0.0 kiB	+0.0 %
test12: Build virtual/kernel	build time	8:58.9	-1.6 s	-0.3 %
test13: Build core-image-sato with rm_work enabled	build time	1:22:33	-22.7 s	-0.5 %
	tmpdir size	16.64 GiB	+418.0 kiB	+0.0 %
test2: Run core-image-sato do_rootfs with sstate	do_rootfs time	5:09.4	+5.2 s	+1.7 %
test3: Bitbake parsing (bitbake -p)	parse_1 time	26.1 s	+0.22 s	+0.8 %
	parse_2 time	24.1 s	-0.00 s	-0.0 %
	parse_3 time	2.9 s	+0.01 s	+0.4 %
test4: eSDK metrics	installer_bin size	420.74 MiB	-62.7 kiB	-0.0 %
	deploy time	1:31.0	+1.6 s	+1.8 %
	deploy_dir size	2.40 GiB	-76.5 kiB	-0.0 %

Test details

The following section provides details of each test, accompanied by charts representing build time and disk usage over time or by commit number.

test1: Build core-image-sato

build time

1:22:10 +12.4 s (+0.3 %)

Test runs	7
-/+	-30.9 s / +37.6 s
Min	1:21:39
Max	1:22:48
Stdev	29.3 s

Task resource usage

Number of tasks

Top consumers of cputime

9554 (+0)

rust-llvm-native.do_compile	10857 s
llvm-native.do_compile	10777 s
rust-native.do_install	6075 s
gcc.do_compile	3148 s
linux-yocto.do_compile	2699 s

Biggest increase in cputime

Biggest decrease in cputime

rust-llvm-native.do_compile	+39 s
spirv-tools-native.do_compile	+15 s
rust-native.do_install	+10 s
glibc.do_compile	+8 s
gcc-cross-i686.do_compile	+5 s

llvm-native.do_compile	-12 s
harfbuzz.do_compile	-7 s
cargo-native.do_compile	-6 s
mesa-native.do_compile	-5 s
gcc.do_compile	-4 s

Recipe version changes

Version changed
llvm-native	18.1.6 → 18.1.8

tmpdir size

95.29 GiB +677.0 kiB (+0.0 %)

Test runs	7
-/+	-288.0 kiB / +316.0 kiB
Min	95.29 GiB
Max	95.29 GiB
Stdev	208.9 kiB

rootfs size

342.13 MiB +0.0 kiB (+0.0 %)

Test runs	7
-/+	-0.0 kiB / +0.0 kiB
Min	342.13 MiB
Max	342.13 MiB
Stdev	0.0 kiB

test12: Build virtual/kernel

build time

8:58.9 -1.6 s (-0.3 %)

Test runs	7
-/+	-5.1 s / +5.2 s
Min	8:53.8
Max	9:04.1
Stdev	4.0 s

test13: Build core-image-sato with rm_work enabled

build time

1:22:33 -22.7 s (-0.5 %)

Test runs	7
-/+	-45.9 s / +1:05.7
Min	1:21:47
Max	1:23:39
Stdev	43.2 s

Task resource usage

Number of tasks

Top consumers of cputime

10317 (+0)

llvm-native.do_compile	10872 s
rust-llvm-native.do_compile	10816 s
rust-native.do_install	6085 s
gcc.do_compile	3195 s
linux-yocto.do_compile	2698 s

Biggest increase in cputime

Biggest decrease in cputime

llvm-native.do_compile	+6 s
librsvg.do_compile	+6 s
linux-yocto.do_package_write_rpm	+6 s
glibc-locale.do_package	+6 s
perl.do_package_write_rpm	+5 s

rust-llvm-native.do_compile	-26 s
linux-yocto.do_compile	-21 s
gcc.do_compile	-18 s
openssl.do_package_write_rpm	-11 s
spirv-tools-native.do_compile	-11 s

Recipe version changes

Version changed
llvm-native	18.1.6 → 18.1.8

tmpdir size

16.64 GiB +418.0 kiB (+0.0 %)

Test runs	7
-/+	-604.0 kiB / +1.07 MiB
Min	16.64 GiB
Max	16.64 GiB
Stdev	729.2 kiB

test2: Run core-image-sato do_rootfs with sstate

do_rootfs time

5:09.4 +5.2 s (+1.7 %)

Test runs	7
-/+	-15.3 s / +9.8 s
Min	4:54.1
Max	5:19.2
Stdev	7.7 s

test3: Bitbake parsing (bitbake -p)

parse_1 time

26.1 s +0.22 s (+0.8 %)

Test runs	7
-/+	-0.60 s / +0.40 s
Min	25.5 s
Max	26.5 s
Stdev	0.36 s

parse_2 time

24.1 s -0.00 s (-0.0 %)

Test runs	7
-/+	-0.57 s / +0.80 s
Min	23.6 s
Max	24.9 s
Stdev	0.44 s

parse_3 time

2.9 s +0.01 s (+0.4 %)

Test runs	7
-/+	-0.02 s / +0.01 s
Min	2.9 s
Max	2.9 s
Stdev	0.01 s

test4: eSDK metrics

installer_bin size

420.74 MiB -62.7 kiB (-0.0 %)

Test runs	7
-/+	-3.6 kiB / +2.4 kiB
Min	420.73 MiB
Max	420.74 MiB
Stdev	1.9 kiB

deploy time

1:31.0 +1.6 s (+1.8 %)

Test runs	7
-/+	-3.2 s / +1.5 s
Min	1:27.8
Max	1:32.5
Stdev	1.9 s

deploy_dir size

2.40 GiB -76.5 kiB (-0.0 %)

Test runs	7
-/+	-88.3 kiB / +48.7 kiB
Min	2.40 GiB
Max	2.40 GiB
Stdev	61.2 kiB