Skip to content

Conversation

namhyung
Copy link
Owner

Hi all, I'm preparing a new release (v0.18) with these changes:

  • filter condition support
  • support LTO build
  • add avg/max/min fields to uftrace graph
  • many updates on the test
  • a fix for Go programs built with gccgo

Please take a look and play with it. It'd be great if you could report how it goes on your platform.

This is a new release including the following:

 * filter condition support
 * support LTO build
 * add avg/max/min fields to uftrace graph
 * many updates on the test
 * a fix for Go programs built with gccgo

Signed-off-by: Namhyung Kim <[email protected]>
@gichoel
Copy link
Contributor

gichoel commented Jun 29, 2025

Refer to the previously executed command in Release v0.16 PR and i ran the make test -j$(nproc) command on a VisionFive2 board with a RISC-V architecture and got three results as shown below.

Running 107 test cases
======================
[001] unittest_framework            : PASS

......

[067] mcount_list_event             : PASS
WARN: failed to open 'cycles' perf event: Invalid argument
[068] mcount_pmu_event              : SKIP

......

[107] utils_strv                    : PASS

unit test stats
====================
106 ran successfully
  0 failed
  1 skipped
  0 signal caught
  0 unknown result
$ cat test_result.txt | grep -E "NG|NZ|SG|TM|BI|LA|SK"

022 filter_kernel       : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
052 nested_func         : NG OK OK OK OK NG OK OK OK OK  SK SK SK SK SK SK SK SK SK SK
058 arg_int             : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
059 arg_str             : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
060 arg_fmt             : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
062 arg_char            : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
063 retval              : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
065 arg_order           : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
075 lib_arg             : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
079 replay_kernel_D1    : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
080 replay_kernel_D2    : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
081 kernel_depth        : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
082 arg_many            : NG NG NG NG NG SK SK SK SK SK  NG NG NG NG NG SK SK SK SK SK
083 arg_float           : OK OK OK OK OK SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
084 arg_mixed           : NG NG NG NG NG SK SK SK SK SK  NG NG NG NG NG SK SK SK SK SK
085 arg_reg             : NG NG NG NG NG SK SK SK SK SK  NG NG NG NG NG SK SK SK SK SK
086 arg_stack           : NG NG NG NG NG SK SK SK SK SK  NG NG NG NG NG SK SK SK SK SK
087 arg_variadic        : NG NG NG NG NG SK SK SK SK SK  NG NG NG NG NG SK SK SK SK SK
103 dump_kernel         : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
104 graph_kernel        : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
109 replay_time_A       : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
111 kernel_tid          : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
124 exception1          : OK NG NG NG NG OK OK OK OK OK  OK OK OK OK OK NG NG NG NG NG
126 arg_regex           : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
127 arg_module1         : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
128 arg_module2         : OK OK OK OK OK SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
132 trigger_kernel      : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
133 long_string         : OK OK OK OK OK SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
134 pic_pie             : TM TM TM TM TM OK OK OK OK OK  TM TM TM TM TM OK OK OK OK OK
136 dynamic_basic       : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
137 kernel_tid_update   : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
138 kernel_dynamic1     : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
139 kernel_dynamic2     : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
140 dynamic_xray        : BI BI BI BI BI BI BI BI BI BI  BI BI BI BI BI BI BI BI BI BI
143 recv_kernel         : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
145 longjmp3            : TM TM TM TM TM TM TM TM TM TM  TM TM TM TM TM TM TM TM TM TM
146 arg_std_string      : TM TM TM TM TM SK SK SK SK SK  TM NG TM TM TM SK SK SK SK SK
147 event_sdt           : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
148 event_kernel1       : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
149 event_kernel2       : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
150 recv_event          : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
168 lib_nested          : NG NG NG NG NG NG NG NG NG NG  OK OK OK OK OK OK OK OK OK OK
171 script_option       : OK OK OK OK TM TM OK OK TM TM  OK OK TM OK OK OK TM TM OK TM
173 trigger_args        : TM TM TM TM TM SK SK SK SK SK  TM TM TM OK TM SK SK SK SK SK
174 replay_filter_kernel: SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
176 arg_fptr            : OK OK OK OK OK OK OK OK OK OK  TM TM OK OK OK OK OK TM OK OK
178 arg_auto1           : TM OK TM OK OK TM OK OK OK TM  OK TM OK TM TM TM OK OK OK OK
179 arg_auto2           : TM TM TM OK TM TM TM TM OK TM  OK OK TM OK TM TM TM TM TM TM
180 arg_auto3           : TM TM TM TM TM TM TM TM OK TM  TM TM TM TM TM TM TM TM TM OK
184 arg_enum1           : TM TM TM TM TM TM OK TM TM TM  TM TM TM TM TM TM TM TM TM TM
185 exception2          : NG NG NG NG NG OK OK OK OK OK  NG NG NG NG NG NG NG NG NG NG
186 exception3          : NG NG NG NG NG OK OK OK OK OK  NG NG NG NG NG NG NG NG NG NG
190 trigger_autoargs    : OK OK OK OK OK OK TM OK OK OK  TM OK OK TM OK TM OK OK TM OK
191 posix_spawn         : TM OK TM TM OK OK TM OK OK TM  TM OK TM TM TM TM OK OK TM TM
192 lib_name            : NG NG NG NG NG NG NG NG NG NG  OK OK OK OK OK OK OK OK OK OK
193 read_pmu_cycle      : NG NG NG NG NG NG NG NG NG NG  NG NG NG NG NG NG NG NG NG NG
194 read_pmu_cache      : NG NG NG NG NG NG NG NG NG NG  NG NG NG NG NG NG NG NG NG NG
195 read_pmu_branch     : NG NG NG NG NG NG NG NG NG NG  NG NG NG NG NG NG NG NG NG NG
196 chrome_taskname     : OK OK NG OK OK NG NG OK OK OK  OK OK OK OK OK OK OK NG OK OK
198 lib_arg_float       : OK OK OK OK OK SK SK SK SK SK  TM OK TM TM TM SK SK SK SK SK
201 arg_dwarf1          : TM TM TM TM TM SK SK SK SK SK  TM TM TM TM TM SK SK SK SK SK
202 arg_dwarf2          : TM TM TM TM TM SK SK SK SK SK  TM TM TM TM TM SK SK SK SK SK
203 arg_dwarf3          : TM TM TM TM TM SK SK SK SK SK  TM TM TM TM TM SK SK SK SK SK
204 arg_dwarf4          : TM TM TM TM TM SK SK SK SK SK  TM TM TM TM TM SK SK SK SK SK
205 arg_auto4           : TM TM TM TM TM SK SK SK SK SK  TM TM TM TM OK SK SK SK SK SK
206 arg_enum2           : TM NG TM NG TM SK SK SK SK SK  OK OK TM TM OK SK SK SK SK SK
213 arg_symbol          : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
214 signal_trigger      : OK OK OK OK OK OK NZ NZ NZ NZ  OK OK OK OK OK NZ OK NZ NZ NZ
223 dynamic_full        : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
224 dynamic_lib         : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
225 dynamic_size        : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
227 read_pmu_cycle2     : NG NG NG NG NG NG NG NG NG NG  NG NG NG NG NG NG NG NG NG NG
228 read_pmu_cycle3     : NG NG NG NG NG NG NG NG NG NG  NG NG NG NG NG NG NG NG NG NG
231 arg_bound           : NG TM NG NG NG SK SK SK SK SK  OK OK OK TM OK SK SK SK SK SK
232 dynamic_unpatch     : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
233 dynamic_unpatch2    : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
234 script_luajit       : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
238 report_field2       : OK OK OK OK OK NG OK OK OK OK  OK OK OK OK OK OK OK OK OK OK
248 dynamic_dlopen      : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
251 exception4          : NG OK OK OK OK SG SG SG SG SG  OK OK OK OK OK SG SG SG SG SG
254 arg_dwarf5          : NG NG NG TM NG SK SK SK SK SK  NG TM TM NG NG SK SK SK SK SK
255 arg_dwarf6          : TM TM TM TM TM SK SK SK SK SK  TM TM TM TM TM SK SK SK SK SK
256 arg_dwarf7          : TM TM TM TM TM SK SK SK SK SK  TM TM TM TM TM SK SK SK SK SK
257 arg_struct_replay   : TM TM TM TM TM SK SK SK SK SK  TM TM TM TM TM SK SK SK SK SK
258 arg_struct_dump     : NG OK OK OK OK SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
259 arg_struct_script   : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
260 arg_struct_luajit   : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
263 patchable_dynamic1  : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
264 patchable_dynamic2  : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
265 patchable_dynamic3  : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
266 patchable_dynamic4  : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
267 patchable_dynamic5  : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
269 arg_no_args_replay  : OK OK OK OK OK SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
270 arg_no_args_dump    : OK OK OK OK OK SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
287 arg_enum3           : TM NG TM TM TM SK SK SK SK SK  NG NG TM TM TM SK SK SK SK SK
288 arg_oct             : OK OK OK OK OK OK OK OK OK OK  OK TM OK TM OK OK TM TM OK TM
289 exception5          : OK OK OK OK OK NG NG NG NG NG  OK OK OK OK OK NG NG NG NG NG
291 arg_dlopen          : TM TM TM TM TM SK SK SK SK SK  TM TM TM TM TM SK SK SK SK SK
293 arg_cond1           : NZ NZ NZ NZ NZ SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
294 arg_cond2           : TM TM TM TM TM SK SK SK SK SK  TM TM TM TM TM SK SK SK SK SK

runtime test stats
====================
total  5920  Tests executed (success: 72.06%)
  OK:  4190  Test succeeded
  OK:    76  Test succeeded (with some fixup)
  NG:   300  Different test result
  NZ:    13  Non-zero return value
  SG:    10  Abnormal exit by signal
  TM:   261  Test ran too long
  BI:    20  Build failed
  LA:     0  Unsupported Language
  SK:  1050  Skipped
Python test case          Result
--------------------------------
001 basic               : TM
002 filter_F            : TM
003 filter_N            : TM
004 filter_FN           : TM
005 srcline             : TM
006 filter_time         : TM
007 filter_depth        : TM
008 file_var            : TM
009 libcall_single      : TM
010 libcall_none        : TM
011 libcall_nested      : TM
012 os_exit             : TM


runtime test stats
====================
total    12  Tests executed (success: 0.00%)
  OK:     0  Test succeeded
  OK:     0  Test succeeded (with some fixup)
  NG:     0  Different test result
  NZ:     0  Non-zero return value
  SG:     0  Abnormal exit by signal
  TM:    12  Test ran too long
  BI:     0  Build failed
  LA:     0  Unsupported Language
  SK:     0  Skipped

This seems to be a different result from what we previously saw in #1921 in the release v0.16 PR.

If you need any additional testing, please leave a comment and i will help you conduct the testing.

@namhyung
Copy link
Owner Author

I see many timeouts, not sure what happened.

@gichoel
Copy link
Contributor

gichoel commented Jun 30, 2025

There were no RISC-V board test results for the v0.17 release, so i git checkout the tags/v0.17 branch and ran the test on the RISC-V board as shown below and got the following results

$ git checkout tags/v0.17
$ make test -j$(nproc)
Running 105 test cases
======================
[001] unittest_framework            : PASS

......

[065] mcount_list_event             : PASS
WARN: failed to open 'cycles' perf event: Invalid argument
[066] mcount_pmu_event              : SKIP

......

[105] utils_strv                    : PASS

unit test stats
====================
104 ran successfully
  0 failed
  1 skipped
  0 signal caught
  0 unknown result
$ cat test_result.txt | grep -E "NG|NZ|SG|TM|BI|LA|SK"

022 filter_kernel       : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
045 report_avg_self     : OK OK OK OK OK OK NG OK OK OK  OK OK OK OK OK OK OK OK OK OK
052 nested_func         : NG OK OK OK OK NG OK OK OK OK  SK SK SK SK SK SK SK SK SK SK
058 arg_int             : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
059 arg_str             : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
060 arg_fmt             : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
062 arg_char            : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
063 retval              : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
065 arg_order           : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
075 lib_arg             : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
079 replay_kernel_D     : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
080 replay_kernel_D2    : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
081 kernel_depth        : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
082 arg_many            : NG NG NG NG NG SK SK SK SK SK  NG NG NG NG NG SK SK SK SK SK
083 arg_float           : OK OK OK OK OK SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
084 arg_mixed           : NG NG NG NG NG SK SK SK SK SK  NG NG NG NG NG SK SK SK SK SK
085 arg_reg             : NG NG NG NG NG SK SK SK SK SK  NG NG NG NG NG SK SK SK SK SK
086 arg_stack           : NG NG NG NG NG SK SK SK SK SK  NG NG NG NG NG SK SK SK SK SK
087 arg_variadic        : NG NG NG NG NG SK SK SK SK SK  NG NG NG NG NG SK SK SK SK SK
103 dump_kernel         : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
104 graph_kernel        : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
109 replay_time_A       : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
111 kernel_tid          : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
124 exception           : OK NG NG NG NG OK OK OK OK OK  OK OK OK OK OK NG NG NG NG NG
126 arg_regex           : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
127 arg_module          : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
128 arg_module2         : OK OK OK OK OK SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
132 trigger_kernel      : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
133 long_string         : OK OK OK OK OK SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
136 dynamic             : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
137 kernel_tid_update   : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
138 kernel_dynamic      : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
139 kernel_dynamic2     : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
140 dynamic_xray        : BI BI BI BI BI BI BI BI BI BI  BI BI BI BI BI BI BI BI BI BI
143 recv_kernel         : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
146 arg_std_string      : NG NG NG NG NG SK SK SK SK SK  NG NG NG NG NG SK SK SK SK SK
147 event_sdt           : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
148 event_kernel        : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
149 event_kernel2       : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
150 recv_event          : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
151 recv_runcmd         : OK OK OK OK OK NG OK OK OK OK  OK OK OK OK OK OK OK OK OK OK
165 graph_sched         : OK OK OK OK OK OK OK OK OK OK  OK NG OK OK OK OK OK OK OK OK
166 dump_sched          : OK OK OK OK OK OK OK OK OK OK  OK OK NG OK OK OK OK OK OK OK
167 recv_sched          : OK OK OK OK OK OK OK OK OK OK  OK NG OK OK OK OK OK NG OK OK
168 lib_nested          : NG NG NG NG NG NG NG NG NG NG  OK OK OK OK OK OK OK OK OK OK
173 trigger_args        : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
174 replay_filter_kernel: SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
185 exception2          : NG NG NG NG NG OK OK OK OK OK  NG NG NG NG NG NG NG NG NG NG
186 exception3          : NG NG NG NG NG OK OK OK OK OK  NG NG NG NG NG NG NG NG NG NG
192 lib_name            : NG NG NG NG NG NG NG NG NG NG  OK OK OK OK OK OK OK OK OK OK
193 read_pmu_cycle      : NG NG NG NG NG NG NG NG NG NG  NG NG NG NG NG NG NG NG NG NG
194 read_pmu_cache      : NG NG NG NG NG NG NG NG NG NG  NG NG NG NG NG NG NG NG NG NG
195 read_pmu_branch     : NG NG NG NG NG NG NG NG NG NG  NG NG NG NG NG NG NG NG NG NG
196 chrome_taskname     : OK OK NG NG OK OK OK OK OK OK  OK OK OK OK OK OK NG OK OK OK
198 lib_arg_float       : OK OK OK OK OK SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
201 arg_dwarf1          : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
202 arg_dwarf2          : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
203 arg_dwarf3          : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
204 arg_dwarf4          : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
205 arg_auto4           : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
206 arg_enum2           : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
213 arg_symbol          : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
214 signal_trigger      : OK OK OK OK OK NZ NZ NZ NZ NZ  OK OK OK OK OK NZ NZ NZ NZ NZ
223 dynamic_full        : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
224 dynamic_lib         : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
225 dynamic_size        : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
227 read_pmu_cycle2     : NG NG NG NG NG NG NG NG NG NG  NG NG NG NG NG NG NG NG NG NG
228 read_pmu_cycle3     : NG NG NG NG NG NG NG NG NG NG  NG NG NG NG NG NG NG NG NG NG
231 arg_bound           : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
232 dynamic_unpatch     : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
233 dynamic_unpatch2    : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
234 script_luajit       : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
248 dynamic_dlopen      : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
251 exception4          : NG OK OK OK OK SG SG SG SG SG  OK OK OK OK OK SG SG SG SG SG
254 arg_dwarf5          : NG NG NG NG NG SK SK SK SK SK  NG NG NG NG NG SK SK SK SK SK
255 arg_dwarf6          : OK OK OK OK OK SK SK SK SK SK  NG NG NG NG NG SK SK SK SK SK
256 arg_dwarf7          : OK OK OK OK OK SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
257 arg_struct_replay   : NG OK OK OK OK SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
258 arg_struct_dump     : NG OK OK OK OK SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
259 arg_struct_script   : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
260 arg_struct_luajit   : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
263 patchable_dynamic   : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
264 patchable_dynamic2  : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
265 patchable_dynamic3  : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
266 patchable_dynamic4  : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
267 patchable_dynamic5  : SK SK SK SK SK SK SK SK SK SK  SK SK SK SK SK SK SK SK SK SK
269 arg_no_args_replay  : OK OK OK OK OK SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
270 arg_no_args_dump    : OK OK OK OK OK SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK
287 arg_enum3           : NG NG NG NG NG SK SK SK SK SK  NG NG NG NG NG SK SK SK SK SK
289 exception5          : OK OK OK OK OK NG NG NG NG NG  OK OK OK OK OK NG NG NG NG NG
291 arg_dlopen          : NG NG NG NG NG SK SK SK SK SK  OK OK OK OK OK SK SK SK SK SK

runtime test stats
====================
total  5820  Tests executed (success: 75.29%)
  OK:  4308  Test succeeded
  OK:    74  Test succeeded (with some fixup)
  NG:   368  Different test result
  NZ:    10  Non-zero return value
  SG:    10  Abnormal exit by signal
  TM:     0  Test ran too long
  BI:    20  Build failed
  LA:     0  Unsupported Language
  SK:  1030  Skipped
Python test case          Result
--------------------------------
001 basic               : OK

......

012 os_exit             : OK

runtime test stats
====================
total    12  Tests executed (success: 100.00%)
  OK:    12  Test succeeded
  OK:     0  Test succeeded (with some fixup)
  NG:     0  Different test result
  NZ:     0  Non-zero return value
  SG:     0  Abnormal exit by signal
  TM:     0  Test ran too long
  BI:     0  Build failed
  LA:     0  Unsupported Language
  SK:     0  Skipped

This result suggests that the problem is caused by one of the commits we added after the v0.17 branch, do you agree?

@namhyung
Copy link
Owner Author

namhyung commented Jul 2, 2025

Yep, it looks like a regression. It'd be nice if you can run bisect like this.

  1. prepare a script to test the result (should exit with 0 if it's ok).
$ cat check-timeout.sh
#!/bin/sh
./configure -p > /dev/null
make -j $(nproc) pytest | grep 'TM: *0'

$ chmod +x check-timeout.sh
  1. run the bisect between v0.17 and the current HEAD.
$ git bisect start HEAD v0.17
$ git bisect run ./check-timeout.sh

@namhyung namhyung changed the title Preparing New Release v0.18 New Release v0.18 Jul 6, 2025
@namhyung namhyung merged commit 8ccd4f6 into master Jul 6, 2025
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants