Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Timeouts on alinux #20463

Closed
pshipton opened this issue Oct 31, 2024 · 11 comments
Closed

Timeouts on alinux #20463

pshipton opened this issue Oct 31, 2024 · 11 comments

Comments

@pshipton
Copy link
Member

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.openjdk_aarch64_linux_Nightly_testList_1/324/
java/util/stream/boottest/java.base/java/util/stream/DoubleNodeTest.java.DoubleNodeTest
java/util/stream/boottest/java.base/java/util/stream/FlagOpTest.java.FlagOpTest

Copy link

Issue Number: 20463
Status: Open
Recommended Components: comp:vm, comp:test, comp:gc
Recommended Assignees: jasonfengj9, pshipton, keithc-ca

@pshipton pshipton changed the title Timeouts on alinux, no diagnostics Timeouts, no diagnostics Oct 31, 2024
@pshipton pshipton changed the title Timeouts, no diagnostics Timeouts on alinux, no diagnostics Oct 31, 2024
@pshipton
Copy link
Member Author

pshipton commented Oct 31, 2024

https://openj9-jenkins.osuosl.org/job/Test_openjdk23_j9_sanity.openjdk_aarch64_linux_Nightly_testList_0/96
java/lang/Class/forName/ForNameNames.java.ForNameNames
java/lang/Class/forName/NonLinking/NonLinking.java.NonLinking

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk23_j9_sanity.openjdk_aarch64_linux_Nightly_testList_0/96/openjdk_test_output.tar.gz

ForNameNames

    name:          main
    id:            4147606
    Thread object: java/lang/Thread @ 0xe004f008
    ID:            2 (0x2)
    Priority:      -1
    Thread.State:  WAITING
    JVMTI state:   ALIVE WAITING WAITING_INDEFINITELY IN_OBJECT_WAIT
      waiting to be notified on: "Thread public flags mutex" with ID 0xffff98078f40 owner name: <unowned>
    Java stack frames:
     bp: 0x00000000006b7890  method: java.util.concurrent.ConcurrentHashMap$Node[] java/util/concurrent/ConcurrentHashMap.initTable()  source: ConcurrentHashMap.java:2309
      objects: 0xffeaf1c8 0xffeaf1c8
     bp: 0x00000000006b7988  method: Object java/util/concurrent/ConcurrentHashMap.putVal(Object, Object, boolean)  source: ConcurrentHashMap.java:1025
      objects: 0xe006b780 0xe006b768 0xffeaf1c8 0xe006b780 0xe006b768
     bp: 0x00000000006b79c8  method: void java/util/concurrent/ConcurrentHashMap.putAll(java.util.Map)  source: ConcurrentHashMap.java:1099
      objects: 0xffeaf1c8 0xffeaf208
     bp: 0x00000000006b79f8  method: void java/util/Properties.putAll(java.util.Map)  source: Properties.java:1357
      objects: 0xffeaf198
     bp: 0x00000000006b7a20  method: java.util.Properties com/sun/javatest/regtest/agent/ActionHelper.newProperties(java.util.Map)  source: ActionHelper.java:199
      objects: 0xffeaf198
     bp: 0x00000000006b7a40  method: java.util.Properties com/sun/javatest/regtest/agent/ActionHelper.access$200(java.util.Map)  source: ActionHelper.java:45
      objects: <no objects in this frame>
     bp: 0x00000000006b7b00  method: com.sun.javatest.regtest.agent.AStatus com/sun/javatest/regtest/agent/ActionHelper$SaveState.restore(String, com.sun.javatest.regtest.agent.AStatus)  source: ActionHelper.java:137
      objects: 0xffb9a3f8 0xe01caa78
     bp: 0x00000000006b7c10  method: com.sun.javatest.regtest.agent.AStatus com/sun/javatest/regtest/agent/CompileActionHelper.runCompile(String, java.util.Map, java.util.List, int, com.sun.javatest.regtest.agent.ActionHelper$OutputHandler)  source: CompileActionHelper.java:102
      objects: 0xe01ce0c8 0xffb9a390 0xffb9a3a8 0xffb9a3d0 0xffb90038 0xffb9a340 0xffb9a368 0xe01caa78 0xffb90000 0xffb9a3f8
     bp: 0x00000000006b7c60  method: void com/sun/javatest/regtest/agent/AgentServer.doCompile()  source: AgentServer.java:272
      objects: 0xe01ce0c8 0xffb9a3d0
     bp: 0x00000000006b7c90  method: void com/sun/javatest/regtest/agent/AgentServer.run()  source: AgentServer.java:239
      objects: 0xe01ce0c8
     bp: 0x00000000006b7cb8  method: void com/sun/javatest/regtest/agent/AgentServer.main(String[])  source: AgentServer.java:71
      objects: <no objects in this frame>

NonLinking

    name:          main
    id:            4147575
    Thread object: java/lang/Thread @ 0xe006a4d0
    ID:            2 (0x2)
    Priority:      -1
    Thread.State:  WAITING
    JVMTI state:   ALIVE WAITING WAITING_INDEFINITELY IN_OBJECT_WAIT
      waiting to be notified on: "Thread public flags mutex" with ID 0xffff9c078f40 owner name: <unowned>
    Java stack frames:
     bp: 0x00000000006bc5d0  method: boolean java/lang/String.isLatin1()  source: String.java:<data unavailable>
      objects: 0xff04d378 0xff04d378 0xff04d3a0
     bp: 0x00000000006bc658  method: void sun/nio/cs/StreamEncoder.write(String, int, int)  source: StreamEncoder.java:160
      objects: 0xe01f6588 0xff04d3a0
     bp: 0x00000000006bc690  method: void java/io/OutputStreamWriter.write(String, int, int)  source: OutputStreamWriter.java:239
      objects: <no objects in this frame>
     bp: 0x00000000006bc6d0  method: void java/io/PrintWriter.implWrite(String, int, int)  source: PrintWriter.java:621
      objects: 0xe0130a90
     bp: 0x00000000006bc728  method: void java/io/PrintWriter.write(String, int, int)  source: PrintWriter.java:613
      objects: 0xe013a120
     bp: 0x00000000006bc750  method: void java/io/PrintWriter.write(String)  source: PrintWriter.java:635
      objects: <no objects in this frame>
     bp: 0x00000000006bc778  method: java.io.PrintWriter java/io/PrintWriter.append(CharSequence)  source: PrintWriter.java:1313
      objects: 0xe0130a90
     bp: 0x00000000006bc7b0  method: java.io.PrintWriter java/io/PrintWriter.append(CharSequence, int, int)  source: PrintWriter.java:1353
      objects: <no objects in this frame>
     bp: 0x00000000006bc7e8  method: Appendable java/io/PrintWriter.append(CharSequence, int, int)  source: PrintWriter.java:64
      objects: <no objects in this frame>
     bp: 0x00000000006bc820  method: void java/util/Formatter$FixedString.print(java.util.Formatter, Object, java.util.Locale)  source: Formatter.java:3035
      objects: <no objects in this frame>
     bp: 0x00000000006bc890  method: java.util.Formatter java/util/Formatter.format(java.util.Locale, String, Object[])  source: Formatter.java:2790
      objects: 0xe013a138 0xe00d2348 0xff04d018 0xff04d360
     bp: 0x00000000006bc8c8  method: void java/io/PrintWriter.implFormat(String, Object[])  source: PrintWriter.java:1203
      objects: 0xe0130a90
     bp: 0x00000000006bc918  method: java.io.PrintWriter java/io/PrintWriter.format(String, Object[])  source: PrintWriter.java:1191
      objects: 0xe0130a90 0xe013a120
     bp: 0x00000000006bc948  method: java.io.PrintWriter java/io/PrintWriter.printf(String, Object[])  source: PrintWriter.java:1084
      objects: <no objects in this frame>
     bp: 0x00000000006bc970  method: void com/sun/javatest/regtest/agent/AgentServer.log(String)  source: AgentServer.java:375
      objects: 0xe012e308
     bp: 0x00000000006bc9a0  method: void com/sun/javatest/regtest/agent/AgentServer.run()  source: AgentServer.java:256
      objects: 0xe012e308
     bp: 0x00000000006bc9c8  method: void com/sun/javatest/regtest/agent/AgentServer.main(String[])  source: AgentServer.java:71
      objects: <no objects in this frame>

@pshipton
Copy link
Member Author

pshipton commented Nov 1, 2024

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.openjdk_aarch64_linux_Nightly_testList_1/338
jdk_foreign_0
java/foreign/TestByteBuffer.java

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk21_j9_sanity.openjdk_aarch64_linux_Nightly_testList_1/338/openjdk_test_output.tar.gz

20:05:47  Total tests run: 300, Passes: 300, Failures: 0, Skips: 0
20:05:47  ===============================================
20:05:47  
20:05:47  STDERR:
20:05:47  JVMDUMP034I User requested System dump using '/home/jenkins/workspace/Test_openjdk21_j9_sanity.openjdk_aarch64_linux_Nightly_testList_1/aqa-tests/TKG/output_17304143225733/jdk_foreign_0/work/scratch/1/core.20241101.000248.4030304.0001.dmp' through com.ibm.jvm.Dump.systemDumpToFile
20:05:47  JVMDUMP010I System dump written to /home/jenkins/workspace/Test_openjdk21_j9_sanity.openjdk_aarch64_linux_Nightly_testList_1/aqa-tests/TKG/output_17304143225733/jdk_foreign_0/work/scratch/1/core.20241101.000248.4030304.0001.dmp
20:05:47  STATUS:Passed.
    name:          MainThread
    id:            4030332
    Thread object: java/lang/Thread @ 0xe00d95f0
    ID:            23 (0x17)
    Priority:      -1
    Thread.State:  WAITING
    JVMTI state:   ALIVE WAITING WAITING_INDEFINITELY IN_OBJECT_WAIT
      waiting to be notified on: "Thread public flags mutex" with ID 0xf6a430186ab0 owner name: <unowned>
    Java stack frames:
     bp: 0x000000000022bbc0  method: Class java/lang/reflect/Method.getReturnType()  source: Method.java:<data unavailable>
      objects: 0xe027a6c0 0xe027a6c0 0xe027a6c0
     bp: 0x000000000022bc50  method: jdk.internal.reflect.MethodAccessorImpl jdk/internal/reflect/MethodHandleAccessorFactory.newMethodAccessor(reflect.Method, boolean)  source: MethodHandleAccessorFactory.java:80
      objects: 0xe027a6c0
     bp: 0x000000000022bc90  method: jdk.internal.reflect.MethodAccessor jdk/internal/reflect/ReflectionFactory.newMethodAccessor(reflect.Method, boolean)  source: ReflectionFactory.java:159
      objects: <no objects in this frame>
     bp: 0x000000000022bd30  method: jdk.internal.reflect.MethodAccessor java/lang/reflect/Method.acquireMethodAccessor()  source: Method.java:732
      objects: 0xffda88e8
     bp: 0x000000000022bdf0  method: Object java/lang/reflect/Method.invoke(Object, Object[])  source: Method.java:583
      objects: 0xffda88e8 0xffdcdf28 0xffda8940 0xe0040898
     bp: 0x000000000022be48  method: void TestByteBuffer.testScopedBuffer(java.util.function.Function, reflect.Method, Object[])  source: TestByteBuffer.java:397
      objects: <no objects in this frame>

@pshipton
Copy link
Member Author

pshipton commented Nov 1, 2024

@tajila can someone take a look pls.

@pshipton pshipton changed the title Timeouts on alinux, no diagnostics Timeouts on alinux Nov 1, 2024
@tajila
Copy link
Contributor

tajila commented Nov 1, 2024

@babsingh Please take a look

@babsingh
Copy link
Contributor

babsingh commented Nov 1, 2024

The two previous timeouts have occurred at different points, suggesting that it is not a hang.

#20463 (comment):

<1d3200> 	!j9method 0x000000000014CE48   jdk/internal/reflect/MethodHandleAccessorFactory.getDirectMethod(Ljava/lang/reflect/Method;Z)Ljava/lang/invoke/MethodHandle;
<1d3200> 	!j9method 0x000000000014CDE8   jdk/internal/reflect/MethodHandleAccessorFactory.newMethodAccessor(Ljava/lang/reflect/Method;Z)Ljdk/internal/reflect/MethodAccessorImpl;
<1d3200> 	!j9method 0x00000000000711B8   jdk/internal/reflect/ReflectionFactory.newMethodAccessor(Ljava/lang/reflect/Method;Z)Ljdk/internal/reflect/MethodAccessor;
<1d3200> 	!j9method 0x0000000000055858   java/lang/reflect/Method.acquireMethodAccessor()Ljdk/internal/reflect/MethodAccessor;
<1d3200> 	!j9method 0x0000000000055778   java/lang/reflect/Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;

#20463 (comment).

<ffffac2cf100> 	!j9method 0x0000FFFF10323FC8   java/nio/MappedMemoryUtils.force0(Ljava/io/FileDescriptor;JJ)V
<ffffac2cf100> 	!j9method 0x0000FFFF10323FC8   java/nio/MappedMemoryUtils.force0(Ljava/io/FileDescriptor;JJ)V
<ffffac2cf100> 	!j9method 0x0000FFFF10323F48   java/nio/MappedMemoryUtils.force(Ljava/io/FileDescriptor;JZJJ)V
<ffffac2cf100> 	!j9method 0x0000FFFFAC239908   java/nio/Buffer$2.force(Ljava/io/FileDescriptor;JZJJ)V
<ffffac2cf100> 	!j9method 0x0000FFFFAC233400   jdk/internal/misc/ScopedMemoryAccess.forceInternal(Ljdk/internal/foreign/MemorySessionImpl;Ljava/io/FileDescriptor;JZJJ)V
<ffffac2cf100> 	!j9method 0x0000FFFFAC2333E0   jdk/internal/misc/ScopedMemoryAccess.force(Ljdk/internal/foreign/MemorySessionImpl;Ljava/io/FileDescriptor;JZJJ)V
<ffffac2cf100> 	!j9method 0x0000FFFF10309680   jdk/internal/foreign/MappedMemorySegmentImpl.force()V
<ffffac2cf100> 	!j9method 0x0000FFFFAC49F010   TestByteBuffer.testMappedSegmentOffset()V

No timeouts are seen in a 100x grinder of TestByteBuffer: https://openj9-jenkins.osuosl.org/job/Grinder/3945. This reconfirms that TestByteBuffer doesn't hang.

The test suite needs longer to run on alinux, so the test suite's timeout should be increased. @llxia Can you help with increasing the timeout?

@pshipton
Copy link
Member Author

pshipton commented Nov 11, 2024

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.openjdk_aarch64_linux_OMR_testList_1/182
jdk_foreign_0
java/foreign/TestByteBuffer.java.TestByteBuffer
java/foreign/TestLayouts.java.TestLayouts

@llxia
Copy link
Contributor

llxia commented Nov 27, 2024

Currently, the default is -timeoutFactor:8. We can try to increase the timeout factor on alinux to 12.
https://github.com/adoptium/aqa-tests/blob/a2f96a0fc17d206c45eeade3fbea7395dcb13d36/openjdk/openjdk.mk#L120

@LongyuZhang could you take care of this one? Thanks

@llxia
Copy link
Contributor

llxia commented Dec 4, 2024

Close this issue as timeout factor is increased via adoptium/aqa-tests#5781

@llxia llxia closed this as completed Dec 4, 2024
Copy link

github-actions bot commented Dec 4, 2024

Issue Number: 20463
Status: Closed
Actual Components: comp:test, test failure
Actual Assignees: No one :(
PR Assignees: LongyuZhang

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants