Skip to content

Recent new failures #9050

Closed
Closed

Description

@seisman

Recent changes have break many tests:

+ ctest --output-on-failure --force-new-ctest-process -j4 --timeout 480 --rerun-failed
Test project /home/runner/work/gmt/gmt/build
      Start    3: doc/scripts/GMT_-B_geo_2.sh
      Start  659: test/grdview/gouraud.sh
      Start  862: test/pscoast/pscoast_JE2.sh
      Start 1012: test/pstext/var_offset.sh
 1/11 Test  #862: test/pscoast/pscoast_JE2.sh ..........***Failed    0.48 sec
Set GMT_SESSION_NAME = 80584
pscoast (gmtlib_lonpath): Could not reallocate memory [68719476736.00 Gb, 9223372036854775809 items of 8 bytes]
pscoast (gmtlib_lonpath): Could not reallocate memory [68719476736.00 Gb, 9223372036854775809 items of 8 bytes]
ERROR: Caught signal number 11 (Segmentation fault) at
/home/runner/work/gmt/gmt/build/src/libgmt.so.6(gmtlib_lonpath+0x541)[0x7fd9a8342308]
[0x0]
Stack backtrace:
/home/runner/work/gmt/gmt/build/src/libgmt.so.6(gmt_sig_handler_unix+0x183)[0x7fd9a8275245]
/lib/x86_64-linux-gnu/libc.so.6(+0x45330)[0x7fd9a7c45330]
/home/runner/work/gmt/gmt/build/src/libgmt.so.6(gmtlib_lonpath+0x541)[0x7fd9a8342308]
/home/runner/work/gmt/gmt/build/src/libgmt.so.6(gmtlib_map_path+0xdc)[0x7fd9a8341dbc]
/home/runner/work/gmt/gmt/build/src/libgmt.so.6(gmt_assemble_shore+0x126b)[0x7fd9a81b0e68]
/home/runner/work/gmt/gmt/build/src/libgmt.so.6(GMT_pscoast+0x337a)[0x7fd9a8642214]
/home/runner/work/gmt/gmt/build/src/libgmt.so.6(GMT_Call_Module+0x843)[0x7fd9a80fb6b6]
/home/runner/work/gmt/gmt/build/src/gmt(+0x2f48)[0x5620e0c53f48]
/lib/x86_64-linux-gnu/libc.so.6(+0x2a1ca)[0x7fd9a7c2a1ca]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x8b)[0x7fd9a7c2a28b]
/home/runner/work/gmt/gmt/build/src/gmt(+0x26f5)[0x5620e0c536f5]
ERROR: gmtest:90
memtrack errors: 0
exit status: 1
      Start 1034: test/psxy/bezier_demo_quadratic.sh
 2/11 Test #1012: test/pstext/var_offset.sh ............***Failed    1.24 sec
Set GMT_SESSION_NAME = 80587
/usr/bin/gm compare: image difference exceeds limit (0.00324132 > 0.003).
test/pstext/var_offset.ps: RMS Error = 0.0032 [FAIL]
memtrack errors: 0
exit status: 1
      Start 1168: test/psxyz/QR.sh
 3/11 Test    #3: doc/scripts/GMT_-B_geo_2.sh ..........***Failed    1.32 sec
Set GMT_SESSION_NAME = 80582
/usr/bin/gm compare: image difference exceeds limit (0.0123303 > 0.003).
doc/scripts/GMT_-B_geo_2.ps: RMS Error = 0.0123 [FAIL]
memtrack errors: 0
exit status: 1
      Start 1182: test/psxyz/matharc.sh
 4/11 Test #1168: test/psxyz/QR.sh .....................***Failed    1.29 sec
Set GMT_SESSION_NAME = 80788
/usr/bin/gm compare: image difference exceeds limit (0.164592 > 0.003).
test/psxyz/QR.ps: RMS Error = 0.1646 [FAIL]
memtrack errors: 0
exit status: 1
      Start 1193: test/psxyz/varwedges.sh
 5/11 Test #1182: test/psxyz/matharc.sh ................***Failed    1.32 sec
Set GMT_SESSION_NAME = 80806
/usr/bin/gm compare: image difference exceeds limit (0.136122 > 0.003).
test/psxyz/matharc.ps: RMS Error = 0.1361 [FAIL]
memtrack errors: 0
exit status: 1
      Start 1195: test/psxyz/vector.sh
 6/11 Test #1034: test/psxy/bezier_demo_quadratic.sh ...***Failed    2.24 sec
Set GMT_SESSION_NAME = 80696
/usr/bin/gm compare: image difference exceeds limit (0.0320449 > 0.003).
test/psxy/bezier_demo_quadratic.ps: RMS Error = 0.0320 [FAIL]
memtrack errors: 0
exit status: 1
      Start 1197: test/psxyz/wedges.sh
 7/11 Test #1193: test/psxyz/varwedges.sh ..............***Failed    1.32 sec
Set GMT_SESSION_NAME = 80934
/usr/bin/gm compare: image difference exceeds limit (0.112287 > 0.003).
test/psxyz/varwedges.ps: RMS Error = 0.1123 [FAIL]
memtrack errors: 0
exit status: 1
      Start 1206: test/segy/segy_03.sh
 8/11 Test #1197: test/psxyz/wedges.sh .................***Failed    1.33 sec
Set GMT_SESSION_NAME = 80980
/usr/bin/gm compare: image difference exceeds limit (0.112287 > 0.003).
test/psxyz/wedges.ps: RMS Error = 0.1123 [FAIL]
memtrack errors: 0
exit status: 1
 9/11 Test #1195: test/psxyz/vector.sh .................***Failed    1.42 sec
Set GMT_SESSION_NAME = 80961
/usr/bin/gm compare: image difference exceeds limit (0.159847 > 0.003).
test/psxyz/vector.ps: RMS Error = 0.1598 [FAIL]
memtrack errors: 0
exit status: 1
10/11 Test #1206: test/segy/segy_03.sh .................***Failed    0.97 sec
Set GMT_SESSION_NAME = 81100
/usr/bin/gm compare: image difference exceeds limit (0.28359 > 0.003).
test/segy/segy_03.ps: RMS Error = 0.2836 [FAIL]
memtrack errors: 0
exit status: 1
11/11 Test  #659: test/grdview/gouraud.sh ..............***Failed    5.00 sec
Set GMT_SESSION_NAME = 80583
/usr/bin/gm compare: image difference exceeds limit (0.266764 > 0.003).
test/grdview/gouraud.ps: RMS Error = 0.2668 [FAIL]
memtrack errors: 0
exit status: 1
0% tests passed, 11 tests failed out of 11
Total Test time (real) =   5.03 sec
The following tests FAILED:
	  3 - doc/scripts/GMT_-B_geo_2.sh (Failed)
	659 - test/grdview/gouraud.sh (Failed)
	862 - test/pscoast/pscoast_JE2.sh (Failed)
	1012 - test/pstext/var_offset.sh (Failed)
	1034 - test/psxy/bezier_demo_quadratic.sh (Failed)
	1168 - test/psxyz/QR.sh (Failed)
	1182 - test/psxyz/matharc.sh (Failed)
	1193 - test/psxyz/varwedges.sh (Failed)
	1195 - test/psxyz/vector.sh (Failed)
	1197 - test/psxyz/wedges.sh (Failed)
	1206 - test/segy/segy_03.sh (Failed)
Errors while running CTest
Error: Process completed with exit code 8.

Activity

  1. joa-quim commented on May 29, 2026

    @joa-quim
    Member

    I believe those are caused by the fix of -Xc-Yc in #9045 and now need the ps baseline to be updated

  2. joa-quim commented on May 29, 2026

    @joa-quim
    Member

    It's impossible to work with DVC. I updated more than half of those failures. But the tests keep failing.

  3. seisman commented on May 29, 2026

    @seisman
    MemberAuthor

    I've updated the psxyz tests in #9052 and now they pass.

  4. seisman commented on Jun 1, 2026

    @seisman
    MemberAuthor

    Lastest failures:

    	  3 - doc/scripts/GMT_-B_geo_2.sh (Failed)
    	213 - doc/examples/ex08/ex08.sh (Failed)
    	542 - test/grdimage/globalgrid.sh (Failed)
    	549 - test/grdimage/grdread.sh (Failed)
    	863 - test/pscoast/pscoast_JE2.sh (Failed)
    	1013 - test/pstext/var_offset.sh (Failed)
    	1035 - test/psxy/bezier_demo_quadratic.sh (Failed)
    	1207 - test/segy/segy_03.sh (Failed)
    
  5. seisman commented on Jun 1, 2026

    @seisman
    MemberAuthor

    ex08 is badly broken, likely due to changes in 7b70493. Please don't merge changes unless all existing tests pass, otherwise we will likely introduce more serieos bugs when fixing small issues.

  6. joa-quim commented on Jun 1, 2026

    @joa-quim
    Member

    Problem is that the CIs fail so many times for unknown reasons that they became quite unreliable. And I run the test locally many times. The ex08 passes for me when I use GMT_DATA_SERVER static

  7. seisman commented on Jun 1, 2026

    @seisman
    MemberAuthor

    Hmmm, not sure why I was getting an empty 3-D frame without any histograms, but now ex08 is looks correct with only slightly minor changes. I'll update the baseline image in PR #9055.

    Problem is that the CIs fail so many times for unknown reasons that they have become quite unreliable.

    Yes, it's a long term issue that the CIs, especially Linux, fails to fetch data from the GMT data server. It may be an issue of the CI, or an issue with the curl call in GMT.

  8. joa-quim commented on Jun 1, 2026

    @joa-quim
    Member

    But there must be something fishy on this. ETOPO5 grids are not updated, so why static and non static versions are different?

  9. seisman commented on Jun 1, 2026

    @seisman
    MemberAuthor

    Here is the diff image. It seems the minor difference is caused by the two frame borders at the bottom of the 3D plot.
    Image

  10. joa-quim commented on Jun 1, 2026

    @joa-quim
    Member

    #8972 is on hold exactly due to problems similar to this (or were during the investigation phase).

  11. joa-quim commented on Jun 2, 2026

    @joa-quim
    Member

    Hard to tackle this one because I still cannot reproduce it locally. For me the test keeps passing.

  12. seisman commented on Jun 4, 2026

    @seisman
    MemberAuthor

    The test/pstext/var_offset.sh test fails. I think the baseline image is correct, and the image generated by the master branch is wrong:

    Baseline image Incorrect image from master
    Image Image
  13. joa-quim commented on Jun 4, 2026

    @joa-quim
    Member

    No, current generated image is correct. What happens is that the connecting line is clipped by the text bbox after addressing #3927
    I still intend to revisit this to see if the clipping can be made optional.

  14. seisman commented on Jun 4, 2026

    @seisman
    MemberAuthor

    Now the only failure on Linux/macOS is:

    1/2 Test #863: test/pscoast/pscoast_JE2.sh ......***Failed    0.33 sec
    Set GMT_SESSION_NAME = 80433
    pscoast (gmtlib_lonpath): Could not reallocate memory [68719476736.00 Gb, 9223372036854775809 items of 8 bytes]
    pscoast (gmtlib_lonpath): Could not reallocate memory [68719476736.00 Gb, 9223372036854775809 items of 8 bytes]
    ERROR: Caught signal number 11 (Segmentation fault) at
    /home/runner/work/gmt/gmt/build/src/libgmt.so.6(gmtlib_lonpath+0x541)[0x7f048d342877]
    [0x0]
    Stack backtrace:
    /home/runner/work/gmt/gmt/build/src/libgmt.so.6(gmt_sig_handler_unix+0x183)[0x7f048d[2752](https://github.com/GenericMappingTools/gmt/actions/runs/26950826923/job/79515338539#step:17:2753)a2]
    /lib/x86_64-linux-gnu/libc.so.6(+0x45330)[0x7f048cc45330]
    /home/runner/work/gmt/gmt/build/src/libgmt.so.6(gmtlib_lonpath+0x541)[0x7f048d342877]
    /home/runner/work/gmt/gmt/build/src/libgmt.so.6(gmtlib_map_path+0xdc)[0x7f048d34232b]
    /home/runner/work/gmt/gmt/build/src/libgmt.so.6(gmt_assemble_shore+0x126b)[0x7f048d1b0e68]
    /home/runner/work/gmt/gmt/build/src/libgmt.so.6(GMT_pscoast+0x337a)[0x7f048d643106]
    /home/runner/work/gmt/gmt/build/src/libgmt.so.6(GMT_Call_Module+0x843)[0x7f048d0fb6b6]
    /home/runner/work/gmt/gmt/build/src/gmt(+0x2f48)[0x562eb762bf48]
    /lib/x86_64-linux-gnu/libc.so.6(+0x2a1ca)[0x7f048cc2a1ca]
    /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x8b)[0x7f048cc2a28b]
    /home/runner/work/gmt/gmt/build/src/gmt(+0x26f5)[0x562eb762b6f5]
    ERROR: gmtest:90
    memtrack errors: 0
    exit status: 1
    
  15. joa-quim commented on Jun 8, 2026

    @joa-quim
    Member

    Another tests craziness. For me

    C:\v\build>ctest -R pscoast_JE2
    Test project C:/v/build
        Start 864: test/pscoast/pscoast_JE2.sh
    1/1 Test #864: test/pscoast/pscoast_JE2.sh ......   Passed    3.93 sec
    
    100% tests passed, 0 tests failed out of 1
    
    Total Test time (real) =   4.30 sec
    
  16. joa-quim commented on Jul 15, 2026

    @joa-quim
    Member

    On Linux all tests pass now, but that Etopo5 3D barplot stubbornly shows up time to time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions