Flaky ign_publisher_system_test

[agalbachicar]

See https://github.com/ToyotaResearchInstitute/delphyne/actions/runs/331805044 and https://github.com/ToyotaResearchInstitute/delphyne/actions/runs/331806801

[scpeters]

I've noticed this as well. Here is some example console output:

-- run_test.py: invoking following command in '/home/scpeters/clone/dsim-repos-index/maliput_ws/src/delphyne':
 - /home/scpeters/clone/dsim-repos-index/maliput_ws/build/delphyne/test/regression/cpp/UNIT_ign_publisher_system_test --gtest_output=xml:/home/scpeters/clone/dsim-repos-index/maliput_ws/build/delphyne/test_results/delphyne/UNIT_ign_publisher_system_test.gtest.xml
Running main() from /opt/ros/dashing/src/gtest_vendor/src/gtest_main.cc
[==========] Running 2 tests from 1 test case.
[----------] Global test environment set-up.
[----------] 2 tests from IgnPublisherSystemTest
[ RUN      ] IgnPublisherSystemTest.ImmediatePublishTest
[       OK ] IgnPublisherSystemTest.ImmediatePublishTest (6 ms)
[ RUN      ] IgnPublisherSystemTest.LowFrequencyPublishTest
-- run_test.py: return code -11
-- run_test.py: generate result file '/home/scpeters/clone/dsim-repos-index/maliput_ws/build/delphyne/test_results/delphyne/UNIT_ign_publisher_system_test.gtest.xml' with failed test
-- run_test.py: verify result file '/home/scpeters/clone/dsim-repos-index/maliput_ws/build/delphyne/test_results/delphyne/UNIT_ign_publisher_system_test.gtest.xml'

    Start 44: check_UNIT_ign_publisher_system_test
2/2 Test #44: check_UNIT_ign_publisher_system_test ...   Passed    0.02 sec

-- run_test.py: invoking following command in '/home/scpeters/clone/dsim-repos-index/maliput_ws/src/delphyne':
 - /home/scpeters/clone/dsim-repos-index/maliput_ws/build/delphyne/test/regression/cpp/UNIT_ign_publisher_system_test --gtest_output=xml:/home/scpeters/clone/dsim-repos-index/maliput_ws/build/delphyne/test_results/delphyne/UNIT_ign_publisher_system_test.gtest.xml
Running main() from /opt/ros/dashing/src/gtest_vendor/src/gtest_main.cc
[==========] Running 2 tests from 1 test case.
[----------] Global test environment set-up.
[----------] 2 tests from IgnPublisherSystemTest
[ RUN      ] IgnPublisherSystemTest.ImmediatePublishTest
[       OK ] IgnPublisherSystemTest.ImmediatePublishTest (6 ms)
[ RUN      ] IgnPublisherSystemTest.LowFrequencyPublishTest
[       OK ] IgnPublisherSystemTest.LowFrequencyPublishTest (1 ms)
[----------] 2 tests from IgnPublisherSystemTest (7 ms total)

[----------] Global test environment tear-down
-- run_test.py: return code -11
-- run_test.py: verify result file '/home/scpeters/clone/dsim-repos-index/maliput_ws/build/delphyne/test_results/delphyne/UNIT_ign_publisher_system_test.gtest.xml'
Invalid XML in result file '/home/scpeters/clone/dsim-repos-index/maliput_ws/build/delphyne/test_results/delphyne/UNIT_ign_publisher_system_test.gtest.xml' (even after trying to tidy it): no element found: line 1, column 0

    Start 44: check_UNIT_ign_publisher_system_test
2/2 Test #44: check_UNIT_ign_publisher_system_test ...   Passed    0.02 sec

    -- run_test.py: invoking following command in '/__w/delphyne/delphyne/maliput_ws/src/delphyne':
     - /__w/delphyne/delphyne/maliput_ws/build/delphyne/test/regression/cpp/UNIT_ign_publisher_system_test --gtest_output=xml:/__w/delphyne/delphyne/maliput_ws/build/delphyne/test_results/delphyne/UNIT_ign_publisher_system_test.gtest.xml
    Running main() from /opt/ros/dashing/src/gtest_vendor/src/gtest_main.cc
    [==========] Running 2 tests from 1 test case.
    [----------] Global test environment set-up.
    [----------] 2 tests from IgnPublisherSystemTest
    [ RUN      ] IgnPublisherSystemTest.ImmediatePublishTest
    [       OK ] IgnPublisherSystemTest.ImmediatePublishTest (5 ms)
    [ RUN      ] IgnPublisherSystemTest.LowFrequencyPublishTest
    [       OK ] IgnPublisherSystemTest.LowFrequencyPublishTest (0 ms)
    [----------] 2 tests from IgnPublisherSystemTest (5 ms total)
    
    [----------] Global test environment tear-down
    [==========] 2 tests from 1 test case ran. (5 ms total)
    [  PASSED  ] 2 tests.
    UNIT_ign_publisher_system_test: ../nptl/pthread_mutex_lock.c:433: __pthread_mutex_lock_full: Assertion `INTERNAL_SYSCALL_ERRNO (e, __err) != ESRCH || !robust' failed.
    -- run_test.py: return code -6
    -- run_test.py: inject classname prefix into gtest result file '/__w/delphyne/delphyne/maliput_ws/build/delphyne/test_results/delphyne/UNIT_ign_publisher_system_test.gtest.xml'
    -- run_test.py: verify result file '/__w/delphyne/delphyne/maliput_ws/build/delphyne/test_results/delphyne/UNIT_ign_publisher_system_test.gtest.xml'

[scpeters]

Here's a new one:

-- run_test.py: invoking following command in '/__w/delphyne/delphyne/maliput_ws/src/delphyne':
 - /__w/delphyne/delphyne/maliput_ws/build/delphyne/test/regression/cpp/UNIT_ign_publisher_system_test --gtest_output=xml:/__w/delphyne/delphyne/maliput_ws/build/delphyne/test_results/delphyne/UNIT_ign_publisher_system_test.gtest.xml
Running main() from /opt/ros/dashing/src/gtest_vendor/src/gtest_main.cc
[==========] Running 2 tests from 1 test case.
[----------] Global test environment set-up.
[----------] 2 tests from IgnPublisherSystemTest
[ RUN      ] IgnPublisherSystemTest.ImmediatePublishTest
[       OK ] IgnPublisherSystemTest.ImmediatePublishTest (4 ms)
[ RUN      ] IgnPublisherSystemTest.LowFrequencyPublishTest
[       OK ] IgnPublisherSystemTest.LowFrequencyPublishTest (1 ms)
[----------] 2 tests from IgnPublisherSystemTest (5 ms total)

[----------] Global test environment tear-down
[==========] 2 tests from 1 test case ran. (5 ms total)
[  PASSED  ] 2 tests.
Exception occurred in a local callback on topic [/visualizer/scene_update] with message [header {
  stamp {
    sec: 123
    nsec: 456000000
  }
}
models {
  name: "none"
  id: 0
  pose {
    position {
      x: 0
      y: 5
      z: 10
    }
    orientation {
      x: 5
      y: 10
      z: 15
      w: 0
    }
  }
  link {
    name: "00"
    pose {
      position {
        x: 0
        y: 5
        z: 10
      }
      orientation {
        x: 5
        y: 10
        z: 15
        w: 0
      }
    }
    name: "21"
    pose {
      position {
        x: 2
        y: 6
        z: 12
      }
      orientation {
        x: 7
        y: 11
        z: 17
        w: 1
      }
    }
  }
}
]

[agalbachicar]

As shown in #735 extending the time step of the simulator did not help to with CI. Will disable the test.

[agalbachicar]

Both tests were disabled until we have a solution for them.

[francocipollone]

I've tried it locally and it fails similarly as #751
Ergo, after #759 is merged these tests could be enabled again.

[francocipollone]

Solved. Further discussion if any should continue in #760