Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sacado w/ ROCm 5.4.3: pce/Sacado_UQ_PCE_Imp.hpp:661:3: error: reference to __host__ function 'TestForException_incrThrowNumber' in __host__ __device__ function #12365

Open
eugeneswalker opened this issue Oct 4, 2023 · 1 comment
Open

Sacado w/ ROCm 5.4.3: pce/Sacado_UQ_PCE_Imp.hpp:661:3: error: reference to __host__ function 'TestForException_incrThrowNumber' in __host__ __device__ function #12365

eugeneswalker opened this issue Oct 4, 2023 · 1 comment
Labels
pkg: Sacado type: bug The primary issue is a bug in Trilinos code or tests

Comments

@eugeneswalker
Copy link

Bug Report

@etphipp @nchaimov

Description

Building trilinos@master +testing +rocm amdgpu_target=gfx90a +amesos +amesos2 +anasazi +aztec +belos +boost +epetra +epetraext +ifpack +ifpack2 +intrepid +intrepid2 +isorropia +kokkos +ml +minitensor +muelu +nox +piro +phalanx +rol +rythmos +sacado +stk +shards +shylu +stokhos +stratimikos +teko +tempus +tpetra +trilinoscouplings +zoltan +zoltan2 +superlu-dist gotype=long_long fails using:

  • ROCm 5.4.3, installed via apt, registered as external with Spack
  • GCC 11.4.0
  • Ubuntu 20.04, X86_64
$> spack dev-build -j48 trilinos@master +testing +rocm amdgpu_target=gfx90a +amesos +amesos2 +anasazi +aztec +belos +boost +epetra +epetraext +ifpack +ifpack2 +intrepid +intrepid2 +isorropia +kokkos +ml +minitensor +muelu +nox +piro +phalanx +rol +rythmos +sacado +stk +shards +shylu +stokhos +stratimikos +teko +tempus +tpetra +trilinoscouplings +zoltan +zoltan2 +superlu-dist gotype=long_long ^superlu-dist
...
In file included from /e4s-develop/collab/trilinos/ctest-rocm/Trilinos/packages/trilinoscouplings/examples/fenl/main_pce.cpp:3:
In file included from /e4s-develop/collab/trilinos/ctest-rocm/Trilinos/packages/stokhos/src/sacado/kokkos/pce/Stokhos_Sacado_Kokkos_UQ_PCE.hpp:61:
In file included from /e4s-develop/collab/trilinos/ctest-rocm/Trilinos/packages/stokhos/src/sacado/kokkos/pce/Kokkos_View_UQ_PCE.hpp:63:
In file included from /e4s-develop/collab/trilinos/ctest-rocm/Trilinos/packages/stokhos/src/sacado/kokkos/pce/KokkosExp_View_UQ_PCE_Contiguous.hpp:185:
In file included from /e4s-develop/collab/trilinos/ctest-rocm/Trilinos/packages/stokhos/src/sacado/kokkos/pce/Sacado_UQ_PCE.hpp:1313:
/e4s-develop/collab/trilinos/ctest-rocm/Trilinos/packages/stokhos/src/sacado/kokkos/pce/Sacado_UQ_PCE_Imp.hpp:661:3: error: reference to __host__ function 'TestForException_incrThrowNumber' in __host__ __device__ function
  TEUCHOS_TEST_FOR_EXCEPTION(
...

Steps to Reproduce

Reproducible here using Docker container image:

  • ecpe4s/ubuntu20.04-runner-amd64-gcc-11.4-rocm5.4.3-mpi-base:2023.08.20

Spack environment: spack.yaml.txt

Concretization - esiwctn trilinos@master%[email protected]~adelus~adios2+amesos+amesos2+anasazi+aztec~basker+belos+boost~chaco~complex~cuda~cuda_rdc~debug~dtk+epetra+epetraext~epetraextbtf~epetraextexperimental~epetraextgraphreorderings~exodus+explicit_template_instantiation~float+fortran~gtest~hdf5~hypre+ifpack+ifpack2+intrepid+intrepid2~ipo+isorropia+kokkos~mesquite+minitensor+ml+mpi+muelu~mumps+nox~openmp~panzer+phalanx+piro~python+rocm~rocm_rdc+rol+rythmos+sacado~scorec+shards+shared+shylu+stk+stokhos+stratimikos~strumpack~suite-sparse~superlu+superlu-dist+teko+tempus+testing+thyra+tpetra+trilinoscouplings~wrapper~x11+zoltan+zoltan2 amdgpu_target=gfx90a build_system=cmake build_type=Release cxxstd=17 generator=make gotype=long_long arch=linux-ubuntu20.04-x86_64 [+] ia5ufsp ^[email protected]%[email protected]~atomic~chrono~clanglibcpp~container~context~contract~coroutine~date_time~debug+exception~fiber~filesystem+graph~graph_parallel~icu~iostreams~json~locale~log+math+mpi+multithreaded~nowide~numpy~pic~program_options~python~random~regex~serialization+shared~signals~singlethreaded+stacktrace~system~taggedlayout~test~thread~timer~type_erasure~versionedlayout~wave build_system=generic cxxstd=17 patches=a440f96 visibility=hidden arch=linux-ubuntu20.04-x86_64 [+] j56nveb ^[email protected]%[email protected]~doc+ncurses+ownlibs build_system=generic build_type=Release arch=linux-ubuntu20.04-x86_64 [+] krhswgy ^[email protected]%[email protected]~gssapi~ldap~libidn2~librtmp~libssh~libssh2+nghttp2 build_system=autotools libs=shared,static tls=openssl arch=linux-ubuntu20.04-x86_64 [+] y72nyuk ^[email protected]%[email protected] build_system=autotools arch=linux-ubuntu20.04-x86_64 [+] m2nqw34 ^[email protected]%[email protected]~docs+shared build_system=generic certs=mozilla arch=linux-ubuntu20.04-x86_64 [+] thgudgh ^ca-certificates-mozilla@2023-05-30%[email protected] build_system=generic arch=linux-ubuntu20.04-x86_64 [+] 4ahtcrh ^[email protected]%[email protected]~symlinks+termlib abi=none build_system=autotools arch=linux-ubuntu20.04-x86_64 [+] axbtmvn ^[email protected]%[email protected]~guile build_system=autotools arch=linux-ubuntu20.04-x86_64 [e] m4alb4r ^[email protected]%[email protected]~cuda+rocm build_system=cmake build_type=Release generator=make patches=5068750,c2ee21c,ca523f1,ddd86f0 arch=linux-ubuntu20.04-x86_64 [e] gwdu4x7 ^[email protected]%[email protected]+image+shared build_system=cmake build_type=Release generator=make patches=71e6851 arch=linux-ubuntu20.04-x86_64 [+] ytgmnmi ^[email protected]%[email protected]~cairo~cuda~gl~libudev+libxml2~netloc~nvml~oneapi-level-zero~opencl+pci~rocm build_system=autotools libs=shared,static arch=linux-ubuntu20.04-x86_64 [+] wjzjxgg ^[email protected]%[email protected] build_system=autotools arch=linux-ubuntu20.04-x86_64 [+] 3cmrrml ^[email protected]%[email protected] build_system=autotools arch=linux-ubuntu20.04-x86_64 [+] dije4dh ^[email protected]%[email protected]+sigsegv build_system=autotools patches=9dc5fbd,bfdffa7 arch=linux-ubuntu20.04-x86_64 [+] uxiki2z ^[email protected]%[email protected] build_system=autotools arch=linux-ubuntu20.04-x86_64 [+] pv4s6pa ^[email protected]%[email protected] build_system=autotools arch=linux-ubuntu20.04-x86_64 [+] w3n2rgb ^[email protected]%[email protected]+pic~python+shared build_system=autotools arch=linux-ubuntu20.04-x86_64 [+] bb6pvt7 ^[email protected]%[email protected] build_system=autotools libs=shared,static arch=linux-ubuntu20.04-x86_64 [+] 7gqmxvf ^[email protected]%[email protected]~pic build_system=autotools libs=shared,static arch=linux-ubuntu20.04-x86_64 [+] hjpgnti ^[email protected]%[email protected] build_system=autotools arch=linux-ubuntu20.04-x86_64 [e] 6gz5p46 ^[email protected]%[email protected]~link_llvm_dylib~llvm_dylib~openmp+rocm-device-libs build_system=cmake build_type=Release generator=ninja patches=a08bbe1 arch=linux-ubuntu20.04-x86_64 [+] l6dookb ^[email protected]%[email protected]~gdb~int64~ipo~real64+shared build_system=cmake build_type=Release generator=make patches=4991da9,93a7903,b1225da arch=linux-ubuntu20.04-x86_64 [e] 4vf2w2d ^[email protected]%[email protected]~argobots~cuda+fortran~hwloc+hydra+libxml2+pci~rocm+romio~slurm~vci~verbs~wrapperrpath build_system=autotools datatype-engine=auto device=ch4 netmod=ofi pmi=pmi arch=linux-ubuntu20.04-x86_64 [+] 2n67kk5 ^[email protected]%[email protected]~bignuma~consistent_fpcsr+fortran~ilp64+locking+pic+shared build_system=makefile symbol_suffix=none threads=none arch=linux-ubuntu20.04-x86_64 [+] ymeouv6 ^[email protected]%[email protected]+cpanm+opcode+open+shared+threads build_system=generic patches=714e4d1 arch=linux-ubuntu20.04-x86_64 [+] z5d3lru ^[email protected]%[email protected]+cxx~docs+stl build_system=autotools patches=26090f4,b231fcc arch=linux-ubuntu20.04-x86_64 [+] mxcjdbv ^[email protected]%[email protected]~debug~pic+shared build_system=generic arch=linux-ubuntu20.04-x86_64 [+] zafnh7n ^[email protected]%[email protected] build_system=autotools arch=linux-ubuntu20.04-x86_64 [+] adx2gsg ^[email protected]%[email protected] build_system=autotools arch=linux-ubuntu20.04-x86_64 [+] bhdepb5 ^[email protected]%[email protected] build_system=autotools patches=bbf97f1 arch=linux-ubuntu20.04-x86_64 [+] wcatis4 ^[email protected]%[email protected]~gdb~int64~ipo+shared build_system=cmake build_type=Release generator=make patches=4f89253,50ed208,704b84f arch=linux-ubuntu20.04-x86_64 [+] ur6zd25 ^superlu-dist@develop%[email protected]~cuda~int64~ipo~openmp~rocm+shared build_system=cmake build_type=Release generator=make arch=linux-ubuntu20.04-x86_64 [+] hpmj5kc ^[email protected]%[email protected]+compat+opt build_system=autotools patches=299b958,ae9077a,b692621 arch=linux-ubuntu20.04-x86_64 


$> docker run -it ecpe4s/ubuntu20.04-runner-amd64-gcc-11.4-rocm5.4.3-mpi-base:2023.08.20
root@a6fe029d2d1d:/# git clone https://github.com/eugeneswalker/spack
root@a6fe029d2d1d:/# git -C spack checkout trilinos-ctest

root@a6fe029d2d1d:/# . spack/share/spack/setup-env.sh
root@a6fe029d2d1d:/# spack env activate -d .
root@a6fe029d2d1d:/# spack concretize -f | tee concretize.log
root@a6fe029d2d1d:/# spack install --only dependencies --include-build-deps
... OK

root@a6fe029d2d1d:/# git clone --depth=1 https://github.com/trilinos/Trilinos.git
root@a6fe029d2d1d:/# git -C Trilinos checkout 5aaae1ada6fe1ce777e671a0ff84fdc4f0779406

root@a6fe029d2d1d:/# cd Trilinos
root@a6fe029d2d1d:/# nohup bash -c "time spack dev-build -j48 trilinos@master +rocm amdgpu_target=gfx90a +amesos +amesos2 +anasazi +aztec +belos +boost +epetra +epetraext +ifpack +ifpack2 +intrepid +intrepid2 +isorropia +kokkos +ml +minitensor +muelu +nox +piro +phalanx +rol +rythmos +sacado +stk +shards +shylu +stokhos +stratimikos +teko +tempus +tpetra +trilinoscouplings +zoltan +zoltan2 +superlu-dist gotype=long_long ^superlu-dist" &

root@a6fe029d2d1d:/# tail -f nohup.out
...
In file included from /e4s-develop/collab/trilinos/ctest-rocm/Trilinos/packages/trilinoscouplings/examples/fenl/main_pce.cpp:3:
In file included from /e4s-develop/collab/trilinos/ctest-rocm/Trilinos/packages/stokhos/src/sacado/kokkos/pce/Stokhos_Sacado_Kokkos_UQ_PCE.hpp:61:
In file included from /e4s-develop/collab/trilinos/ctest-rocm/Trilinos/packages/stokhos/src/sacado/kokkos/pce/Kokkos_View_UQ_PCE.hpp:63:
In file included from /e4s-develop/collab/trilinos/ctest-rocm/Trilinos/packages/stokhos/src/sacado/kokkos/pce/KokkosExp_View_UQ_PCE_Contiguous.hpp:185:
In file included from /e4s-develop/collab/trilinos/ctest-rocm/Trilinos/packages/stokhos/src/sacado/kokkos/pce/Sacado_UQ_PCE.hpp:1313:
/e4s-develop/collab/trilinos/ctest-rocm/Trilinos/packages/stokhos/src/sacado/kokkos/pce/Sacado_UQ_PCE_Imp.hpp:661:3: error: reference to __host__ function 'TestForException_incrThrowNumber' in __host__ __device__ function
  TEUCHOS_TEST_FOR_EXCEPTION(
...



Here are the CMake args used:


-DTrilinos_VERBOSE_CONFIGURE:BOOL=OFF
-DBUILD_SHARED_LIBS:BOOL=ON
-DTrilinos_ENABLE_ALL_OPTIONAL_PACKAGES:BOOL=OFF
-DTrilinos_ENABLE_ALL_PACKAGES:BOOL=OFF
-DTrilinos_ENABLE_CXX11:BOOL=ON
-DTrilinos_ENABLE_DEBUG:BOOL=OFF
-DTrilinos_ENABLE_EXAMPLES:BOOL=OFF
-DTrilinos_ENABLE_SECONDARY_TESTED_CODE:BOOL=ON
-DTrilinos_ENABLE_TESTS:BOOL=OFF
-DTrilinos_ENABLE_Fortran:BOOL=ON
-DTrilinos_ENABLE_OpenMP:BOOL=OFF
-DTrilinos_ENABLE_EXPLICIT_INSTANTIATION:BOOL=ON
-DTrilinos_ENABLE_TESTS:BOOL=ON
-DBUILD_TESTING:BOOL=ON
-DROL_ENABLE_TESTS=OFF
-DROL_ENABLE_EXAMPLES=OFF
-DCMAKE_CXX_STANDARD:STRING=17
-DTrilinos_ENABLE_Adelus:BOOL=OFF
-DTrilinos_ENABLE_Amesos:BOOL=ON
-DTrilinos_ENABLE_Amesos2:BOOL=ON
-DTrilinos_ENABLE_Anasazi:BOOL=ON
-DTrilinos_ENABLE_AztecOO:BOOL=ON
-DTrilinos_ENABLE_Belos:BOOL=ON
-DTrilinos_ENABLE_Epetra:BOOL=ON
-DTrilinos_ENABLE_EpetraExt:BOOL=ON
-DTrilinos_ENABLE_FEI:BOOL=OFF
-DTrilinos_ENABLE_Gtest:BOOL=OFF
-DTrilinos_ENABLE_Ifpack:BOOL=ON
-DTrilinos_ENABLE_Ifpack2:BOOL=ON
-DTrilinos_ENABLE_Intrepid:BOOL=ON
-DTrilinos_ENABLE_Intrepid2:BOOL=ON
-DTrilinos_ENABLE_Isorropia:BOOL=ON
-DTrilinos_ENABLE_Kokkos:BOOL=ON
-DTrilinos_ENABLE_MiniTensor:BOOL=ON
-DTrilinos_ENABLE_Mesquite:BOOL=OFF
-DTrilinos_ENABLE_ML:BOOL=ON
-DTrilinos_ENABLE_MueLu:BOOL=ON
-DTrilinos_ENABLE_NOX:BOOL=ON
-DTrilinos_ENABLE_Pamgen:BOOL=OFF
-DTrilinos_ENABLE_Panzer:BOOL=OFF
-DTrilinos_ENABLE_Pike:BOOL=OFF
-DTrilinos_ENABLE_Piro:BOOL=ON
-DTrilinos_ENABLE_Phalanx:BOOL=ON
-DTrilinos_ENABLE_PyTrilinos:BOOL=OFF
-DTrilinos_ENABLE_ROL:BOOL=ON
-DTrilinos_ENABLE_Rythmos:BOOL=ON
-DTrilinos_ENABLE_Sacado:BOOL=ON
-DTrilinos_ENABLE_SCOREC:BOOL=OFF
-DTrilinos_ENABLE_Shards:BOOL=ON
-DTrilinos_ENABLE_ShyLU:BOOL=ON
-DTrilinos_ENABLE_STK:BOOL=ON
-DTrilinos_ENABLE_Stokhos:BOOL=ON
-DTrilinos_ENABLE_Stratimikos:BOOL=ON
-DTrilinos_ENABLE_Teko:BOOL=ON
-DTrilinos_ENABLE_Tempus:BOOL=ON
-DTrilinos_ENABLE_Thyra:BOOL=ON
-DTrilinos_ENABLE_Tpetra:BOOL=ON
-DTrilinos_ENABLE_TrilinosCouplings:BOOL=ON
-DTrilinos_ENABLE_Triutils:BOOL=ON
-DTrilinos_ENABLE_Zoltan:BOOL=ON
-DTrilinos_ENABLE_Zoltan2:BOOL=ON
-DEpetraExt_BUILD_BTF:BOOL=OFF
-DEpetraExt_BUILD_EXPERIMENTAL:BOOL=OFF
-DEpetraExt_BUILD_GRAPH_REORDERINGS:BOOL=OFF
-DAmesos2_ENABLE_Basker:BOOL=OFF
-DAmesos2_ENABLE_LAPACK:BOOL=ON
-DAmesos2_ENABLE_MUMPS:BOOL=OFF
-DTrilinos_ENABLE_SEACASExodus:BOOL=OFF
-DTrilinos_ENABLE_SEACASIoss:BOOL=OFF
-DTrilinos_ENABLE_SEACASChaco:BOOL=OFF
-DTrilinos_ENABLE_SEACASNemslice:BOOL=OFF
-DTrilinos_ENABLE_ThyraEpetraAdapters:BOOL=ON
-DTrilinos_ENABLE_ThyraEpetraExtAdapters:BOOL=ON
-DTrilinos_ENABLE_ThyraTpetraAdapters:BOOL=ON
-DTPL_ENABLE_ADIOS2:BOOL=OFF
-DTPL_ENABLE_Boost:BOOL=ON
-DBoost_INCLUDE_DIRS:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/boost-1.83.0-ia5ufsp2ticukrv7yoz3mqn6qycnb2ib/include
-DBoost_ROOT:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/boost-1.83.0-ia5ufsp2ticukrv7yoz3mqn6qycnb2ib
-DBoost_LIBRARY_NAMES:STRING=boost_graph;boost_graph_parallel;boost_graph-mt;boost_graph_parallel-mt;boost_math_c99;boost_math_c99f;boost_math_c99l;boost_math_tr1;boost_math_tr1f;boost_math_tr1l;boost_math_c99-mt;boost_math_c99f-mt;boost_math_c99l-mt;boost_math_tr1-mt;boost_math_tr1f-mt;boost_math_tr1l-mt;boost_mpi;boost_mpi-mt;boost_stacktrace_noop;boost_stacktrace_backtrace;boost_stacktrace_basic;boost_stacktrace_addr2line;boost_stacktrace_noop-mt;boost_stacktrace_backtrace-mt;boost_stacktrace_basic-mt;boost_stacktrace_addr2line-mt
-DBoost_LIBRARY_DIRS:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/boost-1.83.0-ia5ufsp2ticukrv7yoz3mqn6qycnb2ib/lib
-DTPL_ENABLE_CUDA:BOOL=OFF
-DTPL_ENABLE_HDF5:BOOL=OFF
-DTPL_ENABLE_HYPRE:BOOL=OFF
-DTPL_ENABLE_MUMPS:BOOL=OFF
-DTPL_ENABLE_UMFPACK:BOOL=OFF
-DTPL_ENABLE_SuperLU:BOOL=OFF
-DTPL_ENABLE_SuperLUDist:BOOL=ON
-DSuperLUDist_INCLUDE_DIRS:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/superlu-dist-develop-ur6zd254mbob3wx4zkzwxs7tbs6xkl3v/include
-DSuperLUDist_ROOT:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/superlu-dist-develop-ur6zd254mbob3wx4zkzwxs7tbs6xkl3v
-DSuperLUDist_LIBRARY_NAMES:STRING=superlu_dist
-DSuperLUDist_LIBRARY_DIRS:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/superlu-dist-develop-ur6zd254mbob3wx4zkzwxs7tbs6xkl3v/lib
-DTPL_ENABLE_X11:BOOL=OFF
-DTPL_ENABLE_STRUMPACK:BOOL=OFF
-DTPL_ENABLE_BLAS:BOOL=ON
-DBLAS_INCLUDE_DIRS:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/openblas-0.3.24-2n67kk5drwbjhfknf27e5w4jhja2bruc/include
-DBLAS_ROOT:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/openblas-0.3.24-2n67kk5drwbjhfknf27e5w4jhja2bruc
-DBLAS_LIBRARY_NAMES:STRING=openblas
-DBLAS_LIBRARY_DIRS:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/openblas-0.3.24-2n67kk5drwbjhfknf27e5w4jhja2bruc/lib
-DTPL_ENABLE_CGNS:BOOL=OFF
-DTPL_ENABLE_LAPACK:BOOL=ON
-DLAPACK_INCLUDE_DIRS:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/openblas-0.3.24-2n67kk5drwbjhfknf27e5w4jhja2bruc/include
-DLAPACK_ROOT:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/openblas-0.3.24-2n67kk5drwbjhfknf27e5w4jhja2bruc
-DLAPACK_LIBRARY_NAMES:STRING=openblas
-DLAPACK_LIBRARY_DIRS:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/openblas-0.3.24-2n67kk5drwbjhfknf27e5w4jhja2bruc/lib
-DTPL_ENABLE_Matio:BOOL=OFF
-DTPL_ENABLE_METIS:BOOL=ON
-DMETIS_INCLUDE_DIRS:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/metis-5.1.0-l6dookbvurnrgqs45cypcqgd57uhhvxj/include
-DMETIS_ROOT:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/metis-5.1.0-l6dookbvurnrgqs45cypcqgd57uhhvxj
-DMETIS_LIBRARY_NAMES:STRING=metis
-DMETIS_LIBRARY_DIRS:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/metis-5.1.0-l6dookbvurnrgqs45cypcqgd57uhhvxj/lib
-DTPL_ENABLE_Netcdf:BOOL=OFF
-DTPL_ENABLE_SCALAPACK:BOOL=OFF
-DTPL_ENABLE_Zlib:BOOL=ON
-DZlib_INCLUDE_DIRS:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/zlib-ng-2.1.3-hpmj5kcs7owpzqpo75uqqi5qwrlkegsh/include
-DZlib_ROOT:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/zlib-ng-2.1.3-hpmj5kcs7owpzqpo75uqqi5qwrlkegsh
-DZlib_LIBRARY_NAMES:STRING=z
-DZlib_LIBRARY_DIRS:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/zlib-ng-2.1.3-hpmj5kcs7owpzqpo75uqqi5qwrlkegsh/lib
-DTPL_ENABLE_Pnetcdf:BOOL=OFF
-DTPL_ENABLE_HWLOC:BOOL=ON
-DHWLOC_INCLUDE_DIRS:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/hwloc-2.9.1-ytgmnmihayivrlbeewsb4jgfvqrkn5ji/include
-DHWLOC_ROOT:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/hwloc-2.9.1-ytgmnmihayivrlbeewsb4jgfvqrkn5ji
-DHWLOC_LIBRARY_NAMES:STRING=hwloc
-DHWLOC_LIBRARY_DIRS:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/hwloc-2.9.1-ytgmnmihayivrlbeewsb4jgfvqrkn5ji/lib
-DTPL_ENABLE_MPI:BOOL=ON
-DCMAKE_C_COMPILER:STRING=/usr/local/mpich/install/mpich/bin/mpicc
-DCMAKE_CXX_COMPILER:STRING=/usr/local/mpich/install/mpich/bin/mpic++
-DCMAKE_Fortran_COMPILER:STRING=/usr/local/mpich/install/mpich/bin/mpif90
-DMPI_BASE_DIR:STRING=/usr/local/mpich/install/mpich
-DTPL_ENABLE_ParMETIS:BOOL=ON
-DParMETIS_LIBRARY_DIRS:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/parmetis-4.0.3-wcatis4e6h54ijgpajgfrnhj4bqqykf3/lib;/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/metis-5.1.0-l6dookbvurnrgqs45cypcqgd57uhhvxj/lib
-DParMETIS_LIBRARY_NAMES:STRING=parmetis;metis
-DTPL_ParMETIS_INCLUDE_DIRS:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/parmetis-4.0.3-wcatis4e6h54ijgpajgfrnhj4bqqykf3/include;/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/metis-5.1.0-l6dookbvurnrgqs45cypcqgd57uhhvxj/include
-DHAVE_SUPERLUDIST_LUSTRUCTINIT_2ARG:BOOL=ON
-DTPL_ENABLE_Cholmod:BOOL=OFF
-DTeuchos_ENABLE_COMPLEX:BOOL=OFF
-DTeuchos_ENABLE_FLOAT:BOOL=OFF
-DTpetra_INST_OPENMP:BOOL=OFF
-DTpetra_INST_DOUBLE:BOOL=ON
-DTpetra_INST_COMPLEX_DOUBLE:BOOL=OFF
-DTpetra_INST_COMPLEX_FLOAT:BOOL=OFF
-DTpetra_INST_FLOAT:BOOL=OFF
-DTpetra_INST_SERIAL:BOOL=ON
-DTpetra_INST_INT_INT:BOOL=OFF
-DTpetra_INST_INT_LONG:BOOL=OFF
-DTpetra_INST_INT_LONG_LONG:BOOL=ON
-DKokkos_ENABLE_CUDA:BOOL=OFF
-DKokkos_ENABLE_OPENMP:BOOL=OFF
-DKokkos_ENABLE_ROCM:BOOL=OFF
-DKokkos_ENABLE_HIP:BOOL=ON
-DKokkos_ENABLE_HIP_RELOCATABLE_DEVICE_CODE:BOOL=OFF
-DTpetra_INST_HIP:BOOL=ON
-DKokkos_ARCH_VEGA90A:BOOL=ON
-DCMAKE_INSTALL_NAME_DIR:STRING=/spack/opt/spack/linux-ubuntu20.04-x86_64/gcc-11.4.0/trilinos-master-gct5lle7d4yhafkbwg6mypxh46ki7dlh/lib


      		
    

      
  





        



            

              
            

        

      


      
    








      

    



      

  
            

    

      
    

    


      

          @eugeneswalker
eugeneswalker




          added
  the 

  type: bug

  The primary issue is a bug in Trilinos code or tests
 label


      Oct 4, 2023

    

  








      

  
      



  

  @etphipp





  


    

      

  

    

        
    
    

  


      
          
  
      
            Copy link

  

      
    

  


  

      

  
    Contributor


      

  


  

    

      

      
            etphipp
  

      

      

      commented


        Oct 5, 2023


      
    


  





      


        


  
    

      
          
Thanks for reporting.  The issue is this code is ifdef'd out for CUDA but not HIP.  I don't know how much of Stokhos compiles on HIP, so this could take a while to fix.

      		
    

  





        


            

            

              
            

        

      


      

            
  

    
  
    
    

  

  



    












      

  
            


    

    

      
    

    


      

          @eugeneswalker
eugeneswalker




        changed the title
Sacado: pce/Sacado_UQ_PCE_Imp.hpp:661:3: error: reference to __host__ function 'TestForException_incrThrowNumber' in __host__ __device__ function

Sacado w/ ROCm 5.4.3: pce/Sacado_UQ_PCE_Imp.hpp:661:3: error: reference to __host__ function 'TestForException_incrThrowNumber' in __host__ __device__ function


      Oct 7, 2023

    

  












  
  

    

      

  





  




  
  

              

  
    Sign up for free
    to join this conversation on GitHub.
    Already have an account?
    Sign in to comment


  



  






  
                  




    

  


      
  

    Assignees
  



        

    No one assigned







      


  


  

    Labels
  



    

      

    pkg: Sacado

  

    type: bug

  The primary issue is a bug in Trilinos code or tests








      

  

    

        

    Projects
  


        




    None yet




  



      


  

    
  

    Milestone
  


      No milestone





    
      
          


  

    
      

        
    

    Development
  




          
    
No branches or pull requests







    
  




      

    

  
      

  

    

      3 participants
    

    

        
          @cgcgcg 
        
          @etphipp 
        
          @eugeneswalker