aprepro termios compile issue

[aperijake]

Hello, I am trying to compile trilinos via spack and am having issues with linking and the termios library: ld: aprepro: hidden symbol tcgetattr isn't defined. This is specifically for when I am compiling with the GPU enabled. My spack command for adding trilinos is:
spack add trilinos@master ~amesos ~amesos2 ~anasazi ~aztec ~belos ~epetra ~epetraext ~ifpack ~ifpack2 ~ml ~muelu ~sacado ~shared +cuda +cuda_rdc +exodus +gtest +hdf5 +stk +zoltan +zoltan2 cxxstd=17 cuda_arch=75

I don't have a problem when I create a CPU build using:
spack add trilinos@master ~amesos ~amesos2 ~anasazi ~aztec ~belos ~cuda ~epetra ~epetraext ~ifpack ~ifpack2 ~ml ~muelu ~sacado ~shared +exodus +gtest +hdf5 +mpi +stk +zoltan +zoltan2 cxxstd=17

I have tried [email protected] and @develop with the same results. Also, I have verified the termios headers and libraries are on my system. This issue just started showing up in the last month or so. I had been successfully building trilinos with the same scripts before that time. I have been trying to configure spack to help it find the termios files with no luck. It does seem to find them okay for other packages, e.g., it builds cmake successfully, which needs ncurses.

Any ideas? Thanks.

Error message:

#21 1809.8 ==> Installing trilinos-develop-wwuzc4afsmgajjraeddjakgotpnu7b5o [57/57]
#21 1809.8 ==> No binary for trilinos-develop-wwuzc4afsmgajjraeddjakgotpnu7b5o found: installing from source
#21 1882.9 ==> No patches needed for trilinos
#21 1912.6 ==> trilinos: Executing phase: 'cmake'
#21 1912.6 ==> trilinos: Executing phase: 'build'
#21 2026.6 ==> Error: ProcessError: Command exited with status 2:
#21 2026.6     '/usr/bin/make' '-j16'
#21 2027.5 
#21 2027.5 13 errors found in build log:
#21 2027.5      5904                instantiation of class "fmt::v11::basic_string_view<Ch
#21 2027.5              ar> [with Char=char]" at line 1930
#21 2027.5      5905                instantiation of "auto fmt::v11::basic_format_args<Con
#21 2027.5              text>::get_id(fmt::v11::basic_string_view<Char>) const->int [with 
#21 2027.5              Context=fmt::v11::context, Char=char]" at line 1970
#21 2027.5      5906    
#21 2027.5      5907    Remark: The warnings can be suppressed with "-diag-suppress <warni
#21 2027.5              ng-number>"
#21 2027.5      5908    
#21 2027.5      5909    ld: ../../libraries/aprepro_lib/libaprepro_lib.a(apr_getline.cc.o)
#21 2027.5              : in function `(anonymous namespace)::gl_char_init()':
#21 2027.5   >> 5910    tmpxft_000882bd_00000000-6_apr_getline.cudafe1.cpp:(.text+0x82): u
#21 2027.5              ndefined reference to `tcgetattr'
#21 2027.5      5911    ld: ../../libraries/aprepro_lib/libaprepro_lib.a(apr_getline.cc.o)
#21 2027.5              : in function `(anonymous namespace)::gl_error(char const*)':
#21 2027.5   >> 5912    tmpxft_000882bd_00000000-6_apr_getline.cudafe1.cpp:(.text+0x27b): 
#21 2027.5              undefined reference to `tcsetattr'
#21 2027.5      5913    ld: ../../libraries/aprepro_lib/libaprepro_lib.a(apr_getline.cc.o)
#21 2027.5              : in function `(anonymous namespace)::gl_init()':
#21 2027.5   >> 5914    tmpxft_000882bd_00000000-6_apr_getline.cudafe1.cpp:(.text+0x2f1): 
#21 2027.5              undefined reference to `tcgetattr'
#21 2027.5   >> 5915    ld: tmpxft_000882bd_00000000-6_apr_getline.cudafe1.cpp:(.text+0x37
#21 2027.5              2): undefined reference to `tcsetattr'
#21 2027.5      5916    ld: ../../libraries/aprepro_lib/libaprepro_lib.a(apr_getline.cc.o)
#21 2027.5              : in function `(anonymous namespace)::gl_cleanup()':
#21 2027.5   >> 5917    tmpxft_000882bd_00000000-6_apr_getline.cudafe1.cpp:(.text+0x440): 
#21 2027.5              undefined reference to `tcsetattr'
#21 2027.5      5918    ld: ../../libraries/aprepro_lib/libaprepro_lib.a(apr_getline.cc.o)
#21 2027.5              : in function `SEAMS::getline_int(char const*)':
#21 2027.5   >> 5919    tmpxft_000882bd_00000000-6_apr_getline.cudafe1.cpp:(.text+0x254a):
#21 2027.5               undefined reference to `tcsetattr'
#21 2027.5   >> 5920    ld: tmpxft_000882bd_00000000-6_apr_getline.cudafe1.cpp:(.text+0x29
#21 2027.5              91): undefined reference to `tcsetattr'
#21 2027.5   >> 5921    ld: tmpxft_000882bd_00000000-6_apr_getline.cudafe1.cpp:(.text+0x2a
#21 2027.5              9e): undefined reference to `tcsetattr'
#21 2027.5      5922    ld: ../../libraries/aprepro_lib/libaprepro_lib.a(apr_getline.cc.o)
#21 2027.5              :tmpxft_000882bd_00000000-6_apr_getline.cudafe1.cpp:(.text+0x107):
#21 2027.5               more undefined references to `tcsetattr' follow
#21 2027.5      5923    ld: aprepro: hidden symbol `tcgetattr' isn't defined
#21 2027.5   >> 5924    ld: final link failed: bad value
#21 2027.5   >> 5925    collect2: error: ld returned 1 exit status
#21 2027.5      5926    /home/aperi-mech_docker/spack/opt/spack/linux-ubuntu22.04-x86_64_v
#21 2027.5              4/gcc-11.4.0/openmpi-5.0.6-uldm5d4puyzm3rkms2cdzapevnkcaaa7/bin/mp
#21 2027.5              ic++  -pedantic -Wall -Wno-long-long -Wwrite-strings -Wshadow -Wov
#21 2027.5              erloaded-virtual   -Wno-inline -Wno-deprecated-declarations  -O3 -
#21 2027.5              DNDEBUG CMakeFiles/aprepro.dir/aprepro.C.o -o aprepro  -Wl,-rpath,
#21 2027.5              /home/aperi-mech_docker/spack/opt/spack/linux-ubuntu22.04-x86_64_v
#21 2027.5              4/gcc-11.4.0/netcdf-c-4.9.2-7v6qt57va7iqs6qyuf3oc7sz6oik5lwo/lib:/
#21 2027.5              home/aperi-mech_docker/spack/opt/spack/linux-ubuntu22.04-x86_64_v4
#21 2027.5              /gcc-11.4.0/hdf5-1.14.5-rjv653jp3x2psuyi53bf64sbpmmvi35y/lib:/home
#21 2027.5              /aperi-mech_docker/spack/opt/spack/linux-ubuntu22.04-x86_64_v4/gcc
#21 2027.5              -11.4.0/parallel-netcdf-1.14.0-dps64ricr4aw3q5hjwjtri25y47l27x3/li
#21 2027.5              b:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
#21 2027.5              ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
#21 2027.5              ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
#21 2027.5              ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
#21 2027.5              ::::: ../../libraries/aprepro_lib/libaprepro_lib.a ../../libraries
#21 2027.5              /exodus/libexodus.a /home/aperi-mech_docker/spack/opt/spack/linux-
#21 2027.5              ubuntu22.04-x86_64_v4/gcc-11.4.0/netcdf-c-4.9.2-7v6qt57va7iqs6qyuf
#21 2027.5              3oc7sz6oik5lwo/lib/libnetcdf.so /home/aperi-mech_docker/spack/opt/
#21 2027.5              spack/linux-ubuntu22.04-x86_64_v4/gcc-11.4.0/hdf5-1.14.5-rjv653jp3
#21 2027.5              x2psuyi53bf64sbpmmvi35y/lib/libhdf5.so /home/aperi-mech_docker/spa
#21 2027.5              ck/opt/spack/linux-ubuntu22.04-x86_64_v4/gcc-11.4.0/parallel-netcd
#21 2027.5              f-1.14.0-dps64ricr4aw3q5hjwjtri25y47l27x3/lib/libpnetcdf.so
#21 2027.5   >> 5927    make[2]: *** [packages/seacas/applications/aprepro/CMakeFiles/apre
#21 2027.5              pro.dir/build.make:108: packages/seacas/applications/aprepro/aprep
#21 2027.5              ro] Error 1
#21 2027.5      5928    make[2]: Leaving directory '/tmp/aperi-mech_docker/spack-stage/spa
#21 2027.5              ck-stage-trilinos-develop-wwuzc4afsmgajjraeddjakgotpnu7b5o/spack-b
#21 2027.5              uild-wwuzc4a'
#21 2027.5   >> 5929    make[1]: *** [CMakeFiles/Makefile2:7029: packages/seacas/applicati
#21 2027.5              ons/aprepro/CMakeFiles/aprepro.dir/all] Error 2
#21 2027.5      5930    make[1]: *** Waiting for unfinished jobs....```

[aperijake]

I should add that I have tried several different systems (Ubuntu 22.04 Docker, Ubuntu 24.04 Docker, Ubuntu 22.04 bare metal, Windows WSL) with the same results.

[aperijake]

I have narrowed it down a bit. It works for me if I use cuda 12.6.3 and fails with cuda 12.8.0. 12.8 came out a couple of months ago so it lines up with when I started seeing the issue. If I don't specify a version, spack will install 12.8 now.

[gsjaardema]

Not sure what happened to caust the undefined symbols in 12.8.0 The tcgetattr/tcsetattr functions are libc standard functions, so should be defined and the fact that the include of the termios header file didnt' fail also seems to indicate that the functions are still legal and defined...

I looked on the NVidia site, but don't see anything related to this...

[jfinney10]

I've gotten a similar issue here: trilinos/Trilinos#14225

I'm building with cuda 12.9.

[aperijake]

@jfinney10 thanks for the note. I don't have any updates. I have just been living on cuda 12.6 for now.

[gsjaardema]

I will add an option to explicitly disable the use of termios even if the include file is found. It will disable the command-line editing, but the code will compile and still function.

Also looking into whether anyone else has seen this issue with newer cuda releases...

[gsjaardema]

should be fixed by #706

[aperijake]

Thanks!