cling::DynamicLibraryManager::loadLibrary(): libXrdMain.so.1: cannot open shared object file: No such file or directory Error in : failure loading library libNetx.so for TXNetSystem cling::DynamicLibraryManager::loadLibrary(): libXrdMain.so.1: cannot open shared object file: No such file or directory loading VERSION 3 JANA ERROR>>ERROR: F1 TDC chip "unlocked" flag set! JANA ERROR>>ERROR: F1 TDC chip "unlocked" flag set! JANA ERROR>>ERROR: F1 TDC chip "unlocked" flag set! JANA ERROR>>ERROR: F1 TDC chip "unlocked" flag set! JANA ERROR>>ERROR: F1 TDC chip "unlocked" flag set! JANA ERROR>>ERROR: F1 TDC chip "unlocked" flag set! JANA ERROR>>ERROR: F1 TDC chip "unlocked" flag set! =========================================================== There was a crash (kSigSegmentationViolation). This is the entire stack trace of all threads: =========================================================== Thread 16 (Thread 0x7fffe84de700 (LWP 206)): #0 0x00007fffee568b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007fffee568bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007fffee568c6b in sem_wait GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x00007fffed5564ce in Wait (this=) at /home/halld/xrootd/src/./XrdSys/XrdSysPthread.hh:419 #4 XrdPosixFile::DelayedDestroy (vpf=) at /home/halld/xrootd/src/XrdPosix/XrdPosixFile.cc:240 #5 0x00007fffeaa6c977 in XrdSysThread_Xeq (myargs=0x18e3a50) at /home/halld/xrootd/src/XrdSys/XrdSysPthread.cc:86 #6 0x00007fffee562ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007fffed867b0d in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7fffd8168700 (LWP 241)): #0 0x00007fffed8680e3 in epoll_wait () from /lib64/libc.so.6 #1 0x00007fffeaa67832 in XrdSys::IOEvents::PollE::Begin (this=0x3738f30, syncsem=, retcode=, eTxt=) at /home/halld/xrootd/src/./XrdSys/XrdSysIOEventsPollE.icc:212 #2 0x00007fffeaa6427d in XrdSys::IOEvents::BootStrap::Start (parg=0x7fffffff9e80) at /home/halld/xrootd/src/XrdSys/XrdSysIOEvents.cc:131 #3 0x00007fffeaa6c977 in XrdSysThread_Xeq (myargs=0x372bbc0) at /home/halld/xrootd/src/XrdSys/XrdSysPthread.cc:86 #4 0x00007fffee562ea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007fffed867b0d in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7fffd7967700 (LWP 242)): #0 0x00007fffee569e9d in nanosleep () from /lib64/libpthread.so.0 #1 0x00007fffeaa6d179 in XrdSysTimer::Wait (mills=) at /home/halld/xrootd/src/XrdSys/XrdSysTimer.cc:239 #2 0x00007fffead6d612 in XrdCl::TaskManager::RunTasks (this=0x37392b0) at /home/halld/xrootd/src/XrdCl/XrdClTaskManager.cc:245 #3 0x00007fffead6d789 in RunRunnerThread (arg=) at /home/halld/xrootd/src/XrdCl/XrdClTaskManager.cc:38 #4 0x00007fffee562ea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007fffed867b0d in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7fffd7166700 (LWP 243)): #0 0x00007fffee568b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007fffee568bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007fffee568c6b in sem_wait GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x00007fffeadddf02 in Wait (this=0x336ab80) at /home/halld/xrootd/src/./XrdSys/XrdSysPthread.hh:419 #4 Get (this=0x336abc8) at /home/halld/xrootd/src/./XrdCl/XrdClSyncQueue.hh:67 #5 XrdCl::JobManager::RunJobs (this=0x336abb0) at /home/halld/xrootd/src/XrdCl/XrdClJobManager.cc:147 #6 0x00007fffeadddfa9 in RunRunnerThread (arg=) at /home/halld/xrootd/src/XrdCl/XrdClJobManager.cc:34 #7 0x00007fffee562ea5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fffed867b0d in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7fffd6965700 (LWP 244)): #0 0x00007fffee568b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007fffee568bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007fffee568c6b in sem_wait GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x00007fffeadddf02 in Wait (this=0x336ab80) at /home/halld/xrootd/src/./XrdSys/XrdSysPthread.hh:419 #4 Get (this=0x336abc8) at /home/halld/xrootd/src/./XrdCl/XrdClSyncQueue.hh:67 #5 XrdCl::JobManager::RunJobs (this=0x336abb0) at /home/halld/xrootd/src/XrdCl/XrdClJobManager.cc:147 #6 0x00007fffeadddfa9 in RunRunnerThread (arg=) at /home/halld/xrootd/src/XrdCl/XrdClJobManager.cc:34 #7 0x00007fffee562ea5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fffed867b0d in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7fffd6164700 (LWP 245)): #0 0x00007fffee568b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007fffee568bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007fffee568c6b in sem_wait GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x00007fffeadddf02 in Wait (this=0x336ab80) at /home/halld/xrootd/src/./XrdSys/XrdSysPthread.hh:419 #4 Get (this=0x336abc8) at /home/halld/xrootd/src/./XrdCl/XrdClSyncQueue.hh:67 #5 XrdCl::JobManager::RunJobs (this=0x336abb0) at /home/halld/xrootd/src/XrdCl/XrdClJobManager.cc:147 #6 0x00007fffeadddfa9 in RunRunnerThread (arg=) at /home/halld/xrootd/src/XrdCl/XrdClJobManager.cc:34 #7 0x00007fffee562ea5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fffed867b0d in clone () from /lib64/libc.so.6 Thread 10 (Thread 0x7fffd54c4700 (LWP 246)): #0 0x00007fffee566de2 in pthread_cond_timedwait GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000000000104360c in __gthread_cond_timedwait (__abs_timeout=0x7fffd54bd1c0, __mutex=0x7fffcc0010a0, __cond=0x7fffcc0010c8) at /usr/include/c++/4.8.2/x86_64-redhat-linux/bits/gthr-default.h:871 #2 __wait_until_impl > > (__atime=..., __lock=, this=0x7fffcc0010c8) at /usr/include/c++/4.8.2/condition_variable:160 #3 wait_until > > (__atime=..., __lock=, this=0x7fffcc0010c8) at /usr/include/c++/4.8.2/condition_variable:100 #4 wait_for > (__rtime=..., __lock=, this=0x7fffcc0010c8) at /usr/include/c++/4.8.2/condition_variable:132 #5 JEventSource_EVIOpp::GetEvent (this=0x7fffcc000fc0, event=...) at libraries/DAQ/JEventSource_EVIOpp.cc:593 #6 0x0000000001275f37 in jana::JEventSource::GetEvent (this=0x7fffcc000fc0, event=...) at src/JANA/JEventSource.cc:54 #7 0x000000000125aa0a in jana::JApplication::ReadEvent (this=0x7fffffffb080, event=...) at src/JANA/JApplication.cc:824 #8 0x000000000125a760 in jana::JApplication::EventBufferThread (this=this entry=0x7fffffffb080) at src/JANA/JApplication.cc:753 #9 0x000000000125a9e9 in LaunchEventBufferThread (arg=0x7fffffffb080) at src/JANA/JApplication.cc:666 #10 0x00007fffee562ea5 in start_thread () from /lib64/libpthread.so.0 #11 0x00007fffed867b0d in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7fffd4cc3700 (LWP 247)): #0 0x00007fffed82e9fd in nanosleep () from /lib64/libc.so.6 #1 0x00007fffed85f2d4 in usleep () from /lib64/libc.so.6 #2 0x000000000124c54a in jana::JApplication::NextEvent (this=0x7fffffffb080, event=...) at src/JANA/JApplication.cc:614 #3 0x0000000001274a5e in jana::JEventLoop::OneEvent (this=this entry=0x7fffb40008c0) at src/JANA/JEventLoop.cc:591 #4 0x0000000001275634 in jana::JEventLoop::Loop (this=this entry=0x7fffb40008c0) at src/JANA/JEventLoop.cc:496 #5 0x000000000124d1ea in LaunchThread (arg=0x7fffffffb080) at src/JANA/JApplication.cc:1382 #6 0x00007fffee562ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007fffed867b0d in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7fffc0d8e700 (LWP 248)): #0 0x00007fffed82e9fd in nanosleep () from /lib64/libc.so.6 #1 0x00007fffed85f2d4 in usleep () from /lib64/libc.so.6 #2 0x000000000124c54a in jana::JApplication::NextEvent (this=0x7fffffffb080, event=...) at src/JANA/JApplication.cc:614 #3 0x0000000001274a5e in jana::JEventLoop::OneEvent (this=this entry=0x7fffb00008c0) at src/JANA/JEventLoop.cc:591 #4 0x0000000001275634 in jana::JEventLoop::Loop (this=this entry=0x7fffb00008c0) at src/JANA/JEventLoop.cc:496 #5 0x000000000124d1ea in LaunchThread (arg=0x7fffffffb080) at src/JANA/JApplication.cc:1382 #6 0x00007fffee562ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007fffed867b0d in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7fffbbfff700 (LWP 249)): #0 0x00007fffed82e9fd in nanosleep () from /lib64/libc.so.6 #1 0x00007fffed85f2d4 in usleep () from /lib64/libc.so.6 #2 0x000000000124c54a in jana::JApplication::NextEvent (this=0x7fffffffb080, event=...) at src/JANA/JApplication.cc:614 #3 0x0000000001274a5e in jana::JEventLoop::OneEvent (this=this entry=0x7fffac0008c0) at src/JANA/JEventLoop.cc:591 #4 0x0000000001275634 in jana::JEventLoop::Loop (this=this entry=0x7fffac0008c0) at src/JANA/JEventLoop.cc:496 #5 0x000000000124d1ea in LaunchThread (arg=0x7fffffffb080) at src/JANA/JApplication.cc:1382 #6 0x00007fffee562ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007fffed867b0d in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7fffbb7fe700 (LWP 250)): #0 0x00007fffed82e9fd in nanosleep () from /lib64/libc.so.6 #1 0x00007fffed85f2d4 in usleep () from /lib64/libc.so.6 #2 0x000000000124c54a in jana::JApplication::NextEvent (this=0x7fffffffb080, event=...) at src/JANA/JApplication.cc:614 #3 0x0000000001274a5e in jana::JEventLoop::OneEvent (this=this entry=0x7fffa80008c0) at src/JANA/JEventLoop.cc:591 #4 0x0000000001275634 in jana::JEventLoop::Loop (this=this entry=0x7fffa80008c0) at src/JANA/JEventLoop.cc:496 #5 0x000000000124d1ea in LaunchThread (arg=0x7fffffffb080) at src/JANA/JApplication.cc:1382 #6 0x00007fffee562ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007fffed867b0d in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7fffba853700 (LWP 255)): #0 0x00007fffed82e659 in waitpid () from /lib64/libc.so.6 #1 0x00007fffed7abf62 in do_system () from /lib64/libc.so.6 #2 0x00007fffed7ac311 in system () from /lib64/libc.so.6 #3 0x00007ffff6284288 in TUnixSystem::Exec (this=0x18638b0, shellcmd=0x7fffa4000b80 "/cvmfs/oasis.opensciencegrid.org/gluex/root-6.22.06/x86_64-debug/etc/gdb-backtrace.sh 205 1>&2") at /nfs/cern.ch/asis/root-6.22.06/core/unix/src/TUnixSystem.cxx:2117 #4 0x00007ffff6284ae2 in TUnixSystem::StackTrace (this=0x18638b0) at /nfs/cern.ch/asis/root-6.22.06/core/unix/src/TUnixSystem.cxx:2408 #5 0x00007ffff62883c0 in TUnixSystem::DispatchSignals (this=0x18638b0, sig=kSigSegmentationViolation) at /nfs/cern.ch/asis/root-6.22.06/core/unix/src/TUnixSystem.cxx:3646 #6 0x00007ffff6280560 in SigHandler (sig=kSigSegmentationViolation) at /nfs/cern.ch/asis/root-6.22.06/core/unix/src/TUnixSystem.cxx:404 #7 0x00007ffff62882c8 in sighandler (sig=11) at /nfs/cern.ch/asis/root-6.22.06/core/unix/src/TUnixSystem.cxx:3617 #8 #9 0x00007fffed8b7ef0 in __memcpy_ssse3 () from /lib64/libc.so.6 #10 0x0000000001052218 in async_filebuf::xsgetn (this=0x7fffcc0057d0, s=0x7fffba84c0f0 "\226\351", n=28) at libraries/DAQ/async_filebuf.cc:233 #11 0x00007fffee0cea8b in std::istream::read(char*, long) () from /lib64/libstdc++.so.6 #12 0x000000000100ef2b in HDEVIO::MapEvents (this=this entry=0x7fffcc0052f0, bh=..., br=...) at libraries/DAQ/HDEVIO.cc:915 #13 0x00000000010106dd in HDEVIO::readNoFileBuff (this=0x7fffcc0052f0, user_buff=0x7fffa40dcd20, user_buff_len=179569, allow_swap=allow_swap entry=false) at libraries/DAQ/HDEVIO.cc:580 #14 0x0000000001043da3 in JEventSource_EVIOpp::Dispatcher (this=0x7fffcc000fc0) at libraries/DAQ/JEventSource_EVIOpp.cc:381 #15 0x00007fffee104330 in ?? () from /lib64/libstdc++.so.6 #16 0x00007fffee562ea5 in start_thread () from /lib64/libpthread.so.0 #17 0x00007fffed867b0d in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7fffba052700 (LWP 256)): #0 0x00007fffee566de2 in pthread_cond_timedwait GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000001067fd4 in __gthread_cond_timedwait (__abs_timeout=0x7fffba04b270, __mutex=, __cond=0x7fffcc0062c0) at /usr/include/c++/4.8.2/x86_64-redhat-linux/bits/gthr-default.h:871 #2 __wait_until_impl > > (__atime=..., __lock=..., this=0x7fffcc0062c0) at /usr/include/c++/4.8.2/condition_variable:160 #3 wait_until > > (__atime=..., __lock=..., this=0x7fffcc0062c0) at /usr/include/c++/4.8.2/condition_variable:100 #4 wait_for > (__rtime=..., __lock=..., this=0x7fffcc0062c0) at /usr/include/c++/4.8.2/condition_variable:132 #5 DEVIOWorkerThread::Run (this=0x7fffcc006200) at libraries/DAQ/DEVIOWorkerThread.cc:99 #6 0x00007fffee104330 in ?? () from /lib64/libstdc++.so.6 #7 0x00007fffee562ea5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fffed867b0d in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7fffb9851700 (LWP 257)): #0 0x00007fffee566de2 in pthread_cond_timedwait GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000001067fd4 in __gthread_cond_timedwait (__abs_timeout=0x7fffb984a270, __mutex=, __cond=0x7fffcc006fb0) at /usr/include/c++/4.8.2/x86_64-redhat-linux/bits/gthr-default.h:871 #2 __wait_until_impl > > (__atime=..., __lock=..., this=0x7fffcc006fb0) at /usr/include/c++/4.8.2/condition_variable:160 #3 wait_until > > (__atime=..., __lock=..., this=0x7fffcc006fb0) at /usr/include/c++/4.8.2/condition_variable:100 #4 wait_for > (__rtime=..., __lock=..., this=0x7fffcc006fb0) at /usr/include/c++/4.8.2/condition_variable:132 #5 DEVIOWorkerThread::Run (this=0x7fffcc006ef0) at libraries/DAQ/DEVIOWorkerThread.cc:99 #6 0x00007fffee104330 in ?? () from /lib64/libstdc++.so.6 #7 0x00007fffee562ea5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fffed867b0d in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7fffb9050700 (LWP 533)): #0 0x00007fffee566a35 in pthread_cond_wait GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fffeaa6c9ad in XrdSysCondVar::Wait (this=this entry=0x7fffb9048fe8) at /home/halld/xrootd/src/XrdSys/XrdSysPthread.cc:106 #2 0x00007fffead96b78 in WaitForResponse (this=0x7fffb9048fd0) at /home/halld/xrootd/src/./XrdCl/XrdClMessageUtils.hh:97 #3 WaitForResponse (response=, handler=0x7fffb9048fd0) at /home/halld/xrootd/src/./XrdCl/XrdClMessageUtils.hh:171 #4 XrdCl::File::Read (this=this entry=0x7fffcc005b08, offset=offset entry=18565225612, size=size entry=30000000, buffer=buffer entry=0x7fffc46c7710, bytesRead= 0x7fffb90490bc: 32767, timeout=timeout entry=0) at /home/halld/xrootd/src/XrdCl/XrdClFile.cc:212 #5 0x00007fffed5555b3 in XrdPosixFile::Read (this=0x7fffcc005a70, Buff=0x7fffc46c7710 "", Offs=18565225612, Len=30000000) at /home/halld/xrootd/src/XrdPosix/XrdPosixFile.cc:561 #6 0x00007fffed55bec9 in XrdPosixXrootd::Read (fildes=, buf=0x7fffc46c7710, nbyte=30000000) at /home/halld/xrootd/src/XrdPosix/XrdPosixXrootd.cc:1102 #7 0x00007fffee0cb5c7 in std::__basic_file::xsgetn(char*, long) () from /lib64/libstdc++.so.6 #8 0x00007fffee1055bd in std::basic_filebuf >::xsgetn(char*, long) () from /lib64/libstdc++.so.6 #9 0x0000000001052d1d in async_filebuf::readloop (this=0x7fffcc0057d0) at libraries/DAQ/async_filebuf.cc:119 #10 0x00007fffee104330 in ?? () from /lib64/libstdc++.so.6 #11 0x00007fffee562ea5 in start_thread () from /lib64/libpthread.so.0 #12 0x00007fffed867b0d in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7ffff7ead380 (LWP 205)): #0 0x00007fffee569e9d in nanosleep () from /lib64/libpthread.so.0 #1 0x000000000125658d in jana::JApplication::Run (this=this entry=0x7fffffffb080, proc=proc entry=0x32c3a20, Nthreads=, Nthreads entry=0) at src/JANA/JApplication.cc:1613 #2 0x000000000069742c in main (narg=11, argv=0x7fffffffb6e8) at programs/Analysis/hd_root/hd_root.cc:46 =========================================================== The lines below might hint at the cause of the crash. You may get help by asking at the ROOT forum https://root.cern.ch/forum Only if you are really convinced it is a bug in ROOT then please submit a report at https://root.cern.ch/bugs Please post the ENTIRE stack trace from above as an attachment in addition to anything else that might help us fixing this issue. =========================================================== #9 0x00007fffed8b7ef0 in __memcpy_ssse3 () from /lib64/libc.so.6 #10 0x0000000001052218 in async_filebuf::xsgetn (this=0x7fffcc0057d0, s=0x7fffba84c0f0 "226351", n=28) at libraries/DAQ/async_filebuf.cc:233 #11 0x00007fffee0cea8b in std::istream::read(char*, long) () from /lib64/libstdc++.so.6 #12 0x000000000100ef2b in HDEVIO::MapEvents (this=this entry=0x7fffcc0052f0, bh=..., br=...) at libraries/DAQ/HDEVIO.cc:915 #13 0x00000000010106dd in HDEVIO::readNoFileBuff (this=0x7fffcc0052f0, user_buff=0x7fffa40dcd20, user_buff_len=179569, allow_swap=allow_swap entry=false) at libraries/DAQ/HDEVIO.cc:580 #14 0x0000000001043da3 in JEventSource_EVIOpp::Dispatcher (this=0x7fffcc000fc0) at libraries/DAQ/JEventSource_EVIOpp.cc:381 #15 0x00007fffee104330 in ?? () from /lib64/libstdc++.so.6 #16 0x00007fffee562ea5 in start_thread () from /lib64/libpthread.so.0 #17 0x00007fffed867b0d in clone () from /lib64/libc.so.6 ===========================================================