MongoDB: Connection String Error when Upgrading Config Servers to Replica Set - mongodb

I'm following these instructions to upgrade my Mongo config servers to a replica set. Everything seems to work initially, but then when connecting to a Mongos and running sh.status, I get the following error message and stack.
Of importance: "Detected upgrade from mirrored (SCCC) config servers to replica set (CSRS) config servers. setShardVersion was given: csReplSet/mongodb-config-1:27019 for the config server connection string, but has stored: mongodb-config-1:27019,mongodb-config-2:27019,mongodb-config-3:27019
This causes the PRIMARY and one of the SECONDARY config servers to crash. I checked that all mongos have the right connection string and that all mongod and mongos are running the same version of MongoDB (3.2.11). I also tried firing up config servers from scratch (at the expense of losing data), but to no avail.
Any ideas?
2016-12-13T08:27:47.825+0000 I SHARDING [conn849] Detected upgrade from mirrored (SCCC) config servers to replica set (CSRS) config servers. setShardVersion was given: csReplSet/mo\
ngodb-config-1:27019 for the config server connection string, but has stored: mongodb-config-1:27019,mongodb-config-2:27019,mongodb-config-3:27019
2016-12-13T08:27:47.825+0000 F - [conn849] Invalid access at address: 0x108
2016-12-13T08:27:47.831+0000 F - [conn849] Got signal: 11 (Segmentation fault).
0x132f902 0x132ea59 0x132edd8 0x7f288d434330 0x7f288d42e404 0x1140949 0xfa1480 0xbd2653 0xbd34d9 0xb2c1f0 0xce12f5 0x9be81c 0x12dc0c5 0x7f288d42c184 0x7f288d15937d
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"400000","o":"F2F902","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"F2EA59"},{"b":"400000","o":"F2EDD8"},{"b":"7F288D424000","o":"10330"},{"b":"7F288D4\
24000","o":"A404","s":"pthread_mutex_lock"},{"b":"400000","o":"D40949","s":"_ZN5mongo24ForwardingCatalogManager37scheduleReplaceCatalogManagerIfNeededENS_14CatalogManager16ConfigSer\
verModeERKNS_16ConnectionStringE"},{"b":"400000","o":"BA1480"},{"b":"400000","o":"7D2653","s":"_ZN5mongo7Command3runEPNS_16OperationContextERKNS_3rpc16RequestInterfaceEPNS3_21ReplyB\
uilderInterfaceE"},{"b":"400000","o":"7D34D9","s":"_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_RKNS_3rpc16RequestInterfaceEPNS4_21ReplyBuilderInterfaceE"},{"b":"400000\
","o":"72C1F0","s":"_ZN5mongo11runCommandsEPNS_16OperationContextERKNS_3rpc16RequestInterfaceEPNS2_21ReplyBuilderInterfaceE"},{"b":"400000","o":"8E12F5","s":"_ZN5mongo16assembleResp\
onseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE"},{"b":"400000","o":"5BE81C","s":"_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessag\
ingPortE"},{"b":"400000","o":"EDC0C5","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"7F288D424000","o":"8184"},{"b":"7F288D05F000","o":"FA37D","s":"clone"}],"proces\
sInfo":{ "mongodbVersion" : "3.2.11", "gitVersion" : "009580ad490190ba33d1c6253ebd8d91808923e4", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "4.4.0-53-gener\
ic", "version" : "#74~14.04.1-Ubuntu SMP Fri Dec 2 03:43:31 UTC 2016", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "55994D9F4E3C47C30959A86BC9F3\
3188CB6ADF21" }, { "b" : "7FFCEDF32000", "elfType" : 3, "buildId" : "AA5EEB9DFDD3AABAC9F493EC883C381016A1C312" }, { "b" : "7F288E346000", "path" : "/lib/x86_64-linux-gnu/libssl.so.1\
.0.0", "elfType" : 3, "buildId" : "15A6A69B862FAC0AA589921DB1B0DF8A673FEC81" }, { "b" : "7F288DF6A000", "path" : "/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId"\
: "607C4A6F3428B6F065D55691AFDC4E343786A8A5" }, { "b" : "7F288DD62000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "E2A6DD5048A0A051FD61043BDB69D8CC681\
92AB7" }, { "b" : "7F288DB5E000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "DA9B8C234D0FE9FD8CAAC8970A7EC1B6C8F6623F" }, { "b" : "7F288D858000", "path\
" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "D144258E614900B255A31F3FD2283A878670D5BC" }, { "b" : "7F288D642000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1\
", "elfType" : 3, "buildId" : "36311B4457710AE5578C4BF00791DED7359DBB92" }, { "b" : "7F288D424000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "31E\
9F21AE8C10396171F1E13DA15780986FA696C" }, { "b" : "7F288D05F000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "CF699A15CAAE64F50311FC4655B86DC39A479789" }\
, { "b" : "7F288E5A5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "D0F537904076D73F29E4A37341F8A449E2EF6CD0" } ] }}
mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x132f902]
mongod(+0xF2EA59) [0x132ea59]
mongod(+0xF2EDD8) [0x132edd8]
libpthread.so.0(+0x10330) [0x7f288d434330]
libpthread.so.0(pthread_mutex_lock+0x4) [0x7f288d42e404]
mongod(_ZN5mongo24ForwardingCatalogManager37scheduleReplaceCatalogManagerIfNeededENS_14CatalogManager16ConfigServerModeERKNS_16ConnectionStringE+0x39) [0x1140949]
mongod(+0xBA1480) [0xfa1480]
mongod(_ZN5mongo7Command3runEPNS_16OperationContextERKNS_3rpc16RequestInterfaceEPNS3_21ReplyBuilderInterfaceE+0x473) [0xbd2653]
mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_RKNS_3rpc16RequestInterfaceEPNS4_21ReplyBuilderInterfaceE+0x3F9) [0xbd34d9]
mongod(_ZN5mongo11runCommandsEPNS_16OperationContextERKNS_3rpc16RequestInterfaceEPNS2_21ReplyBuilderInterfaceE+0x1F0) [0xb2c1f0]
mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xB45) [0xce12f5]
mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortE+0xEC) [0x9be81c]
mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x325) [0x12dc0c5]
libpthread.so.0(+0x8184) [0x7f288d42c184]
libc.so.6(clone+0x6D) [0x7f288d15937d]
----- END BACKTRACE -----
2016-12-13T08:27:47.831+0000 F - [conn849] /proc/self/maps:
00400000-02008000 r-xp 00000000 08:01 2125 /usr/bin/mongod
2016-12-13T08:27:47.831+0000 F - [conn849] 02008000-020db000 rw-p 01c07000 08:01 2125 /usr/bin/mongod
2016-12-13T08:27:47.831+0000 F - [conn849] 020db000-0214b000 rw-p 00000000 00:00 0
2016-12-13T08:27:47.831+0000 F - [conn849] 02885000-03486000 rw-p 00000000 00:00 0 [heap]
2016-12-13T08:27:47.831+0000 F - [conn849] 03486000-08972000 rw-p 00000000 00:00 0 [heap]
2016-12-13T08:27:47.831+0000 F - [conn849] 7f28689ba000-7f28689bb000 ---p 00000000 00:00 0
2016-12-13T08:27:47.831+0000 F - [conn849] 7f28689bb000-7f2868abb000 rw-p 00000000 00:00 0
2016-12-13T08:27:47.831+0000 F - [conn849] 7f2868abb000-7f2868abc000 ---p 00000000 00:00 0
2016-12-13T08:27:47.831+0000 F - [conn849] 7f2868abc000-7f2868bbc000 rw-p 00000000 00:00 0
2016-12-13T08:27:47.831+0000 F - [conn849] 7f2868bbc000-7f2868bbd000 ---p 00000000 00:00 0
2016-12-13T08:27:47.831+0000 F - [conn849] 7f2868bbd000-7f2868cbd000 rw-p 00000000 00:00 0
2016-12-13T08:27:47.831+0000 F - [conn849] 7f2868cbd000-7f2868cbe000 ---p 00000000 00:00 0
.
.
.
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288c85e000-7f288c85f000 ---p 00000000 00:00 0
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288c85f000-7f288d05f000 rw-p 00000000 00:00 0
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288d05f000-7f288d219000 r-xp 00000000 08:01 3079 /lib/x86_64-linux-gnu/libc-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288d219000-7f288d419000 ---p 001ba000 08:01 3079 /lib/x86_64-linux-gnu/libc-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288d419000-7f288d41d000 r--p 001ba000 08:01 3079 /lib/x86_64-linux-gnu/libc-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288d41d000-7f288d41f000 rw-p 001be000 08:01 3079 /lib/x86_64-linux-gnu/libc-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288d41f000-7f288d424000 rw-p 00000000 00:00 0
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288d424000-7f288d43d000 r-xp 00000000 08:01 3042 /lib/x86_64-linux-gnu/libpthread-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288d43d000-7f288d63c000 ---p 00019000 08:01 3042 /lib/x86_64-linux-gnu/libpthread-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288d63c000-7f288d63d000 r--p 00018000 08:01 3042 /lib/x86_64-linux-gnu/libpthread-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288d63d000-7f288d63e000 rw-p 00019000 08:01 3042 /lib/x86_64-linux-gnu/libpthread-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288d63e000-7f288d642000 rw-p 00000000 00:00 0
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288d642000-7f288d658000 r-xp 00000000 08:01 3111 /lib/x86_64-linux-gnu/libgcc_s.so.1
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288d658000-7f288d857000 ---p 00016000 08:01 3111 /lib/x86_64-linux-gnu/libgcc_s.so.1
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288d857000-7f288d858000 rw-p 00015000 08:01 3111 /lib/x86_64-linux-gnu/libgcc_s.so.1
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288d858000-7f288d95d000 r-xp 00000000 08:01 3084 /lib/x86_64-linux-gnu/libm-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288d95d000-7f288db5c000 ---p 00105000 08:01 3084 /lib/x86_64-linux-gnu/libm-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288db5c000-7f288db5d000 r--p 00104000 08:01 3084 /lib/x86_64-linux-gnu/libm-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288db5d000-7f288db5e000 rw-p 00105000 08:01 3084 /lib/x86_64-linux-gnu/libm-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288db5e000-7f288db61000 r-xp 00000000 08:01 3076 /lib/x86_64-linux-gnu/libdl-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288db61000-7f288dd60000 ---p 00003000 08:01 3076 /lib/x86_64-linux-gnu/libdl-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288dd60000-7f288dd61000 r--p 00002000 08:01 3076 /lib/x86_64-linux-gnu/libdl-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288dd61000-7f288dd62000 rw-p 00003000 08:01 3076 /lib/x86_64-linux-gnu/libdl-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288dd62000-7f288dd69000 r-xp 00000000 08:01 3002 /lib/x86_64-linux-gnu/librt-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288dd69000-7f288df68000 ---p 00007000 08:01 3002 /lib/x86_64-linux-gnu/librt-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288df68000-7f288df69000 r--p 00006000 08:01 3002 /lib/x86_64-linux-gnu/librt-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288df69000-7f288df6a000 rw-p 00007000 08:01 3002 /lib/x86_64-linux-gnu/librt-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288df6a000-7f288e11d000 r-xp 00000000 08:01 3012 /lib/x86_64-linux-gnu/libcrypto.so.1.0.0
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288e11d000-7f288e31c000 ---p 001b3000 08:01 3012 /lib/x86_64-linux-gnu/libcrypto.so.1.0.0
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288e31c000-7f288e337000 r--p 001b2000 08:01 3012 /lib/x86_64-linux-gnu/libcrypto.so.1.0.0
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288e337000-7f288e342000 rw-p 001cd000 08:01 3012 /lib/x86_64-linux-gnu/libcrypto.so.1.0.0
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288e342000-7f288e346000 rw-p 00000000 00:00 0
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288e346000-7f288e39b000 r-xp 00000000 08:01 3059 /lib/x86_64-linux-gnu/libssl.so.1.0.0
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288e39b000-7f288e59b000 ---p 00055000 08:01 3059 /lib/x86_64-linux-gnu/libssl.so.1.0.0
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288e59b000-7f288e59e000 r--p 00055000 08:01 3059 /lib/x86_64-linux-gnu/libssl.so.1.0.0
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288e59e000-7f288e5a5000 rw-p 00058000 08:01 3059 /lib/x86_64-linux-gnu/libssl.so.1.0.0
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288e5a5000-7f288e5c8000 r-xp 00000000 08:01 3010 /lib/x86_64-linux-gnu/ld-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288e62d000-7f288e62f000 rw-p 00000000 00:00 0
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288e62f000-7f288e7b8000 r--p 00000000 08:01 28741 /usr/lib/locale/locale-archive
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288e7be000-7f288e7c5000 r--s 00000000 08:01 29034 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288e7c5000-7f288e7c7000 rw-p 00000000 00:00 0
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288e7c7000-7f288e7c8000 r--p 00022000 08:01 3010 /lib/x86_64-linux-gnu/ld-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288e7c8000-7f288e7c9000 rw-p 00023000 08:01 3010 /lib/x86_64-linux-gnu/ld-2.19.so
2016-12-13T08:27:47.833+0000 F - [conn849] 7f288e7c9000-7f288e7ca000 rw-p 00000000 00:00 0
2016-12-13T08:27:47.833+0000 F - [conn849] 7ffcede0e000-7ffcede2f000 rw-p 00000000 00:00 0 [stack]
2016-12-13T08:27:47.833+0000 F - [conn849] 7ffcedf30000-7ffcedf32000 r--p 00000000 00:00 0 [vvar]
2016-12-13T08:27:47.833+0000 F - [conn849] 7ffcedf32000-7ffcedf34000 r-xp 00000000 00:00 0 [vdso]
2016-12-13T08:27:47.833+0000 F - [conn849] ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]

The problem was that there were still some mongos instances using the old (mirrored) connection string. It seems that even mongos instances that are not up keep on pinging the config servers which cause the error and the fatal crash. Do use config; db.mongos.find() to find all your mongos instances and make sure they are all using the updated connection string without exception.

Related

Emacs crashes with corrupted double-linked list

My emacs keeps crashing all the time, no matter if I'm under Mac OS X or Linux. What package should I disable to make this go away?
I use configuration as here https://github.com/abelardojarab/emacsfull.git
But gives this:
(gdb) bt
#0 0x00002aaa
afa6b755 in raise () from /lib64/libc.so.6
#1 0x00002aaaafa6cd31 in abort () from /lib64/libc.so.6
#2 0x00002aaaafaa9c1f in __libc_message () from /lib64/libc.so.6
#3 0x00002aaaafaaf338 in malloc_printerr () from /lib64/libc.so.6
#4 0x00002aaaafaaf91f in malloc_consolidate () from /lib64/libc.so.6
#5 0x00002aaaafab0e30 in _int_free () from /lib64/libc.so.6
#6 0x00002aaaafab437c in free () from /lib64/libc.so.6
#7 0x000000000054fc73 in Fgarbage_collect ()
#8 0x0000000006b1c406 in ?? ()
#9 0x00000000000080f7 in ?? ()
#10 0x0000000000000001 in ?? ()
#11 0x01000000065b4ae8 in ?? ()
#12 0x0000000002e70000 in ?? ()
#13 0x0000000002e702c0 in ?? ()
#14 0x0000000000000000 in ?? ()
the gdb output after crashing is:
*** glibc detected *** /nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs: corrupted double-linked list: 0x0000000004d61210 ***
======= Backtrace: =========
/lib64/libc.so.6(+0x76338)[0x2aaaafaaf338]
/lib64/libc.so.6(+0x7691f)[0x2aaaafaaf91f]
/lib64/libc.so.6(+0x77e30)[0x2aaaafab0e30]
/lib64/libc.so.6(cfree+0x6c)[0x2aaaafab437c]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x54fc73]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x59e9d8]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x5677af]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x56698a]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs(eval_sub+0x3a3)[0x566de3]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs(eval_sub+0x808)[0x567248]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x5695a1]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs(Ffuncall+0x484)[0x567da4]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x5661a4]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x43531b]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x4353ef]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x44b53e]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x44b6f9]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x44b6f9]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x450808]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x450af1]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x4682ab]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x46b61e]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x565efa]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x455572]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x455ee7]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x4f8912]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x5a9860]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x4288e3]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x4fb6d5]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x4fcfd0]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs(command_loop_1+0x1f9)[0x4fe499]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x565db0]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x4f16b3]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x565c9b]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x4f3913]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x4f3c85]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x41e59f]
/lib64/libc.so.6(__libc_start_main+0xe6)[0x2aaaafa57c16]
/nfs/site/itools/em64t_SLES11/pkgs/wrapper/2.06/bin/emacs[0x41f355]
======= Memory map: ========
00400000-00634000 r-xp 00000000 00:28 6470881 /nfs/site/itools/em64t_SLES11/pkgs/emacs/24.4/bin/emacs-24.4
00834000-01368000 rw-p 00234000 00:28 6470881 /nfs/site/itools/em64t_SLES11/pkgs/emacs/24.4/bin/emacs-24.4
01368000-06c16000 rw-p 00000000 00:00 0 [heap]
2aaaaaaab000-2aaaaaaca000 r-xp 00000000 08:02 32634 /lib64/ld-2.11.3.so
2aaaaaaca000-2aaaaaacb000 r-xp 00000000 00:00 0 [vdso]
2aaaaaacb000-2aaaaaacd000 rw-p 00000000 00:00 0
2aaaaacc9000-2aaaaacca000 r--p 0001e000 08:02 32634 /lib64/ld-2.11.3.so
2aaaaacca000-2aaaaaccb000 rw-p 0001f000 08:02 32634 /lib64/ld-2.11.3.so
2aaaaaccb000-2aaaaaccc000 rw-p 00000000 00:00 0
2aaaaaccc000-2aaaaad2c000 r-xp 00000000 00:28 2898131 /nfs/site/itools/em64t_SLES11/pkgs/tiff/3.9.1-64/lib64/libtiff.so.3.9.1
2aaaaad2c000-2aaaaaf2c000 ---p 00060000 00:28 2898131 /nfs/site/itools/em64t_SLES11/pkgs/tiff/3.9.1-64/lib64/libtiff.so.3.9.1
2aaaaaf2c000-2aaaaaf2e000 r--p 00060000 00:28 2898131 /nfs/site/itools/em64t_SLES11/pkgs/tiff/3.9.1-64/lib64/libtiff.so.3.9.1
2aaaaaf2e000-2aaaaaf2f000 rw-p 00062000 00:28 2898131 /nfs/site/itools/em64t_SLES11/pkgs/tiff/3.9.1-64/lib64/libtiff.so.3.9.1
2aaaaaf2f000-2aaaaaf30000 rw-p 00000000 00:00 0
2aaaaaf30000-2aaaaaf4e000 r-xp 00000000 00:28 5340277 /nfs/site/itools/em64t_SLES11/pkgs/jpeg/6b-64/lib/libjpeg.so.62.0.0
2aaaaaf4e000-2aaaab04d000 ---p 0001e000 00:28 5340277 /nfs/site/itools/em64t_SLES11/pkgs/jpeg/6b-64/lib/libjpeg.so.62.0.0
2aaaab04d000-2aaaab051000 rw-p 0001d000 00:28 5340277 /nfs/site/itools/em64t_SLES11/pkgs/jpeg/6b-64/lib/libjpeg.so.62.0.0
2aaaab051000-2aaaab076000 r-xp 00000000 00:28 18211497 /nfs/site/itools/em64t_SLES11/pkgs/libpng/1.2.40-64/lib/libpng12.so.0.40.0
2aaaab076000-2aaaab275000 ---p 00025000 00:28 18211497 /nfs/site/itools/em64t_SLES11/pkgs/libpng/1.2.40-64/lib/libpng12.so.0.40.0
2aaaab275000-2aaaab276000 r--p 00024000 00:28 18211497 /nfs/site/itools/em64t_SLES11/pkgs/libpng/1.2.40-64/lib/libpng12.so.0.40.0
2aaaab276000-2aaaab277000 rw-p 00025000 00:28 18211497 /nfs/site/itools/em64t_SLES11/pkgs/libpng/1.2.40-64/lib/libpng12.so.0.40.0
2aaaab277000-2aaaab28a000 r-xp 00000000 00:28 3086824 /nfs/site/itools/em64t_SLES11/pkgs/zlib/1.2.x-64/lib64/libz.so.1.2.3
2aaaab28a000-2aaaab389000 ---p 00013000 00:28 3086824 /nfs/site/itools/em64t_SLES11/pkgs/zlib/1.2.x-64/lib64/libz.so.1.2.3
2aaaab389000-2aaaab38b000 rw-p 00012000 00:28 3086824 /nfs/site/itools/em64t_SLES11/pkgs/zlib/1.2.x-64/lib64/libz.so.1.2.3
2aaaab38b000-2aaaab38c000 r--p 00000000 08:05 254032 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION
2aaaab38c000-2aaaab393000 r--s 00000000 08:05 13411 /usr/lib64/gconv/gconv-modules.cache
2aaaab393000-2aaaab394000 r--p 00000000 08:05 261916 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT
2aaaab394000-2aaaab395000 r--p 00000000 08:05 261911 /usr/lib/locale/en_US.utf8/LC_TELEPHONE
2aaaab395000-2aaaab396000 r--p 00000000 08:05 251910 /usr/lib/locale/en_US.utf8/LC_ADDRESS
2aaaab396000-2aaaab397000 r--p 00000000 08:05 260579 /usr/lib/locale/en_US.utf8/LC_NAME
2aaaab397000-2aaaab398000 r--p 00000000 08:05 260566 /usr/lib/locale/en_US.utf8/LC_PAPER
2aaaab398000-2aaaab399000 r--p 00000000 08:05 261912 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES
2aaaab399000-2aaaab39a000 r--p 00000000 08:05 254033 /usr/lib/locale/en_US.utf8/LC_MONETARY
2aaaab39a000-2aaaab39b000 r--p 00000000 08:05 254034 /usr/lib/locale/en_US.utf8/LC_TIME
2aaaab39b000-2aaaab39c000 r--p 00000000 08:05 260632 /usr/lib/locale/en_US.utf8/LC_NUMERIC
2aaaab3ab000-2aaaab406000 r-xp 00000000 08:02 32403 /lib64/libm-2.11.3.so
2aaaab406000-2aaaab605000 ---p 0005b000 08:02 32403 /lib64/libm-2.11.3.so
2aaaab605000-2aaaab606000 r--p 0005a000 08:02 32403 /lib64/libm-2.11.3.so
2aaaab606000-2aaaab624000 rw-p 0005b000 08:02 32403 /lib64/libm-2.11.3.so
2aaaab624000-2aaaab625000 rw-p 00000000 00:00 0
2aaaab625000-2aaaab636000 r-xp 00000000 00:28 32887742 /nfs/site/itools/em64t_SLES11/pkgs/X11/R7.5-64/lib/libXpm.so.4.11.0
2aaaab636000-2aaaab835000 ---p 00011000 00:28 32887742 /nfs/site/itools/em64t_SLES11/pkgs/X11/R7.5-64/lib/libXpm.so.4.11.0
2aaaab835000-2aaaab836000 r--p 00010000 00:28 32887742 /nfs/site/itools/em64t_SLES11/pkgs/X11/R7.5-64/lib/libXpm.so.4.11.0
2aaaab836000-2aaaab837000 rw-p 00011000 00:28 32887742 /nfs/site/itools/em64t_SLES11/pkgs/X11/R7.5-64/lib/libXpm.so.4.11.0
2aaaab837000-2aaaabc34000 r-xp 00000000 00:28 16585724 /nfs/site/itools/em64t_SLES11/pkgs/gtk+/2.18.6-64/lib64/libgtk-x11-2.0.so.0.1800.6
2aaaabc34000-2aaaabe34000 ---p 003fd000 00:28 16585724 /nfs/site/itools/em64t_SLES11/pkgs/gtk+/2.18.6-64/lib64/libgtk-x11-2.0.so.0.1800.6
2aaaabe34000-2aaaabe3b000 r--p 003fd000 00:28 16585724 /nfs/site/itools/em64t_SLES11/pkgs/gtk+/2.18.6-64/lib64/libgtk-x11-2.0.so.0.1800.6
2aaaabe3b000-2aaaabe3f000 rw-p 00404000 00:28 16585724 /nfs/site/itools/em64t_SLES11/pkgs/gtk+/2.18.6-64/lib64/libgtk-x11-2.0.so.0.1800.6
2aaaabe3f000-2aaaabe41000 rw-p 00000000 00:00 0
2aaaabe41000-2aaaabee7000 r-xp 00000000 00:28 6779303 /nfs/site/itools/em64t_SLES11/pkgs/gtk+/2.18.6-64/lib64/libgdk-x11-2.0.so.0.1800.6
2aaaabee7000-2aaaac0e6000 ---p 000a6000 00:28 6779303 /nfs/site/itools/em64t_SLES11/pkgs/gtk+/2.18.6-64/lib64/libgdk-x11-2.0.so.0.1800.6
2aaaac0e6000-2aaaac0ea000 r--p 000a5000 00:28 6779303 /nfs/site/itools/em64t_SLES11/pkgs/gtk+/2.18.6-64/lib64/libgdk-x11-2.0.so.0.1800.6
2aaaac0ea000-2aaaac0ec000 rw-p 000a9000 00:28 6779303 /nfs/site/itools/em64t_SLES11/pkgs/gtk+/2.18.6-64/lib64/libgdk-x11-2.0.so.0.1800.6
2aaaac0ec000-2aaaac0ed000 rw-p 00000000 00:00 0
2aaaac0ed000-2aaaac10b000 r-xp 00000000 00:28 29753415 /nfs/site/itools/em64t_SLES11/pkgs/atk/1.28.0-64/lib64/libatk-1.0.so.0.2809.1
2aaaac10b000-2aaaac30b000 ---p 0001e000 00:28 29753415 /nfs/site/itools/em64t_SLES11/pkgs/atk/1.28.0-64/lib64/libatk-1.0.so.0.2809.1
2aaaac30b000-2aaaac30d000 r--p 0001e000 00:28 29753415 /nfs/site/itools/em64t_SLES11/pkgs/atk/1.28.0-64/lib64/libatk-1.0.so.0.2809.1
2aaaac30d000-2aaaac30e000 rw-p 00020000 00:28 29753415 /nfs/site/itools/em64t_SLES11/pkgs/atk/1.28.0-64/lib64/libatk-1.0.so.0.2809.1
2aaaac30e000-2aaaac3b3000 r-xp 00000000 00:28 9290844 /nfs/site/itools/em64t_SLES11/pkgs/glib/2.22.3-64/lib64/libgio-2.0.so.0.2200.3
2aaaac3b3000-2aaaac5b3000 ---p 000a5000 00:28 9290844 /nfs/site/itools/em64t_SLES11/pkgs/glib/2.22.3-64/lib64/libgio-2.0.so.0.2200.3
2aaaac5b3000-2aaaac5b5000 r--p 000a5000 00:28 9290844 /nfs/site/itools/em64t_SLES11/pkgs/glib/2.22.3-64/lib64/libgio-2.0.so.0.2200.3
2aaaac5b5000-2aaaac5b6000 rw-p 000a7000 00:28 9290844 /nfs/site/itools/em64t_SLES11/pkgs/glib/2.22.3-64/lib64/libgio-2.0.so.0.2200.3
2aaaac5b6000-2aaaac5b7000 rw-p 00000000 00:00 0
2aaaac5b7000-2aaaac5df000 r-xp 00000000 00:28 23448439 /nfs/site/itools/em64t_SLES11/pkgs/pango/1.26.2-64/lib64/libpangoft2-1.0.so.0.2600.2
2aaaac5df000-2aaaac7de000 ---p 00028000 00:28 23448439 /nfs/site/itools/em64t_SLES11/pkgs/pango/1.26.2-64/lib64/libpangoft2-1.0.so.0.2600.2
2aaaac7de000-2aaaac7df000 r--p 00027000 00:28 23448439 /nfs/site/itools/em64t_SLES11/pkgs/pango/1.26.2-64/lib64/libpangoft2-1.0.so.0.2600.2
2aaaac7df000-2aaaac7e0000 rw-p 00028000 00:28 23448439 /nfs/site/itools/em64t_SLES11/pkgs/pango/1.26.2-64/lib64/libpangoft2-1.0.so.0.2600.2
2aaaac7e0000-2aaaac7e1000 rw-p 00000000 00:00 0
2aaaac7e1000-2aaaac7fc000 r-xp 00000000 00:28 16585719 /nfs/site/itools/em64t_SLES11/pkgs/gtk+/2.18.6-64/lib64/libgdk_pixbuf-2.0.so.0.1800.6
2aaaac7fc000-2aaaac9fb000 ---p 0001b000 00:28 16585719 /nfs/site/itools/em64t_SLES11/pkgs/gtk+/2.18.6-64/lib64/libgdk_pixbuf-2.0.so.0.1800.6
2aaaac9fb000-2aaaac9fc000 r--p 0001a000 00:28 16585719 /nfs/site/itools/em64t_SLES11/pkgs/gtk+/2.18.6-64/lib64/libgdk_pixbuf-2.0.so.0.1800.6
2aaaac9fc000-2aaaac9fd000 rw-p 0001b000 00:28 16585719 /nfs/site/itools/em64t_SLES11/pkgs/gtk+/2.18.6-64/lib64/libgdk_pixbuf-2.0.so.0.1800.6
2aaaac9fd000-2aaaaca08000 r-xp 00000000 00:28 23448437 /nfs/site/itools/em64t_SLES11/pkgs/pango/1.26.2-64/lib64/libpangocairo-1.0.so.0.2600.2
2aaaaca08000-2aaaacc08000 ---p 0000b000 00:28 23448437 /nfs/site/itools/em64t_SLES11/pkgs/pango/1.26.2-64/lib64/libpangocairo-1.0.so.0.2600.2
2aaaacc08000-2aaaacc09000 r--p 0000b000 00:28 23448437 /nfs/site/itools/em64t_SLES11/pkgs/pango/1.26.2-64/lib64/libpangocairo-1.0.so.0.2600.2
2aaaacc09000-2aaaacc0a000 rw-p 0000c000 00:28 23448437 /nfs/site/itools/em64t_SLES11/pkgs/pango/1.26.2-64/lib64/libpangocairo-1.0.so.0.2600.2
2aaaacc0a000-2aaaacc7f000 r-xp 00000000 00:28 25890820 /nfs/site/itools/em64t_SLES11/pkgs/cairo/1.8.8-64/lib/libcairo.so.2.10800.8
2aaaacc7f000-2aaaace7f000 ---p 00075000 00:28 25890820 /nfs/site/itools/em64t_SLES11/pkgs/cairo/1.8.8-64/lib/libcairo.so.2.10800.8
2aaaace7f000-2aaaace81000 r--p 00075000 00:28 25890820 /nfs/site/itools/em64t_SLES11/pkgs/cairo/1.8.8-64/lib/libcairo.so.2.10800.8
2aaaace81000-2aaaace82000 rw-p 00077000 00:28 25890820 /nfs/site/itools/em64t_SLES11/pkgs/cairo/1.8.8-64/lib/libcairo.so.2.10800.8
2aaaace82000-2aaaace83000 rw-p 00000000 00:00 0
2aaaace83000-2aaaacecb000 r-xp 00000000 00:28 23448435 /nfs/site/itools/em64t_SLES11/pkgs/pango/1.26.2-64/lib64/libpango-1.0.so.0.2600.2
2aaaacecb000-2aaaad0cb000 ---p 00048000 00:28 23448435 /nfs/site/itools/em64t_SLES11/pkgs/pango/1.26.2-64/lib64/libpango-1.0.so.0.2600.2
2aaaad0cb000-2aaaad0cd000 r--p 00048000 00:28 23448435 /nfs/site/itools/em64t_SLES11/pkgs/pango/1.26.2-64/lib64/libpango-1.0.so.0.2600.2
2aaaad0cd000-2aaaad0ce000 rw-p 0004a000 00:28 23448435 /nfs/site/itools/em64t_SLES11/pkgs/pango/1.26.2-64/lib64/libpango-1.0.so.0.2600.2
2aaaad0ce000-2aaaad14d000 r-xp 00000000 00:28 134817 /nfs/site/itools/em64t_SLES11/pkgs/freetype/2.3.7-64/lib/libfreetype.so.6.3.18
Program received signal SIGABRT, Aborted.
[Switching to Thread 0x2aaab1a8c880 (LWP 38558)]
0x00002aaaafa6b755 in raise () from /lib64/libc.so.6
(gdb)
Use binary search to determine which package is responsible (if any is). This should be much quicker than bothering with gdb. Use gdb only when/if you have to.
To use binary search: Start Emacs up with 1/2 of the packages used, to see which half is problematic. Then 1/4, 1/8, 1/16, 1/32, 1/64, 1/128, etc.
You'll have to start Emacs up multiple times, but this is a quick way to find out what's wrong, especially if you are using a lot of packages.

Stuck with crash dump analysis - user32!NtUserSetFocus freezes app?

We have an old VB6 application that keeps freezing and/or crashing. We setup an easy shortcut for users to create a full dump when the program freezes.
We now have a week's worth of dumps, and most of them show a cryptic stack from the hung thread, which doesn't even include any of our functions, and the last call is to user32!NtUserSetFocus.
We're really stuck here... can anyone help?
0:000> kb
ChildEBP RetAddr Args to Child
0018d788 755eee3e 002609ac 00000001 755eed34 user32!NtUserSetFocus+0x15
0018d7a0 755962fa 00260f22 00000110 002609ac user32!MB_DlgProc+0x10a
0018d7cc 755bf9df 755eed34 00260f22 00000110 user32!InternalCallWinProc+0x23
0018d848 755bf784 00000000 755eed34 00260f22 user32!UserCallDlgProcCheckWow+0xd7
0018d898 755bf889 0160cf70 00000000 00000110 user32!DefDlgProcWorker+0xb7
0018d8b8 755962fa 00260f22 00000110 002609ac user32!DefDlgProcW+0x29
0018d8e4 75596d3a 755bf860 00260f22 00000110 user32!InternalCallWinProc+0x23
0018d95c 7559965e 00000000 76ee3d54 00260f22 user32!UserCallWinProcCheckWow+0x109
0018d9a0 755c206f 0160cf70 00000000 76ee3d54 user32!SendMessageWorker+0x581
0018da74 755bcf4b 75580000 00000008 00000000 user32!InternalCreateDialog+0xb9f
0018daac 755ef73c 75580000 1736f6a8 0010193a user32!InternalDialogBox+0xc1
0018db60 755efa18 00000030 ffffffff ffff0000 user32!SoftModalMessageBox+0x757
0018dcb8 755efc65 0018dcd0 00000000 755efbd1 user32!MessageBoxWorker+0x269
0018dd38 729af829 0018dd50 0010193a 0010193a user32!MessageBoxIndirectA+0x94
0018dd78 729af6a5 0018ddbc 00000000 00000000 msvbvm60!VBMessageBox2+0x92
0018dda0 729af9a0 729af7ce 0018ddbc 0018ddbc msvbvm60!MessageBoxPVoid+0x4b
0018ddd0 729a3d68 00000000 12aa8ef8 0018ddf8 msvbvm60!DlgEnableModeless+0x5e
0018de34 729a3db6 032807d4 002308e4 00000030 msvbvm60!_Scanint+0x13
0018de54 72a0c411 174be0e4 00000000 00000030 msvbvm60!RefMemberIDFromHxmod+0x39
0018de70 72a0c6f3 174be0e4 00000000 00000030 msvbvm60!EbShowError+0x3
0018de94 72a2497c 010831b8 00000000 00000000 msvbvm60!GetErrMsg+0x90
0018deb0 770fb6ad 0018df9c 00000000 0018dfec msvbvm60!SehUpdateStack+0x29
0018ded4 770fb67f 0018df9c 0018f6f8 0018dfec ntdll!ExecuteHandler2+0x26
0018def8 770fb620 0018df9c 0018f6f8 0018dfec ntdll!ExecuteHandler+0x24
0018df84 770b0163 0018df9c 0018dfec 0018df9c ntdll!RtlDispatchException+0x127
0018df84 74f3c42d 0018df9c 0018dfec 0018df9c ntdll!KiUserExceptionDispatcher+0xf
0018e4a0 72a10dcf c000008f 00000001 00000002 KERNELBASE!RaiseException+0x58
0018e4c0 72a0e228 010831b8 800a0061 0018e584 msvbvm60!CEnumConPnts::QueryInterface+0x34
0018e4d4 72a0e28c 010831b8 00000000 00000000 msvbvm60!BasicExcepDeferredFillIn+0x65
0018e4e4 72a0be99 00000061 11035a85 00000000 msvbvm60!BasicExcepDeferredFillIn+0xd2
00000000 00000000 00000000 00000000 00000000 msvbvm60!ValidateArray+0xb4
!runaway proves that this is indeed the hung thread.
0:000> !runaway
User Mode Time
Thread Time
0:ca8 0 days 0:01:00.325
8:13a4 0 days 0:00:00.171
6:10b4 0 days 0:00:00.062
10:1554 0 days 0:00:00.031
19:1598 0 days 0:00:00.000
18:a88 0 days 0:00:00.000
17:7b0 0 days 0:00:00.000
16:ba0 0 days 0:00:00.000
15:770 0 days 0:00:00.000
14:103c 0 days 0:00:00.000
13:16bc 0 days 0:00:00.000
12:17e4 0 days 0:00:00.000
11:1160 0 days 0:00:00.000
9:1194 0 days 0:00:00.000
7:dc8 0 days 0:00:00.000
5:1510 0 days 0:00:00.000
4:af0 0 days 0:00:00.000
3:e5c 0 days 0:00:00.000
2:10f4 0 days 0:00:00.000
1:ff8 0 days 0:00:00.000
!analyze -hang -v produces the following:
0:000> !analyze -hang -v
*******************************************************************************
* *
* Exception Analysis *
* *
*******************************************************************************
*** WARNING: Unable to verify checksum for mscorlib.ni.dll
GetUrlPageData2 (WinHttp) failed: 12152.
FAULTING_IP:
+0
00000000 ?? ???
EXCEPTION_RECORD: ffffffff -- (.exr 0xffffffffffffffff)
ExceptionAddress: 00000000
ExceptionCode: 80000003 (Break instruction exception)
ExceptionFlags: 00000000
NumberParameters: 0
CONTEXT: 00000000 -- (.cxr 0x0;r)
eax=00000001 ebx=00000000 ecx=00000000 edx=00000000 esi=0018dcd0 edi=00260f22
eip=755a218a esp=0018d788 ebp=0018d7a0 iopl=0 nv up ei pl zr na pe nc
cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00200246
user32!NtUserSetFocus+0x15:
755a218a 83c404 add esp,4
FAULTING_THREAD: 00000000
BUGCHECK_STR: HANG
DEFAULT_BUCKET_ID: APPLICATION_HANG
PROCESS_NAME: OurProcess.exe
ERROR_CODE: (NTSTATUS) 0xcfffffff - <Unable to get error code text>
EXCEPTION_CODE: (NTSTATUS) 0xcfffffff - <Unable to get error code text>
NTGLOBALFLAG: 0
APPLICATION_VERIFIER_FLAGS: 0
APP: OurProcess.exe
ANALYSIS_VERSION: 6.3.9600.16384 (debuggers(dbg).130821-1623) x86fre
MANAGED_STACK: !dumpstack -EE
OS Thread Id: 0xca8 (0)
Current frame:
ChildEBP RetAddr Caller, Callee
DERIVED_WAIT_CHAIN:
Dl Eid Cid WaitType
-- --- ------- --------------------------
0 758.ca8 Unknown
WAIT_CHAIN_COMMAND: ~0s;k;;
BLOCKING_THREAD: 00000ca8
PRIMARY_PROBLEM_CLASS: APPLICATION_HANG
LAST_CONTROL_TRANSFER: from 755eee3e to 755a218a
STACK_TEXT:
0018d788 755eee3e 002609ac 00000001 755eed34 user32!NtUserSetFocus+0x15
0018d7a0 755962fa 00260f22 00000110 002609ac user32!MB_DlgProc+0x10a
0018d7cc 755bf9df 755eed34 00260f22 00000110 user32!InternalCallWinProc+0x23
0018d848 755bf784 00000000 755eed34 00260f22 user32!UserCallDlgProcCheckWow+0xd7
0018d898 755bf889 0160cf70 00000000 00000110 user32!DefDlgProcWorker+0xb7
0018d8b8 755962fa 00260f22 00000110 002609ac user32!DefDlgProcW+0x29
0018d8e4 75596d3a 755bf860 00260f22 00000110 user32!InternalCallWinProc+0x23
0018d95c 7559965e 00000000 76ee3d54 00260f22 user32!UserCallWinProcCheckWow+0x109
0018d9a0 755c206f 0160cf70 00000000 76ee3d54 user32!SendMessageWorker+0x581
0018da74 755bcf4b 75580000 00000008 00000000 user32!InternalCreateDialog+0xb9f
0018daac 755ef73c 75580000 1736f6a8 0010193a user32!InternalDialogBox+0xc1
0018db60 755efa18 00000030 ffffffff ffff0000 user32!SoftModalMessageBox+0x757
0018dcb8 755efc65 0018dcd0 00000000 755efbd1 user32!MessageBoxWorker+0x269
0018dd38 729af829 0018dd50 0010193a 0010193a user32!MessageBoxIndirectA+0x94
0018dd78 729af6a5 0018ddbc 00000000 00000000 msvbvm60!VBMessageBox2+0x92
0018dda0 729af9a0 729af7ce 0018ddbc 0018ddbc msvbvm60!MessageBoxPVoid+0x4b
0018ddd0 729a3d68 00000000 12aa8ef8 0018ddf8 msvbvm60!DlgEnableModeless+0x5e
0018de34 729a3db6 032807d4 002308e4 00000030 msvbvm60!_Scanint+0x13
0018de54 72a0c411 174be0e4 00000000 00000030 msvbvm60!RefMemberIDFromHxmod+0x39
0018de70 72a0c6f3 174be0e4 00000000 00000030 msvbvm60!EbShowError+0x3
0018de94 72a2497c 010831b8 00000000 00000000 msvbvm60!GetErrMsg+0x90
0018deb0 770fb6ad 0018df9c 00000000 0018dfec msvbvm60!SehUpdateStack+0x29
0018ded4 770fb67f 0018df9c 0018f6f8 0018dfec ntdll!ExecuteHandler2+0x26
0018def8 770fb620 0018df9c 0018f6f8 0018dfec ntdll!ExecuteHandler+0x24
0018df84 770b0163 0018df9c 0018dfec 0018df9c ntdll!RtlDispatchException+0x127
0018df84 74f3c42d 0018df9c 0018dfec 0018df9c ntdll!KiUserExceptionDispatcher+0xf
0018e4a0 72a10dcf c000008f 00000001 00000002 KERNELBASE!RaiseException+0x58
0018e4c0 72a0e228 010831b8 800a0061 0018e584 msvbvm60!CEnumConPnts::QueryInterface+0x34
0018e4d4 72a0e28c 010831b8 00000000 00000000 msvbvm60!BasicExcepDeferredFillIn+0x65
0018e4e4 72a0be99 00000061 11035a85 00000000 msvbvm60!BasicExcepDeferredFillIn+0xd2
00000000 00000000 00000000 00000000 00000000 msvbvm60!ValidateArray+0xb4
FOLLOWUP_IP:
msvbvm60!VBMessageBox2+92
729af829 8bd8 mov ebx,eax
SYMBOL_STACK_INDEX: e
SYMBOL_NAME: msvbvm60!VBMessageBox2+92
FOLLOWUP_NAME: MachineOwner
MODULE_NAME: msvbvm60
IMAGE_NAME: msvbvm60.dll
DEBUG_FLR_IMAGE_TIMESTAMP: 4a5bda6c
STACK_COMMAND: ~0s ; kb
BUCKET_ID: HANG_msvbvm60!VBMessageBox2+92
FAILURE_BUCKET_ID: APPLICATION_HANG_cfffffff_msvbvm60.dll!VBMessageBox2
ANALYSIS_SOURCE: UM
FAILURE_ID_HASH_STRING: um:application_hang_cfffffff_msvbvm60.dll!vbmessagebox2
FAILURE_ID_HASH: {e6dc63dc-251f-a6d5-c66e-f5e07e418955}
Followup: MachineOwner
---------
Firstly I'd find out what it's doing. When it hangs get a couple of crash dumps and compare the stacks to find out where exactly it's spinning. Also some of the symbols have large offsets (user32!InternalCreateDialog+0xb9f), are you using a symbol server?

Any thoughs on crashes like this with fiware-orion on CoreOS + Docker?

Context Broker Orion crashes in my Cloud + CoreOS + Docker architecture, by using a centos6 based dockerfile definition and the latest rpm compilation provided.
Any thoughts on crashes like the one I paste here? After 20/30 ContextUpdates it stops. Actually, cygnus and proton are subscribed.
DEBUG#11:34:05 httpRequestSend.cpp[409]: Sending message 114 to HTTP server: sending message of 649 bytes to HTTP server
INFO#11:34:05 MongoCommonUpdate.cpp[960]: Database Operation Successful (update: { $set: { lastNotification: 1434022445 }, $inc: { count: 1 } }, query: { _id: ObjectId('55795ab89b16d6c37d911b90') })
DEBUG#11:34:05 MongoCommonUpdate.cpp[925]: blocked due to throttling, current time is:
DEBUG#11:34:05 MongoCommonUpdate.cpp[1941]: Docs found: 1
DEBUG#11:34:05 sem.cpp[255]: mongoUpdateContext gives the 'req' semaphore for 'ngsi10 update request'
DEBUG#11:34:05 restReply.cpp[67]: Response 95: responding with 734 bytes, Status Code 200
DEBUG#11:34:05 restReply.cpp[68]: Response payload: '{
"contextResponses" : [
{
"contextElement" : {
"type" : "Node",
"isPattern" : "false",
"id" : "XXXXXXXXXXXXXX",
"attributes" : [
{
"name" : "TimeInstant",
"type" : "",
"value" : ""
},
{
"name" : "batteryCharge",
"type" : "",
"value" : ""
},
{
"name" : "rows",
"type" : "",
"value" : ""
},
{
"name" : "columns",
"type" : "",
"value" : ""
}
]
},
"statusCode" : {
"code" : "200",
"reasonPhrase" : "OK"
}
}
]
}
'
DEBUG#11:34:05 UpdateContextResponse.cpp[74]: destroyed
DEBUG#11:34:05 RegisterContextResponse.cpp[56]: destroyed
INFO#11:34:05 rest.cpp[384]: Transaction ended
INFO#11:34:05 httpRequestSend.cpp[424]: Notification Successfully Sent to node-2:5050/notify
INFO#11:34:05 httpRequestSend.cpp[435]: Transaction ended
*** longjmp causes uninitialized stack frame ***: /usr/bin/contextBroker terminated
======= Backtrace: =========
/lib64/libc.so.6(__fortify_fail+0x37)[0x7ff44c9e4527]
/lib64/libc.so.6(+0x1024b9)[0x7ff44c9e44b9]
/lib64/libc.so.6(__longjmp_chk+0x33)[0x7ff44c9e4423]
/usr/lib64/libcurl.so.4(+0xee55)[0x7ff44df5be55]
/lib64/libc.so.6(+0x326a0)[0x7ff44c9146a0]
/lib64/libc.so.6(nanosleep+0x2d)[0x7ff44c98ea3d]
/lib64/libc.so.6(sleep+0xe0)[0x7ff44c98e8b0]
/usr/bin/contextBroker(main+0x90a)[0x49e5da]
/lib64/libc.so.6(__libc_start_main+0xfd)[0x7ff44c900d5d]
/usr/bin/contextBroker[0x483219]
======= Memory map: ========
00400000-00737000 r-xp 00000000 08:09 2107197 /usr/bin/contextBroker
00937000-00941000 rw-p 00337000 08:09 2107197 /usr/bin/contextBroker
00941000-00989000 rw-p 00000000 00:00 0
018c0000-01923000 rw-p 00000000 00:00 0 [heap]
7ff428000000-7ff428029000 rw-p 00000000 00:00 0
7ff428029000-7ff42c000000 ---p 00000000 00:00 0
7ff42f7ff000-7ff42f800000 ---p 00000000 00:00 0
7ff42f800000-7ff430000000 rw-p 00000000 00:00 0
7ff430000000-7ff430021000 rw-p 00000000 00:00 0
7ff430021000-7ff434000000 ---p 00000000 00:00 0
7ff434000000-7ff434029000 rw-p 00000000 00:00 0
7ff434029000-7ff438000000 ---p 00000000 00:00 0
7ff438000000-7ff440000000 rw-p 00000000 00:00 0
7ff440000000-7ff440021000 rw-p 00000000 00:00 0
7ff440021000-7ff444000000 ---p 00000000 00:00 0
7ff444418000-7ff444419000 ---p 00000000 00:00 0
7ff444419000-7ff444c19000 rw-p 00000000 00:00 0
7ff444c19000-7ff444c1a000 ---p 00000000 00:00 0
7ff444c1a000-7ff44541a000 rw-p 00000000 00:00 0
7ff44541a000-7ff44541b000 ---p 00000000 00:00 0
7ff44541b000-7ff445c1b000 rw-p 00000000 00:00 0 [stack:20]
7ff445c1b000-7ff445c1c000 ---p 00000000 00:00 0
7ff445c1c000-7ff44641c000 rw-p 00000000 00:00 0 [stack:19]
7ff44641c000-7ff446421000 r-xp 00000000 08:09 5529 /lib64/libnss_dns-2.12.so
7ff446421000-7ff446620000 ---p 00005000 08:09 5529 /lib64/libnss_dns-2.12.so
7ff446620000-7ff446621000 r--p 00004000 08:09 5529 /lib64/libnss_dns-2.12.so
7ff446621000-7ff446622000 rw-p 00005000 08:09 5529 /lib64/libnss_dns-2.12.so
7ff446622000-7ff44662e000 r-xp 00000000 08:09 5531 /lib64/libnss_files-2.12.so
7ff44662e000-7ff44682e000 ---p 0000c000 08:09 5531 /lib64/libnss_files-2.12.so
7ff44682e000-7ff44682f000 r--p 0000c000 08:09 5531 /lib64/libnss_files-2.12.so
7ff44682f000-7ff446830000 rw-p 0000d000 08:09 5531 /lib64/libnss_files-2.12.so
7ff446830000-7ff446832000 r-xp 00000000 08:09 5455 /lib64/libfreebl3.so
7ff446832000-7ff446a31000 ---p 00002000 08:09 5455 /lib64/libfreebl3.so
7ff446a31000-7ff446a32000 r--p 00001000 08:09 5455 /lib64/libfreebl3.so
7ff446a32000-7ff446a33000 rw-p 00002000 08:09 5455 /lib64/libfreebl3.so
7ff446a33000-7ff446a50000 r-xp 00000000 08:09 5560 /lib64/libselinux.so.1
7ff446a50000-7ff446c4f000 ---p 0001d000 08:09 5560 /lib64/libselinux.so.1
7ff446c4f000-7ff446c50000 r--p 0001c000 08:09 5560 /lib64/libselinux.so.1
7ff446c50000-7ff446c51000 rw-p 0001d000 08:09 5560 /lib64/libselinux.so.1
7ff446c51000-7ff446c52000 rw-p 00000000 00:00 0
7ff446c52000-7ff446c59000 r-xp 00000000 08:09 5445 /lib64/libcrypt-2.12.so
7ff446c59000-7ff446e59000 ---p 00007000 08:09 5445 /lib64/libcrypt-2.12.so
7ff446e59000-7ff446e5a000 r--p 00007000 08:09 5445 /lib64/libcrypt-2.12.so
7ff446e5a000-7ff446e5b000 rw-p 00008000 08:09 5445 /lib64/libcrypt-2.12.so
7ff446e5b000-7ff446e89000 rw-p 00000000 00:00 0
7ff446e89000-7ff447dce000 r-xp 00000000 08:09 2107212 /usr/lib64/libicudata.so.42.1
7ff447dce000-7ff447fcd000 ---p 00f45000 08:09 2107212 /usr/lib64/libicudata.so.42.1
7ff447fcd000-7ff447fce000 rw-p 00f44000 08:09 2107212 /usr/lib64/libicudata.so.42.1
7ff447fce000-7ff447fde000 r-xp 00000000 08:09 6734 /usr/lib64/libtasn1.so.3.1.6
7ff447fde000-7ff4481dd000 ---p 00010000 08:09 6734 /usr/lib64/libtasn1.so.3.1.6
7ff4481dd000-7ff4481de000 rw-p 0000f000 08:09 6734 /usr/lib64/libtasn1.so.3.1.6
7ff4481de000-7ff448397000 r-xp 00000000 08:09 6626 /usr/lib64/libcrypto.so.1.0.1e
7ff448397000-7ff448596000 ---p 001b9000 08:09 6626 /usr/lib64/libcrypto.so.1.0.1e
7ff448596000-7ff4485b1000 r--p 001b8000 08:09 6626 /usr/lib64/libcrypto.so.1.0.1e
7ff4485b1000-7ff4485bd000 rw-p 001d3000 08:09 6626 /usr/lib64/libcrypto.so.1.0.1e
7ff4485bd000-7ff4485c1000 rw-p 00000000 00:00 0
7ff4485c1000-7ff448623000 r-xp 00000000 08:09 6728 /usr/lib64/libssl.so.1.0.1e
7ff448623000-7ff448822000 ---p 00062000 08:09 6728 /usr/lib64/libssl.so.1.0.1e
7ff448822000-7ff448826000 r--p 00061000 08:09 6728 /usr/lib64/libssl.so.1.0.1e
7ff448826000-7ff44882d000 rw-p 00065000 08:09 6728 /usr/lib64/libssl.so.1.0.1e
7ff44882d000-7ff44882f000 r-xp 00000000 08:09 5499 /lib64/libkeyutils.so.1.3
7ff44882f000-7ff448a2e000 ---p 00002000 08:09 5499 /lib64/libkeyutils.so.1.3
7ff448a2e000-7ff448a2f000 r--p 00001000 08:09 5499 /lib64/libkeyutils.so.1.3
7ff448a2f000-7ff448a30000 rw-p 00002000 08:09 5499 /lib64/libkeyutils.so.1.3
7ff448a30000-7ff448a3a000 r-xp 00000000 08:09 5503 /lib64/libkrb5support.so.0.1
7ff448a3a000-7ff448c39000 ---p 0000a000 08:09 5503 /lib64/libkrb5support.so.0.1
7ff448c39000-7ff448c3a000 r--p 00009000 08:09 5503 /lib64/libkrb5support.so.0.1
7ff448c3a000-7ff448c3b000 rw-p 0000a000 08:09 5503 /lib64/libkrb5support.so.0.1
7ff448c3b000-7ff448c54000 r-xp 00000000 08:09 6720 /usr/lib64/libsasl2.so.2.0.23
7ff448c54000-7ff448e53000 ---p 00019000 08:09 6720 /usr/lib64/libsasl2.so.2.0.23
7ff448e53000-7ff448e54000 r--p 00018000 08:09 6720 /usr/lib64/libsasl2.so.2.0.23
7ff448e54000-7ff448e55000 rw-p 00019000 08:09 6720 /usr/lib64/libsasl2.so.2.0.23
7ff448e55000-7ff448e6b000 r-xp 00000000 08:09 5556 /lib64/libresolv-2.12.so
7ff448e6b000-7ff44906b000 ---p 00016000 08:09 5556 /lib64/libresolv-2.12.so
7ff44906b000-7ff44906c000 r--p 00016000 08:09 5556 /lib64/libresolv-2.12.so
7ff44906c000-7ff44906d000 rw-p 00017000 08:09 5556 /lib64/libresolv-2.12.so
7ff44906d000-7ff44906f000 rw-p 00000000 00:00 0
7ff44906f000-7ff44907d000 r-xp 00000000 08:09 5505 /lib64/liblber-2.4.so.2.10.2
7ff44907d000-7ff44927c000 ---p 0000e000 08:09 5505 /lib64/liblber-2.4.so.2.10.2
7ff44927c000-7ff44927d000 r--p 0000d000 08:09 5505 /lib64/liblber-2.4.so.2.10.2
7ff44927d000-7ff44927e000 rw-p 0000e000 08:09 5505 /lib64/liblber-2.4.so.2.10.2
7ff44927e000-7ff449406000 r-xp 00000000 08:09 2107220 /usr/lib64/libicui18n.so.42.1
7ff449406000-7ff449606000 ---p 00188000 08:09 2107220 /usr/lib64/libicui18n.so.42.1
7ff449606000-7ff449613000 rw-p 00188000 08:09 2107220 /usr/lib64/libicui18n.so.42.1
7ff449613000-7ff449614000 rw-p 00000000 00:00 0
7ff449614000-7ff449753000 r-xp 00000000 08:09 2107200 /usr/lib64/libicuuc.so.42.1
7ff449753000-7ff449953000 ---p 0013f000 08:09 2107200 /usr/lib64/libicuuc.so.42.1
7ff449953000-7ff449964000 rw-p 0013f000 08:09 2107200 /usr/lib64/libicuuc.so.42.1
7ff449964000-7ff449966000 rw-p 00000000 00:00 0
7ff449966000-7ff449969000 r-xp 00000000 08:09 5471 /lib64/libgpg-error.so.0.5.0
7ff449969000-7ff449b68000 ---p 00003000 08:09 5471 /lib64/libgpg-error.so.0.5.0
7ff449b68000-7ff449b69000 r--p 00002000 08:09 5471 /lib64/libgpg-error.so.0.5.0
7ff449b69000-7ff449b6a000 rw-p 00003000 08:09 5471 /lib64/libgpg-error.so.0.5.0
7ff449b6a000-7ff449bdc000 r-xp 00000000 08:09 5461 /lib64/libgcrypt.so.11.5.3
7ff449bdc000-7ff449ddb000 ---p 00072000 08:09 5461 /lib64/libgcrypt.so.11.5.3
7ff449ddb000-7ff449ddc000 r--p 00071000 08:09 5461 /lib64/libgcrypt.so.11.5.3
7ff449ddc000-7ff449ddf000 rw-p 00072000 08:09 5461 /lib64/libgcrypt.so.11.5.3
7ff449ddf000-7ff449e7b000 r-xp 00000000 08:09 2107217 /usr/lib64/libgnutls.so.26.14.12
7ff449e7b000-7ff44a07b000 ---p 0009c000 08:09 2107217 /usr/lib64/libgnutls.so.26.14.12
7ff44a07b000-7ff44a082000 rw-p 0009c000 08:09 2107217 /usr/lib64/libgnutls.so.26.14.12
7ff44a082000-7ff44a0a9000 r-xp 00000000 08:09 6727 /usr/lib64/libssh2.so.1.0.1
7ff44a0a9000-7ff44a2a8000 ---p 00027000 08:09 6727 /usr/lib64/libssh2.so.1.0.1
7ff44a2a8000-7ff44a2aa000 rw-p 00026000 08:09 6727 /usr/lib64/libssh2.so.1.0.1
7ff44a2aa000-7ff44a2ac000 r-xp 00000000 08:09 5450 /lib64/libdl-2.12.so
7ff44a2ac000-7ff44a4ac000 ---p 00002000 08:09 5450 /lib64/libdl-2.12.so
7ff44a4ac000-7ff44a4ad000 r--p 00002000 08:09 5450 /lib64/libdl-2.12.so
7ff44a4ad000-7ff44a4ae000 rw-p 00003000 08:09 5450 /lib64/libdl-2.12.so
7ff44a4ae000-7ff44a4e7000 r-xp 00000000 08:09 5526 /lib64/libnspr4.so
7ff44a4e7000-7ff44a6e7000 ---p 00039000 08:09 5526 /lib64/libnspr4.so
7ff44a6e7000-7ff44a6e8000 r--p 00039000 08:09 5526 /lib64/libnspr4.so
7ff44a6e8000-7ff44a6ea000 rw-p 0003a000 08:09 5526 /lib64/libnspr4.so
7ff44a6ea000-7ff44a6ec000 rw-p 00000000 00:00 0
7ff44a6ec000-7ff44a6f0000 r-xp 00000000 08:09 5547 /lib64/libplc4.so
7ff44a6f0000-7ff44a8ef000 ---p 00004000 08:09 5547 /lib64/libplc4.so
7ff44a8ef000-7ff44a8f0000 r--p 00003000 08:09 5547 /lib64/libplc4.so
7ff44a8f0000-7ff44a8f1000 rw-p 00004000 08:09 5547 /lib64/libplc4.so
7ff44a8f1000-7ff44a8f4000 r-xp 00000000 08:09 5548 /lib64/libplds4.so
7ff44a8f4000-7ff44aaf3000 ---p 00003000 08:09 5548 /lib64/libplds4.so
7ff44aaf3000-7ff44aaf4000 r--p 00002000 08:09 5548 /lib64/libplds4.so
7ff44aaf4000-7ff44aaf5000 rw-p 00003000 08:09 5548 /lib64/libplds4.so
7ff44aaf5000-7ff44ab1a000 r-xp 00000000 08:09 6697 /usr/lib64/libnssutil3.so
7ff44ab1a000-7ff44ad1a000 ---p 00025000 08:09 6697 /usr/lib64/libnssutil3.so
7ff44ad1a000-7ff44ad20000 r--p 00025000 08:09 6697 /usr/lib64/libnssutil3.so
7ff44ad20000-7ff44ad21000 rw-p 0002b000 08:09 6697 /usr/lib64/libnssutil3.so
7ff44ad21000-7ff44ae58000 r-xp 00000000 08:09 6691 /usr/lib64/libnss3.so
7ff44ae58000-7ff44b057000 ---p 00137000 08:09 6691 /usr/lib64/libnss3.so
7ff44b057000-7ff44b05c000 r--p 00136000 08:09 6691 /usr/lib64/libnss3.so
7ff44b05c000-7ff44b05e000 rw-p 0013b000 08:09 6691 /usr/lib64/libnss3.so
7ff44b05e000-7ff44b060000 rw-p 00000000 00:00 0
7ff44b060000-7ff44b088000 r-xp 00000000 08:09 6721 /usr/lib64/libsmime3.so
7ff44b088000-7ff44b287000 ---p 00028000 08:09 6721 /usr/lib64/libsmime3.so
7ff44b287000-7ff44b28b000 r--p 00027000 08:09 6721 /usr/lib64/libsmime3.so
7ff44b28b000-7ff44b28c000 rw-p 0002b000 08:09 6721 /usr/lib64/libsmime3.so
7ff44b28c000-7ff44b2c7000 r-xp 00000000 08:09 6730 /usr/lib64/libssl3.so
7ff44b2c7000-7ff44b4c6000 ---p 0003b000 08:09 6730 /usr/lib64/libssl3.so
7ff44b4c6000-7ff44b4c9000 r--p 0003a000 08:09 6730 /usr/lib64/libssl3.so
7ff44b4c9000-7ff44b4ca000 rw-p 0003d000 08:09 6730 /usr/lib64/libssl3.so
7ff44b4ca000-7ff44b4cb000 rw-p 00000000 00:00 0
7ff44b4cb000-7ff44b4e0000 r-xp 00000000 08:09 5576 /lib64/libz.so.1.2.3
7ff44b4e0000-7ff44b6df000 ---p 00015000 08:09 5576 /lib64/libz.so.1.2.3
7ff44b6df000-7ff44b6e0000 r--p 00014000 08:09 5576 /lib64/libz.so.1.2.3
7ff44b6e0000-7ff44b6e1000 rw-p 00015000 08:09 5576 /lib64/libz.so.1.2.3
7ff44b6e1000-7ff44b6e4000 r-xp 00000000 08:09 5444 /lib64/libcom_err.so.2.1
7ff44b6e4000-7ff44b8e3000 ---p 00003000 08:09 5444 /lib64/libcom_err.so.2.1
7ff44b8e3000-7ff44b8e4000 r--p 00002000 08:09 5444 /lib64/libcom_err.so.2.1
7ff44b8e4000-7ff44b8e5000 rw-p 00003000 08:09 5444 /lib64/libcom_err.so.2.1
7ff44b8e5000-7ff44b90e000 r-xp 00000000 08:09 5497 /lib64/libk5crypto.so.3.1
7ff44b90e000-7ff44bb0e000 ---p 00029000 08:09 5497 /lib64/libk5crypto.so.3.1
7ff44bb0e000-7ff44bb0f000 r--p 00029000 08:09 5497 /lib64/libk5crypto.so.3.1
7ff44bb0f000-7ff44bb10000 rw-p 0002a000 08:09 5497 /lib64/libk5crypto.so.3.1
7ff44bb10000-7ff44bb11000 rw-p 00000000 00:00 0
7ff44bb11000-7ff44bbec000 r-xp 00000000 08:09 5501 /lib64/libkrb5.so.3.3
7ff44bbec000-7ff44bdeb000 ---p 000db000 08:09 5501 /lib64/libkrb5.so.3.3
7ff44bdeb000-7ff44bdf5000 r--p 000da000 08:09 5501 /lib64/libkrb5.so.3.3
7ff44bdf5000-7ff44bdf7000 rw-p 000e4000 08:09 5501 /lib64/libkrb5.so.3.3
7ff44bdf7000-7ff44be38000 r-xp 00000000 08:09 5473 /lib64/libgssapi_krb5.so.2.2
7ff44be38000-7ff44c038000 ---p 00041000 08:09 5473 /lib64/libgssapi_krb5.so.2.2
7ff44c038000-7ff44c039000 r--p 00041000 08:09 5473 /lib64/libgssapi_krb5.so.2.2
7ff44c039000-7ff44c03b000 rw-p 00042000 08:09 5473 /lib64/libgssapi_krb5.so.2.2
7ff44c03b000-7ff44c088000 r-xp 00000000 08:09 5507 /lib64/libldap-2.4.so.2.10.2
7ff44c088000-7ff44c287000 ---p 0004d000 08:09 5507 /lib64/libldap-2.4.so.2.10.2
7ff44c287000-7ff44c289000 r--p 0004c000 08:09 5507 /lib64/libldap-2.4.so.2.10.2
7ff44c289000-7ff44c28b000 rw-p 0004e000 08:09 5507 /lib64/libldap-2.4.so.2.10.2
7ff44c28b000-7ff44c2bd000 r-xp 00000000 08:09 5479 /lib64/libidn.so.11.6.1
7ff44c2bd000-7ff44c4bc000 ---p 00032000 08:09 5479 /lib64/libidn.so.11.6.1
7ff44c4bc000-7ff44c4bd000 rw-p 00031000 08:09 5479 /lib64/libidn.so.11.6.1
7ff44c4bd000-7ff44c4d4000 r-xp 00000000 08:09 5552 /lib64/libpthread-2.12.so
7ff44c4d4000-7ff44c6d4000 ---p 00017000 08:09 5552 /lib64/libpthread-2.12.so
7ff44c6d4000-7ff44c6d5000 r--p 00017000 08:09 5552 /lib64/libpthread-2.12.so
7ff44c6d5000-7ff44c6d6000 rw-p 00018000 08:09 5552 /lib64/libpthread-2.12.so
7ff44c6d6000-7ff44c6da000 rw-p 00000000 00:00 0
7ff44c6da000-7ff44c6e1000 r-xp 00000000 08:09 5558 /lib64/librt-2.12.so
7ff44c6e1000-7ff44c8e0000 ---p 00007000 08:09 5558 consumer /lib64/librt-2.12.so
7ff44c8e0000-7ff44c8e1000 r--p 00006000 08:09 5558 /lib64/librt-2.12.so
7ff44c8e1000-7ff44c8e2000 rw-p 00007000 08:09 5558 /lib64/librt-2.12.so
7ff44c8e2000-7ff44ca6c000 r-xp 00000000 08:09 5437 /lib64/libc-2.12.so
7ff44ca6c000-7ff44cc6c000 ---p 0018a000 08:09 5437 /lib64/libc-2.12.so
7ff44cc6c000-7ff44cc70000 r--p 0018a000 08:09 5437 /lib64/libc-2.12.so
7ff44cc70000-7ff44cc71000 rw-p 0018e000 08:09 5437 /lib64/libc-2.12.so
7ff44cc71000-7ff44cc76000 rw-p 00000000 00:00 0
7ff44cc76000-7ff44cc8c000 r-xp 00000000 08:09 5458 /lib64/libgcc_s-4.4.7-20120601.so.1
7ff44cc8c000-7ff44ce8b000 ---p 00016000 08:09 5458 /lib64/libgcc_s-4.4.7-20120601.so.1
7ff44ce8b000-7ff44ce8c000 rw-p 00015000 08:09 5458 /lib64/libgcc_s-4.4.7-20120601.so.1
7ff44ce8c000-7ff44cf0f000 r-xp 00000000 08:09 5512 /lib64/libm-2.12.so
7ff44cf0f000-7ff44d10e000 ---p 00083000 08:09 5512 /lib64/libm-2.12.so
7ff44d10e000-7ff44d10f000 r--p 00082000 08:09 5512 /lib64/libm-2.12.so
7ff44d10f000-7ff44d110000 rw-p 00083000 08:09 5512 /lib64/libm-2.12.so
7ff44d110000-7ff44d1f8000 r-xp 00000000 08:09 6732 /usr/lib64/libstdc++.so.6.0.13
7ff44d1f8000-7ff44d3f8000 ---p 000e8000 08:09 6732 /usr/lib64/libstdc++.so.6.0.13
7ff44d3f8000-7ff44d3ff000 r--p 000e8000 08:09 6732 /usr/lib64/libstdc++.so.6.0.13
7ff44d3ff000-7ff44d401000 rw-p 000ef000 08:09 6732 /usr/lib64/libstdc++.so.6.0.13
7ff44d401000-7ff44d416000 rw-p 00000000 00:00 0
7ff44d416000-7ff44d504000 r-xp 00000000 08:09 2107203 /usr/lib64/libboost_regex-mt.so.5
7ff44d504000-7ff44d703000 ---p 000ee000 08:09 2107203 /usr/lib64/libboost_regex-mt.so.5
7ff44d703000-7ff44d70a000 rw-p 000ed000 08:09 2107203 /usr/lib64/libboost_regex-mt.so.5
7ff44d70a000-7ff44d70d000 r-xp 00000000 08:09 2107218 /usr/lib64/libboost_system-mt.so.5
7ff44d70d000-7ff44d90c000 ---p 00003000 08:09 2107218 /usr/lib64/libboost_system-mt.so.5
7ff44d90c000-7ff44d90d000 rw-p 00002000 08:09 2107218 /usr/lib64/libboost_system-mt.so.5
7ff44d90d000-7ff44d921000 r-xp 00000000 08:09 2107225 /usr/lib64/libboost_filesystem-mt.so.5
7ff44d921000-7ff44db21000 ---p 00014000 08:09 2107225 /usr/lib64/libboost_filesystem-mt.so.5
7ff44db21000-7ff44db22000 rw-p 00014000 08:09 2107225 /usr/lib64/libboost_filesystem-mt.so.5
7ff44db22000-7ff44db35000 r-xp 00000000 08:09 2107211 /usr/lib64/libboost_thread-mt.so.5
7ff44db35000-7ff44dd35000 ---p 00013000 08:09 2107211 /usr/lib64/libboost_thread-mt.so.5
7ff44dd35000-7ff44dd37000 rw-p 00013000 08:09 2107211 /usr/lib64/libboost_thread-mt.so.5
7ff44dd37000-7ff44dd4d000 r-xp 00000000 08:09 2107214 /usr/lib64/libmicrohttpd.so.10.22.0
7ff44dd4d000-7ff44df4c000 ---p 00016000 08:09 2107214 /usr/lib64/libmicrohttpd.so.10.22.0
7ff44df4c000-7ff44df4d000 rw-p 00015000 08:09 2107214 /usr/lib64/libmicrohttpd.so.10.22.0
7ff44df4d000-7ff44df9f000 r-xp 00000000 08:09 6629 /usr/lib64/libcurl.so.4.1.1
7ff44df9f000-7ff44e19e000 ---p 00052000 08:09 6629 /usr/lib64/libcurl.so.4.1.1
7ff44e19e000-7ff44e1a1000 rw-p 00051000 08:09 6629 /usr/lib64/libcurl.so.4.1.1
7ff44e1a1000-7ff44e1c1000 r-xp 00000000 08:09 5418 /lib64/ld-2.12.so
7ff44e396000-7ff44e3bb000 rw-p 00000000 00:00 0
7ff44e3bd000-7ff44e3c0000 rw-p 00000000 00:00 0
7ff44e3c0000-7ff44e3c1000 r--p 0001f000 08:09 5418 /lib64/ld-2.12.so
7ff44e3c1000-7ff44e3c2000 rw-p 00020000 08:09 5418 /lib64/ld-2.12.so
7ff44e3c2000-7ff44e3c3000 rw-p 00000000 00:00 0
7ffe2a0c0000-7ffe2a0e1000 rw-p 00000000 00:00 0 [stack]
7ffe2a1b8000-7ffe2a1ba000 r--p 00000000 00:00 0 [vvar]
7ffe2a1ba000-7ffe2a1bc000 r-xp 00000000 00:00 0 [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]
1 ContextElements
It seems that it does not crash without this subscriptions.
thanks!
I think that what made it crash was a ContextUpdate from CEP:Proton, or at least its relation with, which has Orion as consumer. It sent following XML on http://node-1:1026/v1/updateContext
<?xml version="1.0" encoding="UTF-8"?>
<updateContextRequest>
<contextElementList>
<contextElement>
<entityId type="Node" isPattern="false">
<id>XXXXXXXXXXXXXX</id>
</entityId>
<contextAttributeList>
<contextAttribute>
<name>Latitud</name>
<contextValue>0.0</contextValue>
</contextAttribute>
<contextAttribute>
<name>EventId</name>
<contextValue>afb3e832-6253-4816-ad31-62df35550e1b</contextValue>
</contextAttribute>
<contextAttribute>
<name>Longitud</name>
<contextValue>0.0</contextValue>
</contextAttribute>
<contextAttribute>
<name>DetectionTime</name>
<contextValue>2015-06-11T13:34:43.53000UTC</contextValue>
</contextAttribute>
<contextAttribute>
<name>Cost</name>
<contextValue>0.0</contextValue>
</contextAttribute>
<contextAttribute>
<name>Certainty</name>
<contextValue>1</contextValue>
</contextAttribute>
<contextAttribute>
<name>Name</name>
<contextValue>NodeContextUpdate</contextValue>
</contextAttribute>
<contextAttribute>
<name>presence</name>
<contextValue>0</contextValue>
</contextAttribute>
<contextAttribute>
<name>illuminance</name>
<contextValue>0.0</contextValue>
</contextAttribute>
<contextAttribute>
<name>Duration</name>
<contextValue>0</contextValue>
</contextAttribute>
<contextAttribute>
<name>batteryCharge</name>
<contextValue>67</contextValue>
</contextAttribute>
</contextAttributeList>
</contextElement>
</contextElementList>
<updateAction>UPDATE</updateAction>
</updateContextRequest>
Removing Proton subscription, Orion remains stable.
The fact is that when I manually send it it works.
The "longjmp causes uninitialized stack frame" is related with a bug recently discovered in Orion 0.22.0. We plan to solve that bug for Orion 0.23.0 but while the fix comes, the workaround is to use directly IP addresses in reference field at subscribeContext.
EDIT: the bug has been already fixed in the develop branch, so it will be available on next Orion version (i.e. 0.23.0).

Perl "glibc detected" or "Segmentation Fault"

Sometimes executing my script gets me a "Segmentation Fault" and sometimes it gets me the output below. Any help would be appreciated? I'm no Perl expert, so please go easy on my coding skills. You can view my code here.
*** glibc detected *** perl: free(): invalid pointer: 0x0000000002982e64 ***
======= Backtrace: =========
/lib64/libc.so.6[0x32eac714af]
/lib64/libc.so.6(cfree+0x4b)[0x32eac757ab]
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so(Perl_sv_clear+0x6d5)[0x3ee4895a05]
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so(Perl_sv_free+0x80)[0x3ee4895b50]
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so(Perl_av_undef+0x60)[0x3ee48895e0]
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so(Perl_sv_clear+0x48c)[0x3ee48957bc]
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so(Perl_sv_free+0x80)[0x3ee4895b50]
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so(Perl_leave_scope+0xc75)[0x3ee48b8ef5]
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so(Perl_pp_leavesub+0x11d)[0x3ee488c41d]
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so(Perl_runops_standard+0xe)[0x3ee488a37e]
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so[0x3ee48bb02a]
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so(Perl_runops_standard+0xe)[0x3ee488a37e]
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so(Perl_call_sv+0x4d6)[0x3ee48375a6]
/home/yostauto/perl5/lib/perl5/x86_64-linux-thread-multi/auto/DBI/DBI.so(XS_DBI_dispatch+0x1f22)[0x7fb85387fc32]
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so(Perl_pp_entersub+0x3f6)[0x3ee4890ad6]
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so(Perl_runops_standard+0xe)[0x3ee488a37e]
/usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so(perl_run+0x11c)[0x3ee4837ecc]
perl(main+0x150)[0x401960]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x32eac1d9f4]
perl[0x401759]
======= Memory map: ========
00400000-00403000 r-xp 00000000 08:04 110043381 /usr/bin/perl
00602000-00604000 rw-p 00002000 08:04 110043381 /usr/bin/perl
00604000-02fc2000 rw-p 00000000 00:00 0 [heap]
30eec00000-30eed2d000 r-xp 00000000 08:04 9224244 /lib64/libcrypto.so.0.9.8e
30eed2d000-30eef2c000 ---p 0012d000 08:04 9224244 /lib64/libcrypto.so.0.9.8e
30eef2c000-30eef4d000 rw-p 0012c000 08:04 9224244 /lib64/libcrypto.so.0.9.8e
30eef4d000-30eef51000 rw-p 00000000 00:00 0
30ef000000-30ef048000 r-xp 00000000 08:04 9224343 /lib64/libssl.so.0.9.8e
30ef048000-30ef248000 ---p 00048000 08:04 9224343 /lib64/libssl.so.0.9.8e
30ef248000-30ef24e000 rw-p 00048000 08:04 9224343 /lib64/libssl.so.0.9.8e
32ea800000-32ea81c000 r-xp 00000000 08:04 9224227 /lib64/ld-2.5.so
32eaa1c000-32eaa1d000 r--p 0001c000 08:04 9224227 /lib64/ld-2.5.so
32eaa1d000-32eaa1e000 rw-p 0001d000 08:04 9224227 /lib64/ld-2.5.so
32eac00000-32ead4f000 r-xp 00000000 08:04 9224334 /lib64/libc-2.5.so
32ead4f000-32eaf4f000 ---p 0014f000 08:04 9224334 /lib64/libc-2.5.so
32eaf4f000-32eaf53000 r--p 0014f000 08:04 9224334 /lib64/libc-2.5.so
32eaf53000-32eaf54000 rw-p 00153000 08:04 9224334 /lib64/libc-2.5.so
32eaf54000-32eaf59000 rw-p 00000000 00:00 0
32eb000000-32eb082000 r-xp 00000000 08:04 9224469 /lib64/libm-2.5.so
32eb082000-32eb281000 ---p 00082000 08:04 9224469 /lib64/libm-2.5.so
32eb281000-32eb282000 r--p 00081000 08:04 9224469 /lib64/libm-2.5.so
32eb282000-32eb283000 rw-p 00082000 08:04 9224469 /lib64/libm-2.5.so
32eb400000-32eb402000 r-xp 00000000 08:04 9224462 /lib64/libdl-2.5.so
32eb402000-32eb602000 ---p 00002000 08:04 9224462 /lib64/libdl-2.5.so
32eb602000-32eb603000 r--p 00002000 08:04 9224462 /lib64/libdl-2.5.so
32eb603000-32eb604000 rw-p 00003000 08:04 9224462 /lib64/libdl-2.5.so
32eb800000-32eb816000 r-xp 00000000 08:04 9224477 /lib64/libpthread-2.5.so
32eb816000-32eba16000 ---p 00016000 08:04 9224477 /lib64/libpthread-2.5.so
32eba16000-32eba17000 r--p 00016000 08:04 9224477 /lib64/libpthread-2.5.so
32eba17000-32eba18000 rw-p 00017000 08:04 9224477 /lib64/libpthread-2.5.so
32eba18000-32eba1c000 rw-p 00000000 00:00 0
32ebc00000-32ebc14000 r-xp 00000000 08:04 9224305 /lib64/libz.so.1.2.3
32ebc14000-32ebe13000 ---p 00014000 08:04 9224305 /lib64/libz.so.1.2.3
32ebe13000-32ebe14000 rw-p 00013000 08:04 9224305 /lib64/libz.so.1.2.3
32ec000000-32ec007000 r-xp 00000000 08:04 9224484 /lib64/librt-2.5.so
32ec007000-32ec207000 ---p 00007000 08:04 9224484 /lib64/librt-2.5.so
32ec207000-32ec208000 r--p 00007000 08:04 9224484 /lib64/librt-2.5.so
32ec208000-32ec209000 rw-p 00008000 08:04 9224484 /lib64/librt-2.5.so
32ec400000-32ec415000 r-xp 00000000 08:04 9224496 /lib64/libselinux.so.1
32ec415000-32ec615000 ---p 00015000 08:04 9224496 /lib64/libselinux.so.1
32ec615000-32ec617000 rw-p 00015000 08:04 9224496 /lib64/libselinux.so.1
32ec617000-32ec618000 rw-p 00000000 00:00 0
32ec800000-32ec83b000 r-xp 00000000 08:04 9224492 /lib64/libsepol.so.1
32ec83b000-32eca3b000 ---p 0003b000 08:04 9224492 /lib64/libsepol.so.1
32eca3b000-32eca3c000 rw-p 0003b000 08:04 9224492 /lib64/libsepol.so.1
32eca3c000-32eca46000 rw-p 00000000 00:00 0
32ecc00000-32ecc0d000 r-xp 00000000 08:04 9224472 /lib64/libgcc_s-4.1.2-20080825.so.1
32ecc0d000-32ece0d000 ---p 0000d000 08:04 9224472 /lib64/libgcc_s-4.1.2-20080825.so.1
32ece0d000-32ece0e000 rw-p 0000d000 08:04 9224472 /lib64/libgcc_s-4.1.2-20080825.so.1
32ed000000-32ed015000 r-xp 00000000 08:04 9224474 /lib64/libnsl-2.5.so
32ed015000-32ed214000 ---p 00015000 08:04 9224474 /lib64/libnsl-2.5.so
32ed214000-32ed215000 r--p 00014000 08:04 9224474 /lib64/libnsl-2.5.so
32ed215000-32ed216000 rw-p 00015000 08:04 9224474 /lib64/libnsl-2.5.so
32ed216000-32ed218000 rw-p 00000000 00:00 0
32ee800000-32ee811000 r-xp 00000000 08:04 9224478 /lib64/libresolv-2.5.so
32ee811000-32eea11000 ---p 00011000 08:04 9224478 /lib64/libresolv-2.5.so
32eea11000-32eea12000 r--p 00011000 08:04 9224478 /lib64/libresolv-2.5.so
32eea12000-32eea13000 rw-p 00012000 08:04 9224478 /lib64/libresolv-2.5.so
32eea13000-32eea15000 rw-p 00000000 00:00 0
32eec00000-32eec09000 r-xp 00000000 08:04 9224480 /lib64/libcrypt-2.5.so
32eec09000-32eee08000 ---p 00009000 08:04 9224480 /lib64/libcrypt-2.5.so
32eee08000-32eee09000 r--p 00008000 08:04 9224480 /lib64/libcrypt-2.5.so
32eee09000-32eee0a000 rw-p 00009000 08:04 9224480 /lib64/libcrypt-2.5.so
32eee0a000-32eee38000 rw-p 00000000 00:00 0
32efc00000-32efc02000 r-xp 00000000 08:04 9224285 /lib64/libkeyutils-1.2.so
32efc02000-32efe01000 ---p 00002000 08:04 9224285 /lib64/libkeyutils-1.2.so
32efe01000-32efe02000 rw-p 00001000 08:04 9224285 /lib64/libkeyutils-1.2.so
32f0000000-32f0002000 r-xp 00000000 08:04 9224499 /lib64/libcom_err.so.2.1
32f0002000-32f0201000 ---p 00002000 08:04 9224499 /lib64/libcom_err.so.2.1
32f0201000-32f0202000 rw-p 00001000 08:04 9224499 /lib64/libcom_err.so.2.1
32f9400000-32f9402000 r-xp 00000000 08:04 9224482 /lib64/libutil-2.5.so
32f9402000-32f9601000 ---p 00002000 08:04 9224482 /lib64/libutil-2.5.so
32f9601000-32f9602000 r--p 00001000 08:04 9224482 /lib64/libutil-2.5.so
32f9602000-32f9603000 rw-p 00002000 08:04 9224482 /lib64/libutil-2.5.so
3ee4800000-3ee492c000 r-xp 00000000 08:04 110405822 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so
3ee492c000-3ee4b2b000 ---p 0012c000 08:04 110405822 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so
3ee4b2b000-3ee4b34000 rw-p 0012b000 08:04 110405822 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/CORE/libperl.so
3ee4b34000-3ee4b36000 rw-p 00000000 00:00 0
3fea800000-3fea891000 r-xp 00000000 08:04 157884806 /usr/lib64/libkrb5.so.3.3
3fea891000-3feaa91000 ---p 00091000 08:04 157884806 /usr/lib64/libkrb5.so.3.3
3feaa91000-3feaa95000 rw-p 00091000 08:04 157884806 /usr/lib64/libkrb5.so.3.3
3feac00000-3feac2c000 r-xp 00000000 08:04 157884807 /usr/lib64/libgssapi_krb5.so.2.2
3feac2c000-3feae2c000 ---p 0002c000 08:04 157884807 /usr/lib64/libgssapi_krb5.so.2.2
3feae2c000-3feae2e000 rw-p 0002c000 08:04 157884807 /usr/lib64/libgssapi_krb5.so.2.2
3feb000000-3feb024000 r-xp 00000000 08:04 157884805 /usr/lib64/libk5crypto.so.3.1
3feb024000-3feb223000 ---p 00024000 08:04 157884805 /usr/lib64/libk5crypto.so.3.1
3feb223000-3feb225000 rw-p 00023000 08:04 157884805 /usr/lib64/libk5crypto.so.3.1
3feb400000-3feb408000 r-xp 00000000 08:04 157884804 /usr/lib64/libkrb5support.so.0.1
3feb408000-3feb607000 ---p 00008000 08:04 157884804 /usr/lib64/libkrb5support.so.0.1
3feb607000-3feb608000 rw-p 00007000 08:04 157884804 /usr/lib64/libkrb5support.so.0.1
7fb851f89000-7fb851fd7000 r-xp 00000000 08:04 110413043 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/Net/SSLeay/SSLeay.so
7fb851fd7000-7fb8521d6000 ---p 0004e000 08:04 110413043 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/Net/SSLeay/SSLeay.so
7fb8521d6000-7fb8521d8000 rw-p 0004d000 08:04 110413043 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/Net/SSLeay/SSLeay.so
7fb8521d8000-7fb8521da000 r-xp 00000000 08:04 110405769 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Cwd/Cwd.so
7fb8521da000-7fb8523da000 ---p 00002000 08:04 110405769 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Cwd/Cwd.so
7fb8523da000-7fb8523db000 rw-p 00002000 08:04 110405769 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Cwd/Cwd.so
7fb8523db000-7fb8523fc000 rw-p 00000000 00:00 0
7fb8523fc000-7fb852402000 r-xp 00000000 08:04 110412622 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Time/HiRes/HiRes.so
7fb852402000-7fb852601000 ---p 00006000 08:04 110412622 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Time/HiRes/HiRes.so
7fb852601000-7fb852602000 rw-p 00005000 08:04 110412622 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Time/HiRes/HiRes.so
7fb852602000-7fb852609000 r-xp 00000000 08:04 110405775 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Data/Dumper/Dumper.so
7fb852609000-7fb852809000 ---p 00007000 08:04 110405775 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Data/Dumper/Dumper.so
7fb852809000-7fb85280a000 rw-p 00007000 08:04 110405775 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Data/Dumper/Dumper.so
7fb85280a000-7fb85280c000 r-xp 00000000 08:04 70410455 /home/yostauto/perl5/lib/perl5/x86_64-linux-thread-multi/auto/Clone/Clone.so
7fb85280c000-7fb852a0c000 ---p 00002000 08:04 70410455 /home/yostauto/perl5/lib/perl5/x86_64-linux-thread-multi/auto/Clone/Clone.so
7fb852a0c000-7fb852a0d000 rw-p 00002000 08:04 70410455 /home/yostauto/perl5/lib/perl5/x86_64-linux-thread-multi/auto/Clone/Clone.so
7fb852a0d000-7fb852a12000 r-xp 00000000 08:04 70410438 /home/yostauto/perl5/lib/perl5/x86_64-linux-thread-multi/auto/Params/Util/Util.so
7fb852a12000-7fb852c11000 ---p 00005000 08:04 70410438 /home/yostauto/perl5/lib/perl5/x86_64-linux-thread-multi/auto/Params/Util/Util.so
7fb852c11000-7fb852c12000 rw-p 00004000 08:04 70410438 /home/yostauto/perl5/lib/perl5/x86_64-linux-thread-multi/auto/Params/Util/Util.so
7fb852c12000-7fb852c30000 r-xp 00000000 08:04 110791534 /usr/lib64/perl5/site_perl/5.8.8/x86_64-linux-thread-multi/auto/Compress/Raw/Zlib/Zlib.so
7fb852c30000-7fb852e30000 ---p 0001e000 08:04 110791534 /usr/lib64/perl5/site_perl/5.8.8/x86_64-linux-thread-multi/auto/Compress/Raw/Zlib/Zlib.so
7fb852e30000-7fb852e31000 rw-p 0001e000 08:04 110791534 /usr/lib64/perl5/site_perl/5.8.8/x86_64-linux-thread-multi/auto/Compress/Raw/Zlib/Zlib.so
7fb852e31000-7fb852e36000 r-xp 00000000 08:04 110414506 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/File/Glob/Glob.so
7fb852e36000-7fb853035000 ---p 00005000 08:04 110414506 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/File/Glob/Glob.so
7fb853035000-7fb853036000 rw-p 00004000 08:04 110414506 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/File/Glob/Glob.so
7fb853036000-7fb85303a000 r-xp 00000000 08:04 9224292 /lib64/libnss_dns-2.5.so
7fb85303a000-7fb853239000 ---p 00004000 08:04 9224292 /lib64/libnss_dns-2.5.so
7fb853239000-7fb85323a000 r--p 00003000 08:04 9224292 /lib64/libnss_dns-2.5.so
7fb85323a000-7fb85323b000 rw-p 00004000 08:04 9224292 /lib64/libnss_dns-2.5.so
7fb85323b000-7fb853245000 r-xp 00000000 08:04 9224294 /lib64/libnss_files-2.5.so
7fb853245000-7fb853444000 ---p 0000a000 08:04 9224294 /lib64/libnss_files-2.5.so
7fb853444000-7fb853445000 r--p 00009000 08:04 9224294 /lib64/libnss_files-2.5.so
7fb853445000-7fb853446000 rw-p 0000a000 08:04 9224294 /lib64/libnss_files-2.5.so
7fb853446000-7fb85344b000 r-xp 00000000 08:04 110412590 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Socket/Socket.so
7fb85344b000-7fb85364a000 ---p 00005000 08:04 110412590 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Socket/Socket.so
7fb85364a000-7fb85364b000 rw-p 00004000 08:04 110412590 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Socket/Socket.so
7fb85364b000-7fb853667000 r-xp 00000000 08:04 110412428 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/POSIX/POSIX.so
7fb853667000-7fb853867000 ---p 0001c000 08:04 110412428 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/POSIX/POSIX.so
7fb853867000-7fb853868000 rw-p 0001c000 08:04 110412428 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/POSIX/POSIX.so
7fb853868000-7fb853888000 r-xp 00000000 08:04 56328843 /home/yostauto/perl5/lib/perl5/x86_64-linux-thread-multi/auto/DBI/DBI.so
7fb853888000-7fb853a87000 ---p 00020000 08:04 56328843 /home/yostauto/perl5/lib/perl5/x86_64-linux-thread-multi/auto/DBI/DBI.so
7fb853a87000-7fb853a88000 rw-p 0001f000 08:04 56328843 /home/yostauto/perl5/lib/perl5/x86_64-linux-thread-multi/auto/DBI/DBI.so
7fb853a88000-7fb853a94000 r-xp 00000000 08:04 56328198 /home/yostauto/perl5/lib/perl5/x86_64-linux-thread-multi/auto/Text/CSV_XS/CSV_XS.so
7fb853a94000-7fb853c93000 ---p 0000c000 08:04 56328198 /home/yostauto/perl5/lib/perl5/x86_64-linux-thread-multi/auto/Text/CSV_XS/CSV_XS.so
7fb853c93000-7fb853c94000 rw-p 0000b000 08:04 56328198 /home/yostauto/perl5/lib/perl5/x86_64-linux-thread-multi/auto/Text/CSV_XS/CSV_XS.so
7fb853c94000-7fb853c9f000 r-xp 00000000 08:04 110412967 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/HTML/Parser/Parser.so
7fb853c9f000-7fb853e9e000 ---p 0000b000 08:04 110412967 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/HTML/Parser/Parser.so
7fb853e9e000-7fb853e9f000 rw-p 0000a000 08:04 110412967 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/HTML/Parser/Parser.so
7fb853e9f000-7fb853ebb000 r-xp 00000000 08:04 110413015 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/List/MoreUtils/MoreUtils.so
7fb853ebb000-7fb8540bb000 ---p 0001c000 08:04 110413015 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/List/MoreUtils/MoreUtils.so
7fb8540bb000-7fb8540bc000 rw-p 0001c000 08:04 110413015 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/List/MoreUtils/MoreUtils.so
7fb8540bc000-7fb8540c8000 r-xp 00000000 08:04 110412819 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/Params/Validate/Validate.so
7fb8540c8000-7fb8542c7000 ---p 0000c000 08:04 110412819 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/Params/Validate/Validate.so
7fb8542c7000-7fb8542c8000 rw-p 0000b000 08:04 110412819 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/Params/Validate/Validate.so
7fb8542c8000-7fb8542cd000 r-xp 00000000 08:04 110414454 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/DateTime/DateTime.so
7fb8542cd000-7fb8544cc000 ---p 00005000 08:04 110414454 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/DateTime/DateTime.so
7fb8544cc000-7fb8544cd000 rw-p 00004000 08:04 110414454 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/DateTime/DateTime.so
7fb8544cd000-7fb8544d9000 r-xp 00000000 08:04 110412715 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/List/Util/Util.so
7fb8544d9000-7fb8546d8000 ---p 0000c000 08:04 110412715 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/List/Util/Util.so
7fb8546d8000-7fb8546d9000 rw-p 0000b000 08:04 110412715 /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/auto/List/Util/Util.so
7fb8546d9000-7fb8546e2000 r-xp 00000000 08:04 110405801 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Encode/Encode.so
7fb8546e2000-7fb8548e1000 ---p 00009000 08:04 110405801 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Encode/Encode.so
7fb8548e1000-7fb8548e2000 rw-p 00008000 08:04 110405801 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Encode/Encode.so
7fb8548e2000-7fb8548e5000 r-xp 00000000 08:04 110412420 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/MIME/Base64/Base64.so
7fb8548e5000-7fb854ae4000 ---p 00003000 08:04 110412420 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/MIME/Base64/Base64.so
7fb854ae4000-7fb854ae5000 rw-p 00002000 08:04 110412420 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/MIME/Base64/Base64.so
7fb854ae5000-7fb854ae8000 r-xp 00000000 08:04 110412398 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Fcntl/Fcntl.so
7fb854ae8000-7fb854ce7000 ---p 00003000 08:04 110412398 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Fcntl/Fcntl.so
7fb854ce7000-7fb854ce8000 rw-p 00002000 08:04 110412398 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/Fcntl/Fcntl.so
7fb854ce8000-7fb854cec000 r-xp 00000000 08:04 110412414 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/IO/IO.so
7fb854cec000-7fb854eeb000 ---p 00004000 08:04 110412414 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/IO/IO.so
7fb854eeb000-7fb854eec000 rw-p 00003000 08:04 110412414 /usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/IO/IO.so
7fb854eec000-7fb854f12000 rw-p 00000000 00:00 0
7fb854f28000-7fb854f2a000 rw-p 00000000 00:00 0
7fffe55a9000-7fffe55ca000 rw-p 00000000 00:00 0 [stack]
7fffe55ff000-7fffe5600000 r-xp 00000000 00:00 0 [vdso]
ffffffffff600000-ffffffffff601000 r--p 00000000 00:00 0 [vsyscall]
/bin/sh: line 1: 15018 Aborted perl /home/user/emailservice/send.pl

ActiPerl + Tcl.pm *** glibc detected *** munmap_chunk(): invalid pointer: 0x09b5e0d8

I installed ActivePerl 5.10.1.1007 on my Ubuntu 10.04 machine.
I have a very simple Perl script with the following lines:
use lib "/opt/ActivePerl-5.10/lib";
use Tcl;
my $Interpreter = new Tcl;
$Interpreter->Eval('puts "Hello world"');
$Interpreter->Eval('set ::env(TESTVAR) 55')
The output is the following:
$ /opt/ActivePerl-5.10/bin/perl5.10.1 simple.pl
Hello world
*** glibc detected *** /opt/ActivePerl-5.10/bin/perl5.10.1: munmap_chunk(): invalid pointer: 0x09b5e0d8 ***
======= Backtrace: =========
/lib/tls/i686/cmov/libc.so.6(+0x6b591)[0xb7696591]
/lib/tls/i686/cmov/libc.so.6(+0x6c80e)[0xb769780e]
/opt/ActivePerl-5.10/bin/perl5.10.1(perl_destruct+0xda6)[0x8071716]
/opt/ActivePerl-5.10/bin/perl5.10.1(main+0xb0)[0x8060a30]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xb7641bd6]
/opt/ActivePerl-5.10/bin/perl5.10.1(chroot+0x31)[0x80608e1]
======= Memory map: ========
08048000-0815e000 r-xp 00000000 08:11 5154055 /opt/ActivePerl-5.10/bin/perl-static
0815e000-08160000 rwxp 00116000 08:11 5154055 /opt/ActivePerl-5.10/bin/perl-static
09aae000-09bf1000 rwxp 00000000 00:00 0 [heap]
b6ad8000-b6af5000 r-xp 00000000 08:11 3399754 /lib/libgcc_s.so.1
b6af5000-b6af6000 r-xp 0001c000 08:11 3399754 /lib/libgcc_s.so.1
b6af6000-b6af7000 rwxp 0001d000 08:11 3399754 /lib/libgcc_s.so.1
b6af7000-b6b01000 r-xp 00000000 08:11 3424653 /lib/tls/i686/cmov/libnss_files-2.11.1.so
b6b01000-b6b02000 r-xp 00009000 08:11 3424653 /lib/tls/i686/cmov/libnss_files-2.11.1.so
b6b02000-b6b03000 rwxp 0000a000 08:11 3424653 /lib/tls/i686/cmov/libnss_files-2.11.1.so
b6b03000-b6b0b000 r-xp 00000000 08:11 3424655 /lib/tls/i686/cmov/libnss_nis-2.11.1.so
b6b0b000-b6b0c000 r-xp 00007000 08:11 3424655 /lib/tls/i686/cmov/libnss_nis-2.11.1.so
b6b0c000-b6b0d000 rwxp 00008000 08:11 3424655 /lib/tls/i686/cmov/libnss_nis-2.11.1.so
b6b0d000-b6b13000 r-xp 00000000 08:11 3424651 /lib/tls/i686/cmov/libnss_compat-2.11.1.so
b6b13000-b6b14000 r-xp 00006000 08:11 3424651 /lib/tls/i686/cmov/libnss_compat-2.11.1.so
b6b14000-b6b15000 rwxp 00007000 08:11 3424651 /lib/tls/i686/cmov/libnss_compat-2.11.1.so
b6b2a000-b6b2b000 ---p 00000000 00:00 0
b6b2b000-b732b000 rwxp 00000000 00:00 0
b74c1000-b74cb000 r-xp 00000000 08:11 5162486 /opt/ActivePerl-5.10/lib/auto/Tcl/Tcl.so
b74cb000-b74cc000 rwxp 00009000 08:11 5162486 /opt/ActivePerl-5.10/lib/auto/Tcl/Tcl.so
b74cc000-b750b000 r-xp 00000000 08:11 5712734 /usr/lib/locale/en_US.utf8/LC_CTYPE
b750b000-b7629000 r-xp 00000000 08:11 5712735 /usr/lib/locale/en_US.utf8/LC_COLLATE
b7629000-b762b000 rwxp 00000000 00:00 0
b762b000-b777e000 r-xp 00000000 08:11 3424483 /lib/tls/i686/cmov/libc-2.11.1.so
b777e000-b777f000 ---p 00153000 08:11 3424483 /lib/tls/i686/cmov/libc-2.11.1.so
b777f000-b7781000 r-xp 00153000 08:11 3424483 /lib/tls/i686/cmov/libc-2.11.1.so
b7781000-b7782000 rwxp 00155000 08:11 3424483 /lib/tls/i686/cmov/libc-2.11.1.so
b7782000-b7785000 rwxp 00000000 00:00 0
b7785000-b779a000 r-xp 00000000 08:11 3424658 /lib/tls/i686/cmov/libpthread-2.11.1.so
b779a000-b779b000 r-xp 00014000 08:11 3424658 /lib/tls/i686/cmov/libpthread-2.11.1.so
b779b000-b779c000 rwxp 00015000 08:11 3424658 /lib/tls/i686/cmov/libpthread-2.11.1.so
b779c000-b779e000 rwxp 00000000 00:00 0
b779e000-b77a0000 r-xp 00000000 08:11 3424663 /lib/tls/i686/cmov/libutil-2.11.1.so
b77a0000-b77a1000 r-xp 00001000 08:11 3424663 /lib/tls/i686/cmov/libutil-2.11.1.so
b77a1000-b77a2000 rwxp 00002000 08:11 3424663 /lib/tls/i686/cmov/libutil-2.11.1.so
b77a2000-b77ab000 r-xp 00000000 08:11 3424646 /lib/tls/i686/cmov/libcrypt-2.11.1.so
b77ab000-b77ac000 r-xp 00008000 08:11 3424646 /lib/tls/i686/cmov/libcrypt-2.11.1.so
b77ac000-b77ad000 rwxp 00009000 08:11 3424646 /lib/tls/i686/cmov/libcrypt-2.11.1.so
b77ad000-b77d4000 rwxp 00000000 00:00 0
b77d4000-b77f8000 r-xp 00000000 08:11 3424648 /lib/tls/i686/cmov/libm-2.11.1.so
b77f8000-b77f9000 r-xp 00023000 08:11 3424648 /lib/tls/i686/cmov/libm-2.11.1.so
b77f9000-b77fa000 rwxp 00024000 08:11 3424648 /lib/tls/i686/cmov/libm-2.11.1.so
b77fa000-b77fb000 rwxp 00000000 00:00 0
b77fb000-b77fd000 r-xp 00000000 08:11 3424647 /lib/tls/i686/cmov/libdl-2.11.1.so
b77fd000-b77fe000 r-xp 00001000 08:11 3424647 /lib/tls/i686/cmov/libdl-2.11.1.so
b77fe000-b77ff000 rwxp 00002000 08:11 3424647 /lib/tls/i686/cmov/libdl-2.11.1.so
b77ff000-b7812000 r-xp 00000000 08:11 3424650 /lib/tls/i686/cmov/libnsl-2.11.1.so
b7812000-b7813000 r-xp 00012000 08:11 3424650 /lib/tls/i686/cmov/libnsl-2.11.1.so
b7813000-b7814000 rwxp 00013000 08:11 3424650 /lib/tls/i686/cmov/libnsl-2.11.1.so
b7814000-b7816000 rwxp 00000000 00:00 0
b781a000-b781b000 r-xp 00000000 08:11 1859586 /usr/lib/locale/en_US.utf8/LC_NUMERIC
b781b000-b781c000 r-xp 00000000 08:11 5712754 /usr/lib/locale/en_US.utf8/LC_TIME
b781c000-b781d000 r-xp 00000000 08:11 5712755 /usr/lib/locale/en_US.utf8/LC_MONETARY
b781d000-b781e000 r-xp 00000000 08:11 5712756 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES
b781e000-b781f000 r-xp 00000000 08:11 1859591 /usr/lib/locale/en_US.utf8/LC_PAPER
b781f000-b7820000 r-xp 00000000 08:11 1859592 /usr/lib/locale/en_US.utf8/LC_NAME
b7820000-b7821000 r-xp 00000000 08:11 5712757 /usr/lib/locale/en_US.utf8/LC_ADDRESS
b7821000-b7822000 r-xp 00000000 08:11 5712758 /usr/lib/locale/en_US.utf8/LC_TELEPHONE
b7822000-b7823000 r-xp 00000000 08:11 1859595 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT
b7823000-b782a000 r-xs 00000000 08:11 5711192 /usr/lib/gconv/gconv-modules.cache
b782a000-b782b000 r-xp 00000000 08:11 5712759 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION
b782b000-b782d000 rwxp 00000000 00:00 0
b782d000-b782e000 r-xp 00000000 00:00 0 [vdso]
b782e000-b7849000 r-xp 00000000 08:11 3401485 /lib/ld-2.11.1.so
b7849000-b784a000 r-xp 0001a000 08:11 3401485 /lib/ld-2.11.1.so
b784a000-b784b000 rwxp 0001b000 08:11 3401485 /lib/ld-2.11.1.so
bfd36000-bfd4b000 rwxp 00000000 00:00 0 [stack]
Aborted
Please help. I can't find a way to make this work. Setting a non-environment variable does not cause the crash. For example:
$Interpreter->Eval('set localvar 55')
THANKS!!!
First stage analysis: memory corruption on exit. I'd say that there's warring over who should free a block and how. Now we dig deeper…
It's possible that you're seeing the consequences of the fact that both Perl and Tcl are independently trying to work around the bugs misfeatures in the system implementation of environment variables. In particular, the C library's setenv() has a number of problems with memory leaks which make it rather more impractical than you might naïvely expect; I'd quite expect Perl to work around this, and I know that Tcl does too, but it does mean that only one language should set environment variables, and that almost certainly needs to be Perl in this case (on the basis of evidence you've presented).
Do you really need to set environment variables from your Tcl code? If you can just not do it, that'd be the easiest way forward. :-) Otherwise, we're talking about having a different build of Tcl (so that it asks the Perl side of things to do the memory management) or doing some magic to disconnect the Tcl side from the real environment. You might also want to report the problem upstream to ActiveState.
I'll keep digging and if I find the solution I'll let you know.
I reported this to ActiveState. Inline is my email and their response, but to sum up:
1. They didn't develop "Inline Tcl" for Perl nor did they test it.
2. It was developed in 2001 and no additions were made to it since then.
3. When it was developed (in 2001), it was marked as "alpha" and no additions were made since then.
Hi Mircea,
Inline::Tcl is not part of ActivePerl. It's not tested with ActivePerl, and it
does not build on our PPM build farm against ActivePerl:
http://ppm4.activestate.com/i686-linux/5.10/1000/R/RR/RRS/Inline-Tcl-0.09.d/log-20090614T112213.txt
Offhand, the error message looks like a compiler mismatch problem, but it could be
almost anything since Inline::Tcl hasn't been touched by the author since 2001,
and even then the release notes describe it as "alpha software". It doesn't seem
to like Linux very much any more:
http://matrix.cpantesters.org/?dist=Inline-Tcl%200.09;maxver=1
Hmm.. The author's home page is 404. You should probably find another way to do it.
You should not need this line: use lib "/opt/ActivePerl-5.10/lib"; unless you have a misconfiguration. You might want to nuke the install from orbit and start over.
Is there any particular reason why you are using ActivePerl? You should be able to simply install perl from source -- you're using a real OS, so I'd take advantage of it :)