So I have a small proof of concept seam app that is based off of one of the Alfresco web client samples. In the process of getting it to work I ran into many problems and stack traces which I was eventually able to fix. Finally my proof of concept works but jboss still logs an error and stack trace. I dont reference STRTransform anywhere so I think the alfresco sdk code does. Below is the full stack trace.
10:12:02,676 ERROR [STDERR] java.lang.ClassNotFoundException: No ClassLoaders found for: org.apache.ws.security.transform.STRTransform
10:12:02,676 ERROR [STDERR] at org.jboss.mx.loading.LoadMgr3.beginLoadTask(LoadMgr3.java:212)
10:12:02,676 ERROR [STDERR] at org.jboss.mx.loading.RepositoryClassLoader.loadClassImpl(RepositoryClassLoader.java:521)
10:12:02,676 ERROR [STDERR] at org.jboss.mx.loading.RepositoryClassLoader.loadClass(RepositoryClassLoader.java:415)
10:12:02,676 ERROR [STDERR] at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
10:12:02,676 ERROR [STDERR] at java.lang.Class.forName0(Native Method)
10:12:02,676 ERROR [STDERR] at java.lang.Class.forName(Class.java:186)
10:12:02,676 ERROR [STDERR] at org.apache.xml.security.transforms.Transform.register(Unknown Source)
10:12:02,676 ERROR [STDERR] at org.apache.ws.security.WSSConfig.staticInit(WSSConfig.java:310)
10:12:02,676 ERROR [STDERR] at org.apache.ws.security.WSSConfig.<init>(WSSConfig.java:324)
10:12:02,676 ERROR [STDERR] at org.apache.ws.security.WSSConfig.getNewInstance(WSSConfig.java:333)
10:12:02,677 ERROR [STDERR] at org.apache.ws.security.WSSConfig.getDefaultWSConfig(WSSConfig.java:342)
10:12:02,677 ERROR [STDERR] at org.apache.ws.security.WSSecurityEngine.getWssConfig(WSSecurityEngine.java:157)
10:12:02,677 ERROR [STDERR] at org.apache.ws.security.handler.WSHandler.doSenderAction(WSHandler.java:96)
10:12:02,677 ERROR [STDERR] at org.apache.ws.axis.security.WSDoAllSender.invoke(WSDoAllSender.java:170)
10:12:02,677 ERROR [STDERR] at org.apache.axis.strategies.InvocationStrategy.visit(InvocationStrategy.java:32)
10:12:02,677 ERROR [STDERR] at org.apache.axis.SimpleChain.doVisiting(SimpleChain.java:118)
10:12:02,677 ERROR [STDERR] at org.apache.axis.SimpleChain.invoke(SimpleChain.java:83)
10:12:02,677 ERROR [STDERR] at org.apache.axis.client.AxisClient.invoke(AxisClient.java:127)
10:12:02,677 ERROR [STDERR] at org.apache.axis.client.Call.invokeEngine(Call.java:2784)
10:12:02,677 ERROR [STDERR] at org.apache.axis.client.Call.invoke(Call.java:2767)
10:12:02,677 ERROR [STDERR] at org.apache.axis.client.Call.invoke(Call.java:2443)
10:12:02,677 ERROR [STDERR] at org.apache.axis.client.Call.invoke(Call.java:2366)
10:12:02,677 ERROR [STDERR] at org.apache.axis.client.Call.invoke(Call.java:1812)
10:12:02,677 ERROR [STDERR] at org.alfresco.webservice.repository.RepositoryServiceSoapBindingStub.update(RepositoryServiceSoapBindingStub.java:986)
10:12:02,677 ERROR [STDERR] at com.assistgroup.fileupload.AlfrescoConnector.createNewContent(AlfrescoConnector.java:158)
10:12:02,677 ERROR [STDERR] at com.assistgroup.fileupload.AlfrescoConnector.addNewContent(AlfrescoConnector.java:81)
10:12:02,677 ERROR [STDERR] at com.assistgroup.fileupload.UploadHandler.handleUpload(UploadHandler.java:38)
10:12:02,677 ERROR [STDERR] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
10:12:02,677 ERROR [STDERR] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
10:12:02,677 ERROR [STDERR] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
10:12:02,677 ERROR [STDERR] at java.lang.reflect.Method.invoke(Method.java:616)
10:12:02,677 ERROR [STDERR] at org.jboss.seam.util.Reflections.invoke(Reflections.java:21)
10:12:02,677 ERROR [STDERR] at org.jboss.seam.intercept.RootInvocationContext.proceed(RootInvocationContext.java:31)
10:12:02,677 ERROR [STDERR] at org.jboss.seam.intercept.SeamInvocationContext.proceed(SeamInvocationContext.java:56)
10:12:02,677 ERROR [STDERR] at org.jboss.seam.transaction.RollbackInterceptor.aroundInvoke(RollbackInterceptor.java:31)
10:12:02,677 ERROR [STDERR] at org.jboss.seam.intercept.SeamInvocationContext.proceed(SeamInvocationContext.java:68)
10:12:02,677 ERROR [STDERR] at org.jboss.seam.core.BijectionInterceptor.aroundInvoke(BijectionInterceptor.java:46)
10:12:02,677 ERROR [STDERR] at org.jboss.seam.intercept.SeamInvocationContext.proceed(SeamInvocationContext.java:68)
10:12:02,677 ERROR [STDERR] at org.jboss.seam.core.MethodContextInterceptor.aroundInvoke(MethodContextInterceptor.java:42)
10:12:02,677 ERROR [STDERR] at org.jboss.seam.intercept.SeamInvocationContext.proceed(SeamInvocationContext.java:68)
10:12:02,677 ERROR [STDERR] at org.jboss.seam.intercept.RootInterceptor.invoke(RootInterceptor.java:107)
10:12:02,677 ERROR [STDERR] at org.jboss.seam.intercept.JavaBeanInterceptor.interceptInvocation(JavaBeanInterceptor.java:166)
10:12:02,677 ERROR [STDERR] at org.jboss.seam.intercept.JavaBeanInterceptor.invoke(JavaBeanInterceptor.java:102)
10:12:02,677 ERROR [STDERR] at com.assistgroup.fileupload.UploadHandler_$$_javassist_1.handleUpload(UploadHandler_$$_javassist_1.java)
10:12:02,677 ERROR [STDERR] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
10:12:02,677 ERROR [STDERR] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
10:12:02,677 ERROR [STDERR] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
10:12:02,678 ERROR [STDERR] at java.lang.reflect.Method.invoke(Method.java:616)
10:12:02,678 ERROR [STDERR] at org.jboss.el.util.ReflectionUtil.invokeMethod(ReflectionUtil.java:329)
10:12:02,678 ERROR [STDERR] at org.jboss.el.util.ReflectionUtil.invokeMethod(ReflectionUtil.java:342)
10:12:02,678 ERROR [STDERR] at org.jboss.el.parser.AstPropertySuffix.invoke(AstPropertySuffix.java:58)
10:12:02,678 ERROR [STDERR] at org.jboss.el.parser.AstValue.invoke(AstValue.java:96)
10:12:02,678 ERROR [STDERR] at org.jboss.el.MethodExpressionImpl.invoke(MethodExpressionImpl.java:276)
10:12:02,678 ERROR [STDERR] at com.sun.facelets.el.TagMethodExpression.invoke(TagMethodExpression.java:68)
10:12:02,678 ERROR [STDERR] at javax.faces.component.MethodBindingMethodExpressionAdapter.invoke(MethodBindingMethodExpressionAdapter.java:77)
10:12:02,678 ERROR [STDERR] at com.sun.faces.application.ActionListenerImpl.processAction(ActionListenerImpl.java:91)
10:12:02,678 ERROR [STDERR] at javax.faces.component.UICommand.broadcast(UICommand.java:383)
10:12:02,678 ERROR [STDERR] at org.ajax4jsf.component.AjaxViewRoot.processEvents(AjaxViewRoot.java:184)
10:12:02,678 ERROR [STDERR] at org.ajax4jsf.component.AjaxViewRoot.broadcastEvents(AjaxViewRoot.java:162)
10:12:02,678 ERROR [STDERR] at org.ajax4jsf.component.AjaxViewRoot.processApplication(AjaxViewRoot.java:350)
10:12:02,678 ERROR [STDERR] at com.sun.faces.lifecycle.InvokeApplicationPhase.execute(InvokeApplicationPhase.java:97)
10:12:02,678 ERROR [STDERR] at com.sun.faces.lifecycle.LifecycleImpl.phase(LifecycleImpl.java:251)
10:12:02,678 ERROR [STDERR] at com.sun.faces.lifecycle.LifecycleImpl.execute(LifecycleImpl.java:117)
10:12:02,679 ERROR [STDERR] at javax.faces.webapp.FacesServlet.service(FacesServlet.java:244)
10:12:02,679 ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
10:12:02,679 ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
10:12:02,680 ERROR [STDERR] at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:83)
10:12:02,680 ERROR [STDERR] at org.jboss.seam.web.MultipartFilter.doFilter(MultipartFilter.java:80)
10:12:02,680 ERROR [STDERR] at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)
10:12:02,680 ERROR [STDERR] at org.jboss.seam.web.ExceptionFilter.doFilter(ExceptionFilter.java:64)
10:12:02,680 ERROR [STDERR] at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)
10:12:02,680 ERROR [STDERR] at org.jboss.seam.web.RedirectFilter.doFilter(RedirectFilter.java:45)
10:12:02,680 ERROR [STDERR] at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)
10:12:02,680 ERROR [STDERR] at org.ajax4jsf.webapp.BaseXMLFilter.doXmlFilter(BaseXMLFilter.java:141)
10:12:02,680 ERROR [STDERR] at org.ajax4jsf.webapp.BaseFilter.doFilter(BaseFilter.java:281)
10:12:02,680 ERROR [STDERR] at org.jboss.seam.web.Ajax4jsfFilter.doFilter(Ajax4jsfFilter.java:60)
10:12:02,680 ERROR [STDERR] at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)
10:12:02,680 ERROR [STDERR] at org.jboss.seam.web.LoggingFilter.doFilter(LoggingFilter.java:58)
10:12:02,680 ERROR [STDERR] at org.jboss.seam.servlet.SeamFilter$FilterChainImpl.doFilter(SeamFilter.java:69)
10:12:02,680 ERROR [STDERR] at org.jboss.seam.servlet.SeamFilter.doFilter(SeamFilter.java:158)
10:12:02,680 ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
10:12:02,680 ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
10:12:02,680 ERROR [STDERR] at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
10:12:02,680 ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
10:12:02,680 ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
10:12:02,680 ERROR [STDERR] at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230)
10:12:02,680 ERROR [STDERR] at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
10:12:02,680 ERROR [STDERR] at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:179)
10:12:02,680 ERROR [STDERR] at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:432)
10:12:02,680 ERROR [STDERR] at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:84)
10:12:02,680 ERROR [STDERR] at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
10:12:02,680 ERROR [STDERR] at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
10:12:02,680 ERROR [STDERR] at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:157)
10:12:02,680 ERROR [STDERR] at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
10:12:02,680 ERROR [STDERR] at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:262)
10:12:02,680 ERROR [STDERR] at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844)
10:12:02,680 ERROR [STDERR] at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
10:12:02,680 ERROR [STDERR] at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:446)
10:12:02,680 ERROR [STDERR] at java.lang.Thread.run(Thread.java:636)
contents of: jboss-4.2.2.GA/server/default/lib
-rw-r--r-- 1 james james 58225 2007-10-22 11:45 activation.jar
-rw-r--r-- 1 james james 355304 2007-10-22 11:45 antlr.jar
-rw-r--r-- 1 james james 4942 2007-10-22 11:45 autonumber-plugin.jar
-rw-r--r-- 1 james james 513244 2007-10-22 11:45 bcel.jar
-rw-r--r-- 1 james james 21291 2007-10-22 11:45 bindingservice-plugin.jar
-rw-r--r-- 1 james james 167691 2007-10-22 11:45 bsf.jar
-rw-r--r-- 1 james james 12130 2007-10-22 11:45 bsh-deployer.jar
-rw-r--r-- 1 james james 235510 2007-10-22 11:45 bsh.jar
-rw-r--r-- 1 james james 328602 2007-10-22 11:45 cglib.jar
-rw-r--r-- 1 james james 47469 2007-10-22 11:45 commons-codec.jar
-rw-r--r-- 1 james james 558376 2007-10-22 11:45 commons-collections.jar
-rw-r--r-- 1 james james 214796 2007-10-22 11:45 commons-httpclient.jar
-rw-r--r-- 1 james james 55424 2007-10-22 11:45 commons-logging.jar
-rw-r--r-- 1 james james 313128 2007-10-22 11:45 dom4j.jar
-rw-r--r-- 1 james james 52220 2007-10-22 11:45 ejb3-persistence.jar
-rw-r--r-- 1 james james 28338 2007-10-22 11:45 el-api.jar
-rw-r--r-- 1 james james 2276092 2007-10-22 11:45 hibernate3.jar
-rw-r--r-- 1 james james 444506 2007-10-22 11:45 hibernate-annotations.jar
-rw-r--r-- 1 james james 111590 2007-10-22 11:45 hibernate-entitymanager.jar
-rw-r--r-- 1 james james 643806 2011-06-24 15:36 hsqldb.jar
-rw-r--r-- 1 james james 8739 2007-10-22 11:45 hsqldb-plugin.jar
-rw-r--r-- 1 james james 547559 2007-10-22 11:45 javassist.jar
-rw-r--r-- 1 james james 226484 2007-10-22 11:45 jaxen.jar
-rw-r--r-- 1 james james 723098 2007-10-22 11:45 jboss-cache-jdk50.jar
-rw-r--r-- 1 james james 80470 2007-10-22 11:45 jboss-common-jdbc-wrapper.jar
-rw-r--r-- 1 james james 20384 2007-10-22 11:45 jboss-ejb3x.jar
-rw-r--r-- 1 james james 14182 2007-10-22 11:45 jboss-hibernate.jar
-rw-r--r-- 1 james james 423706 2007-10-22 11:45 jboss-j2ee.jar
-rw-r--r-- 1 james james 2124287 2007-10-22 11:45 jboss.jar
-rw-r--r-- 1 james james 29382 2011-07-01 14:49 jboss-jaxrpc.jar
-rw-r--r-- 1 james james 63828 2011-07-01 14:49 jboss-jaxws.jar
-rw-r--r-- 1 james james 199159 2007-10-22 11:45 jboss-jca.jar
-rw-r--r-- 1 james james 14218 2007-10-22 11:45 jboss-jsr77.jar
-rw-r--r-- 1 james james 65044 2007-10-22 11:45 jboss-jsr88.jar
-rw-r--r-- 1 james james 28372 2007-10-22 11:45 jbossjta-integration.jar
-rw-r--r-- 1 james james 547885 2007-10-22 11:45 jbossjta.jar
-rw-r--r-- 1 james james 152258 2007-10-22 11:45 jboss-management.jar
-rw-r--r-- 1 james james 56301 2007-10-22 11:45 jboss-monitoring.jar
-rw-r--r-- 1 james james 537121 2007-10-22 11:45 jbossmq.jar
-rw-r--r-- 1 james james 8376 2007-10-22 11:45 jboss-remoting-int.jar
-rw-r--r-- 1 james james 863878 2007-10-22 11:45 jboss-remoting.jar
-rw-r--r-- 1 james james 26736 2007-10-22 11:45 jboss-saaj.jar
-rw-r--r-- 1 james james 125849 2007-10-22 11:45 jboss-serialization.jar
-rw-r--r-- 1 james james 46960 2007-10-22 11:45 jboss-srp.jar
-rw-r--r-- 1 james james 312961 2007-10-22 11:45 jbosssx.jar
-rw-r--r-- 1 james james 53279 2007-10-22 11:45 jboss-transaction.jar
-rw-r--r-- 1 james james 65245 2007-10-22 11:45 jbossts-common.jar
-rw-r--r-- 1 james james 121073 2007-10-22 11:45 jboss-vfs.jar
-rw-r--r-- 1 james james 52561 2007-10-22 11:45 jbossws-common.jar
-rw-r--r-- 1 james james 66978 2007-10-22 11:45 jbossws-framework.jar
-rw-r--r-- 1 james james 76820 2007-10-22 11:45 jbossws-jboss42.jar
-rw-r--r-- 1 james james 94561 2007-10-22 11:45 jbossws-spi.jar
-rw-r--r-- 1 james james 33300 2007-10-22 11:45 jmx-adaptor-plugin.jar
-rw-r--r-- 1 james james 48897 2007-10-22 11:45 jnpserver.jar
-rw-r--r-- 1 james james 82156 2007-10-22 11:45 joesnmp.jar
-rw-r--r-- 1 james james 3522 2007-10-22 11:45 jpl-pattern.jar
-rw-r--r-- 1 james james 16995 2007-10-22 11:45 jpl-util.jar
-rw-r--r-- 1 james james 82183 2007-10-22 11:45 jsp-api.jar
-rw-r--r-- 1 james james 355753 2007-10-22 11:45 log4j.jar
-rw-r--r-- 1 james james 15143 2007-10-22 11:45 log4j-snmp-appender.jar
-rw-r--r-- 1 james james 387690 2007-10-22 11:45 mail.jar
-rw-r--r-- 1 james james 5466 2007-10-22 11:45 mail-plugin.jar
-rw-r--r-- 1 james james 767492 2011-01-26 11:58 mysql-connector-java-5.1.13-bin.jar
-rw-r--r-- 1 james james 8818 2007-10-22 11:45 properties-plugin.jar
-rw-r--r-- 1 james james 390557 2007-10-22 11:45 quartz.jar
-rw-r--r-- 1 james james 3537 2007-10-22 11:45 scheduler-plugin-example.jar
-rw-r--r-- 1 james james 46036 2007-10-22 11:45 scheduler-plugin.jar
-rw-r--r-- 1 james james 89678 2007-10-22 11:45 servlet-api.jar
-rw-r--r-- 1 james james 2657 2007-10-22 11:45 xmlentitymgr.jar
Contents of: jboss-4.2.2.GA/lib
james#jamesp:~/jboss-4.2.2.GA/lib$ ls -lR
.:
total 2612
-rw-r--r-- 1 james james 47469 2007-10-22 11:44 commons-codec.jar
-rw-r--r-- 1 james james 214796 2007-10-22 11:44 commons-httpclient.jar
-rw-r--r-- 1 james james 55424 2007-10-22 11:44 commons-logging.jar
-rw-r--r-- 1 james james 255425 2007-10-22 11:44 concurrent.jar
drwxr-xr-x 2 james james 4096 2007-10-22 11:44 endorsed
-rw-r--r-- 1 james james 15858 2007-10-22 11:44 getopt.jar
-rw-r--r-- 1 james james 406564 2007-10-22 11:44 jboss-common.jar
-rw-r--r-- 1 james james 880300 2007-10-22 11:44 jboss-jmx.jar
-rw-r--r-- 1 james james 267066 2007-10-22 11:44 jboss-system.jar
-rw-r--r-- 1 james james 377239 2007-10-22 11:44 jboss-xml-binding.jar
-rw-r--r-- 1 james james 128404 2007-10-22 11:44 log4j-boot.jar
./endorsed:
total 3036
-rw-r--r-- 1 james james 188996 2007-10-22 11:44 serializer.jar
-rw-r--r-- 1 james james 1713712 2007-10-22 11:44 xalan.jar
-rw-r--r-- 1 james james 1200039 2007-10-22 11:44 xercesImpl.jar
Contents of: my projects ear/lib
alfresco-web-service-client-3.2.jar
antlr-runtime.jar
axis.jar
commons-beanutils.jar
commons-collections.jar
commons-digester.jar
commons-discovery-0.5.jar
commons-httpclient.jar
commons-lang.jar
commons-logging.jar
core.jar
drools-compiler.jar
drools-core.jar
janino.jar
jboss-el.jar
jbpm-jpdl.jar
mvel14.jar
richfaces-api.jar
wsdl4j-1.5.1.jar
wss4j-1.5.11.jar
While googling I have not found anything so I figured I would post here to see if any one has run into this in the past. If I figure it out I will post back here. Thanks
It looks to me from your stacktrace that you're calling a part of Alfresco that depends on Apache AXIS (to handle the SOAP stuff), but that you're missing one of the AXIS dependencies. AXIS is trying to do some web service security operation, but is failing because it can't find a required class for that.
A quick google indicates that xmlsec is the jar you're missing. One ships with Alfresco, but you don't appear to have it in your jar listings above, I'd suggest you try adding it and see if that does the trick.
Related
I need to add conf file to my mysql volume to create a volume logs but I do not have the permissions on my host machine.
When I run docker-compose the "mysql" folder is created with the followed permissions:
$ ls -l mysql/
total 198068
-rw-r----- 1 systemd-coredump systemd-coredump 56 févr. 2 21:36 auto.cnf
-rw-r----- 1 systemd-coredump systemd-coredump 3117703 févr. 2 21:36 binlog.000001
-rw-r----- 1 systemd-coredump systemd-coredump 157 févr. 2 21:36 binlog.000002
-rw-r----- 1 systemd-coredump systemd-coredump 32 févr. 2 21:36 binlog.index
-rw------- 1 systemd-coredump systemd-coredump 1680 févr. 2 21:36 ca-key.pem
-rw-r--r-- 1 systemd-coredump systemd-coredump 1112 févr. 2 21:36 ca.pem
-rw-r--r-- 1 systemd-coredump systemd-coredump 1112 févr. 2 21:36 client-cert.pem
-rw------- 1 systemd-coredump systemd-coredump 1680 févr. 2 21:36 client-key.pem
-rw-r----- 1 systemd-coredump systemd-coredump 196608 févr. 2 21:36 '#ib_16384_0.dblwr'
-rw-r----- 1 systemd-coredump systemd-coredump 8585216 févr. 2 21:36 '#ib_16384_1.dblwr'
-rw-r----- 1 systemd-coredump systemd-coredump 5714 févr. 2 21:36 ib_buffer_pool
-rw-r----- 1 systemd-coredump systemd-coredump 12582912 févr. 2 21:36 ibdata1
-rw-r----- 1 systemd-coredump systemd-coredump 50331648 févr. 2 21:36 ib_logfile0
-rw-r----- 1 systemd-coredump systemd-coredump 50331648 févr. 2 21:36 ib_logfile1
-rw-r----- 1 systemd-coredump systemd-coredump 12582912 févr. 2 21:36 ibtmp1
drwxr-x--- 2 systemd-coredump systemd-coredump 4096 févr. 2 21:36 '#innodb_temp'
drwxr-x--- 2 systemd-coredump systemd-coredump 4096 févr. 2 21:36 mysql
-rw-r----- 1 systemd-coredump systemd-coredump 31457280 févr. 2 21:36 mysql.ibd
drwxr-x--- 2 systemd-coredump systemd-coredump 4096 févr. 2 21:36 performance_schema
-rw------- 1 systemd-coredump systemd-coredump 1680 févr. 2 21:36 private_key.pem
-rw-r--r-- 1 systemd-coredump systemd-coredump 452 févr. 2 21:36 public_key.pem
-rw-r--r-- 1 systemd-coredump systemd-coredump 1112 févr. 2 21:36 server-cert.pem
-rw------- 1 systemd-coredump systemd-coredump 1680 févr. 2 21:36 server-key.pem
drwxr-x--- 2 systemd-coredump systemd-coredump 4096 févr. 2 21:36 symfony_docker
drwxr-x--- 2 systemd-coredump systemd-coredump 4096 févr. 2 21:36 sys
-rw-r----- 1 systemd-coredump systemd-coredump 16777216 févr. 2 21:36 undo_001
-rw-r----- 1 systemd-coredump systemd-coredump 16777216 févr. 2 21:36 undo_002
Why it does not mount my volume with my user like my others volumes ?
database:
container_name: mysql
image: mysql:8.0
command: --default-authentication-plugin=mysql_native_password
environment:
MYSQL_ROOT_PASSWORD: ${MYSQL_ROOT_PASSWORD}
MYSQL_DATABASE: ${MYSQL_DATABASE}
MYSQL_USER: ${MYSQL_USER}
MYSQL_PASSWORD: ${MYSQL_PASSWORD}
ports:
- "${MYSQL_LOCAL_PORT}:${MYSQL_DOCKER_PORT}"
volumes:
- ./mysql:/var/lib/mysql
networks:
- my-admin-sys
I did try to add user with GID and UID but it did not fixed the issue.
What did I miss ?
I am using the following command to try to write a spark (2.4.4 using Ananaconda 3 Jupyter Notebook) dataframe to a parquet file in Pyspark and get a very strange error message that I cannot resolve. I would appreciate any insights any has.
df.write.mode("overwrite").parquet("test/")
Error message is as follows:
--------------------------------------------------------------------------
Py4JJavaError Traceback (most recent call last)
<ipython-input-37-2b4a1d75a5f6> in <module>()
1 # df.write.partitionBy("AB").parquet("C:/test.parquet",mode='overwrite')
----> 2 df.write.mode("overwrite").parquet("test/")
3 # df.write.mode('SaveMode.Overwrite').parquet("C:/test.parquet")
C:\spark-2.4.4-bin-hadoop2.7\python\pyspark\sql\readwriter.py in parquet(self, path, mode, partitionBy, compression)
841 self.partitionBy(partitionBy)
842 self._set_opts(compression=compression)
--> 843 self._jwrite.parquet(path)
844
845 #since(1.6)
C:\spark-2.4.4-bin-hadoop2.7\python\lib\py4j-0.10.7-src.zip\py4j\java_gateway.py in __call__(self, *args)
1255 answer = self.gateway_client.send_command(command)
1256 return_value = get_return_value(
-> 1257 answer, self.gateway_client, self.target_id, self.name)
1258
1259 for temp_arg in temp_args:
C:\spark-2.4.4-bin-hadoop2.7\python\pyspark\sql\utils.py in deco(*a, **kw)
61 def deco(*a, **kw):
62 try:
---> 63 return f(*a, **kw)
64 except py4j.protocol.Py4JJavaError as e:
65 s = e.java_exception.toString()
C:\spark-2.4.4-bin-hadoop2.7\python\lib\py4j-0.10.7-src.zip\py4j\protocol.py in get_return_value(answer, gateway_client, target_id, name)
326 raise Py4JJavaError(
327 "An error occurred while calling {0}{1}{2}.\n".
--> 328 format(target_id, ".", name), value)
329 else:
330 raise Py4JError(
Py4JJavaError: An error occurred while calling o862.parquet.
: org.apache.spark.SparkException: Job aborted.
at org.apache.spark.sql.execution.datasources.FileFormatWriter$.write(FileFormatWriter.scala:198)
at org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelationCommand.run(InsertIntoHadoopFsRelationCommand.scala:159)
at org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult$lzycompute(commands.scala:104)
at org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult(commands.scala:102)
at org.apache.spark.sql.execution.command.DataWritingCommandExec.doExecute(commands.scala:122)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:131)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:127)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:127)
at org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:80)
at org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:80)
at org.apache.spark.sql.DataFrameWriter$$anonfun$runCommand$1.apply(DataFrameWriter.scala:676)
at org.apache.spark.sql.DataFrameWriter$$anonfun$runCommand$1.apply(DataFrameWriter.scala:676)
at org.apache.spark.sql.execution.SQLExecution$$anonfun$withNewExecutionId$1.apply(SQLExecution.scala:78)
at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:125)
at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:73)
at org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:676)
at org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:285)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:271)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:229)
at org.apache.spark.sql.DataFrameWriter.parquet(DataFrameWriter.scala:566)
at sun.reflect.GeneratedMethodAccessor114.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
at py4j.Gateway.invoke(Gateway.java:282)
at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
at py4j.commands.CallCommand.execute(CallCommand.java:79)
at py4j.GatewayConnection.run(GatewayConnection.java:238)
at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 52.0 failed 1 times, most recent failure: Lost task 0.0 in stage 52.0 (TID 176, localhost, executor driver): java.io.IOException: (null) entry in command string: null chmod 0644 C:\Users\583621\OneDrive - Booz Allen Hamilton\Personal\Teaching\PySpark Essentials for Data Scientists\PySpark DataFrame Essentials\test\_temporary\0\_temporary\attempt_20191206164455_0052_m_000000_176\part-00000-2cd01dbe-9e3f-44a5-88e1-e904822024c2-c000.snappy.parquet
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:770)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:866)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:849)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:733)
at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:225)
at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:209)
at org.apache.hadoop.fs.RawLocalFileSystem.createOutputStreamWithMode(RawLocalFileSystem.java:307)
at org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:296)
at org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:328)
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.<init>(ChecksumFileSystem.java:398)
at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:461)
at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:440)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:911)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:892)
at org.apache.parquet.hadoop.util.HadoopOutputFile.create(HadoopOutputFile.java:74)
at org.apache.parquet.hadoop.ParquetFileWriter.<init>(ParquetFileWriter.java:248)
at org.apache.parquet.hadoop.ParquetOutputFormat.getRecordWriter(ParquetOutputFormat.java:390)
at org.apache.parquet.hadoop.ParquetOutputFormat.getRecordWriter(ParquetOutputFormat.java:349)
at org.apache.spark.sql.execution.datasources.parquet.ParquetOutputWriter.<init>(ParquetOutputWriter.scala:37)
at org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormat$$anon$1.newInstance(ParquetFileFormat.scala:151)
at org.apache.spark.sql.execution.datasources.SingleDirectoryDataWriter.newOutputWriter(FileFormatDataWriter.scala:120)
at org.apache.spark.sql.execution.datasources.SingleDirectoryDataWriter.<init>(FileFormatDataWriter.scala:108)
at org.apache.spark.sql.execution.datasources.FileFormatWriter$.org$apache$spark$sql$execution$datasources$FileFormatWriter$$executeTask(FileFormatWriter.scala:236)
at org.apache.spark.sql.execution.datasources.FileFormatWriter$$anonfun$write$1.apply(FileFormatWriter.scala:170)
at org.apache.spark.sql.execution.datasources.FileFormatWriter$$anonfun$write$1.apply(FileFormatWriter.scala:169)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:123)
at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Driver stacktrace:
at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1889)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1877)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1876)
at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1876)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:926)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:926)
at scala.Option.foreach(Option.scala:257)
at org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:926)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:2110)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2059)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2048)
at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:49)
at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:737)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2061)
at org.apache.spark.sql.execution.datasources.FileFormatWriter$.write(FileFormatWriter.scala:167)
... 32 more
Caused by: java.io.IOException: (null) entry in command string: null chmod 0644 C:\Users\583621\OneDrive - Booz Allen Hamilton\Personal\Teaching\PySpark Essentials for Data Scientists\PySpark DataFrame Essentials\test\_temporary\0\_temporary\attempt_20191206164455_0052_m_000000_176\part-00000-2cd01dbe-9e3f-44a5-88e1-e904822024c2-c000.snappy.parquet
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:770)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:866)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:849)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:733)
at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:225)
at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:209)
at org.apache.hadoop.fs.RawLocalFileSystem.createOutputStreamWithMode(RawLocalFileSystem.java:307)
at org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:296)
at org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:328)
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.<init>(ChecksumFileSystem.java:398)
at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:461)
at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:440)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:911)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:892)
at org.apache.parquet.hadoop.util.HadoopOutputFile.create(HadoopOutputFile.java:74)
at org.apache.parquet.hadoop.ParquetFileWriter.<init>(ParquetFileWriter.java:248)
at org.apache.parquet.hadoop.ParquetOutputFormat.getRecordWriter(ParquetOutputFormat.java:390)
at org.apache.parquet.hadoop.ParquetOutputFormat.getRecordWriter(ParquetOutputFormat.java:349)
at org.apache.spark.sql.execution.datasources.parquet.ParquetOutputWriter.<init>(ParquetOutputWriter.scala:37)
at org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormat$$anon$1.newInstance(ParquetFileFormat.scala:151)
at org.apache.spark.sql.execution.datasources.SingleDirectoryDataWriter.newOutputWriter(FileFormatDataWriter.scala:120)
at org.apache.spark.sql.execution.datasources.SingleDirectoryDataWriter.<init>(FileFormatDataWriter.scala:108)
at org.apache.spark.sql.execution.datasources.FileFormatWriter$.org$apache$spark$sql$execution$datasources$FileFormatWriter$$executeTask(FileFormatWriter.scala:236)
at org.apache.spark.sql.execution.datasources.FileFormatWriter$$anonfun$write$1.apply(FileFormatWriter.scala:170)
at org.apache.spark.sql.execution.datasources.FileFormatWriter$$anonfun$write$1.apply(FileFormatWriter.scala:169)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:123)
at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
... 1 more
1
# Now something a bit more complicated: Read in a full parquet
2
parquet
You need to set a Hadoop home.
You can get the WINUTILS.EXE binary from a Hadoop redistribution. There is a repository of this for some Hadoop versions on github.
Then
1) Either You can Set the environment variable %HADOOP_HOME% to point to the directory above the BIN dir containing WINUTILS.EXE.
2)or Configure in code as
import sys
import os
os.environ['HADOOP_HOME'] = "C:/Mine/Spark/hadoop-2.6.0"
sys.path.append("C:/Mine/Spark/hadoop-2.6.0/bin")
Hope this helps !
I have data streaming into my Spark Scala application in this format
id mark1 mark2 mark3 time
uuid1 100 200 300 Tue Aug 8 14:06:02 PDT 2017
uuid1 100 200 300 Tue Aug 8 14:06:22 PDT 2017
uuid2 150 250 350 Tue Aug 8 14:06:32 PDT 2017
uuid2 150 250 350 Tue Aug 8 14:06:52 PDT 2017
uuid2 150 250 350 Tue Aug 8 14:06:58 PDT 2017
I have it read into columns id, mark1, mark2, mark3 and time. The time is converted to datetime format as well.
I want to get this grouped by id and get the lag for mark1 which gives the previous row's mark1 value.
Something like this:
id mark1 mark2 mark3 prev_mark time
uuid1 100 200 300 null Tue Aug 8 14:06:02 PDT 2017
uuid1 100 200 300 100 Tue Aug 8 14:06:22 PDT 2017
uuid2 150 250 350 null Tue Aug 8 14:06:32 PDT 2017
uuid2 150 250 350 150 Tue Aug 8 14:06:52 PDT 2017
uuid2 150 250 350 150 Tue Aug 8 14:06:58 PDT 2017
Consider the dataframe to be markDF. I have tried:
val window = Window.partitionBy("uuid").orderBy("timestamp")
val newerDF = newDF.withColumn("prev_mark", lag("mark1", 1, null).over(window))`
which says non time windows cannot be applied on streaming/appending datasets/frames.
I have also tried:
val window = Window.partitionBy("uuid").orderBy("timestamp").rowsBetween(-10, 10)
val newerDF = newDF.withColumn("prev_mark", lag("mark1", 1, null).over(window))
To get a window for few rows which did not work either. The streaming window something like:
window("timestamp", "10 minutes")
cannot be used to send over the lag. I am super confused on how to do this. Any help would be awesome!!
I would advise you to change the time column into String as
+-----+-----+-----+-----+----------------------------+
|id |mark1|mark2|mark3|time |
+-----+-----+-----+-----+----------------------------+
|uuid1|100 |200 |300 |Tue Aug 8 14:06:02 PDT 2017|
|uuid1|100 |200 |300 |Tue Aug 8 14:06:22 PDT 2017|
|uuid2|150 |250 |350 |Tue Aug 8 14:06:32 PDT 2017|
|uuid2|150 |250 |350 |Tue Aug 8 14:06:52 PDT 2017|
|uuid2|150 |250 |350 |Tue Aug 8 14:06:58 PDT 2017|
+-----+-----+-----+-----+----------------------------+
root
|-- id: string (nullable = true)
|-- mark1: integer (nullable = false)
|-- mark2: integer (nullable = false)
|-- mark3: integer (nullable = false)
|-- time: string (nullable = true)
After that doing the following should work
df.withColumn("prev_mark", lag("mark1", 1).over(Window.partitionBy("id").orderBy("time")))
Which will give you output as
+-----+-----+-----+-----+----------------------------+---------+
|id |mark1|mark2|mark3|time |prev_mark|
+-----+-----+-----+-----+----------------------------+---------+
|uuid1|100 |200 |300 |Tue Aug 8 14:06:02 PDT 2017|null |
|uuid1|100 |200 |300 |Tue Aug 8 14:06:22 PDT 2017|100 |
|uuid2|150 |250 |350 |Tue Aug 8 14:06:32 PDT 2017|null |
|uuid2|150 |250 |350 |Tue Aug 8 14:06:52 PDT 2017|150 |
|uuid2|150 |250 |350 |Tue Aug 8 14:06:58 PDT 2017|150 |
+-----+-----+-----+-----+----------------------------+---------+
I'm migrating an application from Websphere to JBoss EAP 6.4.
Jboss has been configured to comunincare with a MQ queue via a resource-adapter.
This is the configuration of Jboss:
<resource-adapters>
<resource-adapter id="wmq.jmsra.rar">
<archive>
wmq.jmsra.rar
</archive>
<transaction-support>NoTransaction</transaction-support>
<config-property name="logWriterEnabled">
true
</config-property>
<config-property name="maxConnections">
100
</config-property>
<config-property name="reconnectionRetryCount">
1000
</config-property>
<config-property name="traceLevel">
6
</config-property>
<config-property name="traceEnabled">
true
</config-property>
<config-property name="reconnectionRetryInterval">
30000
</config-property>
<config-property name="connectionConcurrency">
1
</config-property>
<connection-definitions>
<connection-definition class-name="com.ibm.mq.connector.outbound.ManagedConnectionFactoryImpl" jndi-name="java:/puc.ejb.factory" enabled="true" use-java-context="false" pool-name="puc.ejb.factory">
<config-property name="port">
${wmq.port:1414}
</config-property>
<config-property name="hostName">
${wmq.host:xxx.xxx.xxx.xxx}
</config-property>
<config-property name="channel">
${wmq.queue.channel:CLT2SRV}
</config-property>
<config-property name="transportType">
CLIENT
</config-property>
<config-property name="queueManager">
${wmq.queue.manager:MQEDFIDP}
</config-property>
<timeout>
<allocation-retry>3</allocation-retry>
<allocation-retry-wait-millis>5000</allocation-retry-wait-millis>
</timeout>
</connection-definition>
</connection-definitions>
<admin-objects>
<admin-object class-name="com.ibm.mq.connector.outbound.MQQueueProxy" jndi-name="java:/puc.ejb.queue" enabled="true" use-java-context="false" pool-name="puc.ejb.queue">
<config-property name="baseQueueName">
DATAGRAM.GG9.INVIOSMS
</config-property>
<config-property name="baseQueueManagerName">
MQEDFIDP
</config-property>
</admin-object>
</admin-objects>
</resource-adapter>
When publishing messages on the queue I get this exception:
mar 30, 2017 - 10:50:50,177 ERROR [stderr] (EJB default - 1) ERROR!
javax.jms.InvalidDestinationException: MQJMS2008: impossibile aprire
la coda MQ 'DATAGRAM.GG9.INVIOSMS'.
mar 30, 2017 - 10:50:50,180 ERROR [stderr] (EJB default - 1)
javax.jms.InvalidDestinationException: MQJMS2008: impossibile aprire
la coda MQ 'DATAGRAM.GG9.INVIOSMS'.
mar 30, 2017 - 10:50:50,181 ERROR [stderr] (EJB default - 1) at
com.ibm.msg.client.wmq.v6.jms.internal.MQQueueServices.getQueueOpenException(MQQueueServices.java:860)
mar 30, 2017 - 10:50:50,182 ERROR [stderr] (EJB default - 1) at
com.ibm.msg.client.wmq.v6.jms.internal.MQQueueServices.getOutputQueue(MQQueueServices.java:689)
mar 30, 2017 - 10:50:50,183 ERROR [stderr] (EJB default - 1) at
com.ibm.msg.client.wmq.v6.jms.internal.JMSServicesMgr.getOutputQueue(JMSServicesMgr.java:215)
mar 30, 2017 - 10:50:50,185 ERROR [stderr] (EJB default - 1) at
com.ibm.msg.client.wmq.v6.jms.internal.MQSession.createQProducer(MQSession.java:3082)
mar 30, 2017 - 10:50:50,186 ERROR [stderr] (EJB default - 1) at
com.ibm.msg.client.wmq.v6.jms.internal.MQSession.createProducer(MQSession.java:2820)
mar 30, 2017 - 10:50:50,187 ERROR [stderr] (EJB default - 1) at
com.ibm.msg.client.wmq.v6.jms.internal.MQSession.createProducer(MQSession.java:2876)
mar 30, 2017 - 10:50:50,188 ERROR [stderr] (EJB default - 1) at
com.ibm.msg.client.jms.internal.JmsSessionImpl.createProducer(JmsSessionImpl.java:1232)
mar 30, 2017 - 10:50:50,189 ERROR [stderr] (EJB default - 1) at
com.ibm.mq.jms.MQSession.createProducer(MQSession.java:687)
mar 30, 2017 - 10:50:50,191 ERROR [stderr] (EJB default - 1) at
com.ibm.mq.connector.outbound.MessageProducerWrapper.(MessageProducerWrapper.java:104)
mar 30, 2017 - 10:50:50,192 ERROR [stderr] (EJB default - 1) at
com.ibm.mq.connector.outbound.SessionWrapper.createProducer(SessionWrapper.java:375)
mar 30, 2017 - 10:50:50,193 ERROR [stderr] (EJB default - 1) at
com.fideuram.puc.ejb.AccodaSMS.inviaSMS(AccodaSMS.java:81)
mar 30, 2017 - 10:50:50,194 ERROR [stderr] (EJB default - 1) at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
mar 30, 2017 - 10:50:50,195 ERROR [stderr] (EJB default - 1) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
mar 30, 2017 - 10:50:50,197 ERROR [stderr] (EJB default - 1) at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
mar 30, 2017 - 10:50:50,198 ERROR [stderr] (EJB default - 1) at
java.lang.reflect.Method.invoke(Method.java:597)
mar 30, 2017 - 10:50:50,199 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52)
mar 30, 2017 - 10:50:50,200 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,201 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53)
mar 30, 2017 - 10:50:50,203 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63)
mar 30, 2017 - 10:50:50,204 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,205 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53)
mar 30, 2017 - 10:50:50,207 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63)
mar 30, 2017 - 10:50:50,208 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,209 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43)
mar 30, 2017 - 10:50:50,210 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,212 ERROR [stderr] (EJB default - 1) at
org.jboss.as.jpa.interceptor.SBInvocationInterceptor.processInvocation(SBInvocationInterceptor.java:47)
mar 30, 2017 - 10:50:50,213 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,214 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21)
mar 30, 2017 - 10:50:50,215 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,216 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
mar 30, 2017 - 10:50:50,218 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53)
mar 30, 2017 - 10:50:50,219 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,220 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51)
mar 30, 2017 - 10:50:50,221 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,223 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:279)
mar 30, 2017 - 10:50:50,224 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:331)
mar 30, 2017 - 10:50:50,225 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:243)
mar 30, 2017 - 10:50:50,226 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,227 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ejb3.remote.EJBRemoteTransactionPropagatingInterceptor.processInvocation(EJBRemoteTransactionPropagatingInterceptor.java:80)
mar 30, 2017 - 10:50:50,229 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,230 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41)
mar 30, 2017 - 10:50:50,231 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,232 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:43)
mar 30, 2017 - 10:50:50,234 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,235 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:89)
mar 30, 2017 - 10:50:50,236 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,237 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22)
mar 30, 2017 - 10:50:50,239 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,240 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64)
mar 30, 2017 - 10:50:50,241 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,242 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59)
mar 30, 2017 - 10:50:50,243 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,245 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50)
mar 30, 2017 - 10:50:50,246 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,247 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:55)
mar 30, 2017 - 10:50:50,248 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,250 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45)
mar 30, 2017 - 10:50:50,251 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
mar 30, 2017 - 10:50:50,252 ERROR [stderr] (EJB default - 1) at
org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
mar 30, 2017 - 10:50:50,253 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:189)
mar 30, 2017 - 10:50:50,254 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ejb3.remote.protocol.versionone.MethodInvocationMessageHandler.invokeMethod(MethodInvocationMessageHandler.java:319)
mar 30, 2017 - 10:50:50,256 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ejb3.remote.protocol.versionone.MethodInvocationMessageHandler.access$100(MethodInvocationMessageHandler.java:68)
mar 30, 2017 - 10:50:50,257 ERROR [stderr] (EJB default - 1) at
org.jboss.as.ejb3.remote.protocol.versionone.MethodInvocationMessageHandler$1.run(MethodInvocationMessageHandler.java:201)
mar 30, 2017 - 10:50:50,258 ERROR [stderr] (EJB default - 1) at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
mar 30, 2017 - 10:50:50,260 ERROR [stderr] (EJB default - 1) at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
mar 30, 2017 - 10:50:50,261 ERROR [stderr] (EJB default - 1) at
java.util.concurrent.FutureTask.run(FutureTask.java:138)
mar 30, 2017 - 10:50:50,262 ERROR [stderr] (EJB default - 1) at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
mar 30, 2017 - 10:50:50,263 ERROR [stderr] (EJB default - 1) at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
mar 30, 2017 - 10:50:50,264 ERROR [stderr] (EJB default - 1) at
java.lang.Thread.run(Thread.java:662)
mar 30, 2017 - 10:50:50,266 ERROR [stderr] (EJB default - 1) at
org.jboss.threads.JBossThread.run(JBossThread.java:122)
mar 30, 2017 - 10:50:50,267 ERROR [stderr] (EJB default - 1) Caused
by: com.ibm.mq.MQException: MQJE001: Codice di completamento '2',
ragione '2085'.
mar 30, 2017 - 10:50:50,268 ERROR [stderr] (EJB default - 1) at
com.ibm.msg.client.wmq.v6.base.internal.MQQueueManager.accessQueue(MQQueueManager.java:751)
mar 30, 2017 - 10:50:50,269 ERROR [stderr] (EJB default - 1) at
com.ibm.msg.client.wmq.v6.jms.internal.MQQueueServices.getOutputQueue(MQQueueServices.java:682)
mar 30, 2017 - 10:50:50,271 ERROR [stderr] (EJB default - 1) ... 68
more
In another discussion the error had been detected on the wrong configuration of the queue but does not specify what the error was (argh!).
This is the discussion
com.ibm.mq.MQException: MQJE001: Codice di completamento '2', ragione
'2085'.
Why don't you just look up the reason code in the IBM MQ Knowledge Center. If you had done a simple search (i.e. Google), this page would have been at the top
The error is stating that the destination name DATAGRAM.GG9.INVIOSMS was not found. Make sure that DATAGRAM.GG9.INVIOSMS exists on the MQEDFIDP queue manager. You may also need to check to se if the CLT2SRV channel is correct for the queue manager.
When I merge two CSV files, of the format (date, someValue), I see some duplicate records.
If I reduce the records to half the problem goes away. However, if I double the size of both the files it worsens. Appreciate any help!
My code:
i = pd.DataFrame.from_csv('i.csv')
i = i.reset_index()
e = pd.DataFrame.from_csv('e.csv')
e = e.reset_index()
total_df = pd.merge(i, e, right_index=False, left_index=False,
right_on=['date'], left_on=['date'], how='left')
total_df = total_df.sort(column='date')
(Note: the dupulicate records for 11/15, 11/16, 12/17, 12/18.)
In [7]: total_df
Out[7]:
date Cost netCost
25 2012-11-15 00:00:00 1 2
26 2012-11-15 00:00:00 1 2
31 2012-11-16 00:00:00 1 2
32 2012-11-16 00:00:00 1 2
37 2012-11-17 00:00:00 1 2
2 2012-11-18 00:00:00 1 2
5 2012-11-19 00:00:00 1 2
8 2012-11-20 00:00:00 1 2
11 2012-11-21 00:00:00 1 2
14 2012-11-22 00:00:00 1 2
17 2012-11-23 00:00:00 1 2
20 2012-11-24 00:00:00 1 2
23 2012-11-25 00:00:00 1 2
29 2012-11-26 00:00:00 1 2
35 2012-11-27 00:00:00 1 2
0 2012-11-28 00:00:00 1 2
3 2012-11-29 00:00:00 1 2
6 2012-11-30 00:00:00 1 2
9 2012-12-01 00:00:00 1 2
12 2012-12-02 00:00:00 1 2
15 2012-12-03 00:00:00 1 2
18 2012-12-04 00:00:00 1 2
21 2012-12-05 00:00:00 1 2
24 2012-12-06 00:00:00 1 2
30 2012-12-07 00:00:00 1 2
36 2012-12-08 00:00:00 1 2
1 2012-12-09 00:00:00 2 2
4 2012-12-10 00:00:00 2 2
7 2012-12-11 00:00:00 2 2
10 2012-12-12 00:00:00 2 2
13 2012-12-13 00:00:00 1 2
16 2012-12-14 00:00:00 2 2
19 2012-12-15 00:00:00 2 2
22 2012-12-16 00:00:00 2 2
27 2012-12-17 00:00:00 1 2
28 2012-12-17 00:00:00 1 2
33 2012-12-18 00:00:00 1 2
34 2012-12-18 00:00:00 1 2
i.csv
date,Cost
2012-11-15 00:00:00,1
2012-11-16 00:00:00,1
2012-11-17 00:00:00,1
2012-11-18 00:00:00,1
2012-11-19 00:00:00,1
2012-11-20 00:00:00,1
2012-11-21 00:00:00,1
2012-11-22 00:00:00,1
2012-11-23 00:00:00,1
2012-11-24 00:00:00,1
2012-11-25 00:00:00,1
2012-11-26 00:00:00,1
2012-11-27 00:00:00,1
2012-11-28 00:00:00,1
2012-11-29 00:00:00,1
2012-11-30 00:00:00,1
2012-12-01 00:00:00,1
2012-12-02 00:00:00,1
2012-12-03 00:00:00,1
2012-12-04 00:00:00,1
2012-12-05 00:00:00,1
2012-12-06 00:00:00,1
2012-12-07 00:00:00,1
2012-12-08 00:00:00,1
2012-12-09 00:00:00,2
2012-12-10 00:00:00,2
2012-12-11 00:00:00,2
2012-12-12 00:00:00,2
2012-12-13 00:00:00,1
2012-12-14 00:00:00,2
2012-12-15 00:00:00,2
2012-12-16 00:00:00,2
2012-12-17 00:00:00,1
2012-12-18 00:00:00,1
e.csv
date,netCost
2012-11-15 00:00:00,2
2012-11-16 00:00:00,2
2012-11-17 00:00:00,2
2012-11-18 00:00:00,2
2012-11-19 00:00:00,2
2012-11-20 00:00:00,2
2012-11-21 00:00:00,2
2012-11-22 00:00:00,2
2012-11-23 00:00:00,2
2012-11-24 00:00:00,2
2012-11-25 00:00:00,2
2012-11-26 00:00:00,2
2012-11-27 00:00:00,2
2012-11-28 00:00:00,2
2012-11-29 00:00:00,2
2012-11-30 00:00:00,2
2012-12-01 00:00:00,2
2012-12-02 00:00:00,2
2012-12-03 00:00:00,2
2012-12-04 00:00:00,2
2012-12-05 00:00:00,2
2012-12-06 00:00:00,2
2012-12-07 00:00:00,2
2012-12-08 00:00:00,2
2012-12-09 00:00:00,2
2012-12-10 00:00:00,2
2012-12-11 00:00:00,2
2012-12-12 00:00:00,2
2012-12-13 00:00:00,2
2012-12-14 00:00:00,2
2012-12-15 00:00:00,2
2012-12-16 00:00:00,2
2012-12-17 00:00:00,2
2012-12-18 00:00:00,2
This does seem like a bug with pandas 0.7.3 or numpy 1.6. This only happens if the column being merged on is a date (internally converted to numpy.datetime64). My solution was to convert date into a string-
def _DatetimeToString(datetime64):
timestamp = datetime64.astype(long)/1000000000
return datetime.fromtimestamp(timestamp).strftime('%Y-%m-%d')
i = pd.DataFrame.from_csv('i.csv')
i = i.reset_index()
i['date'] = i['date'].map(_DatetimeToString)
e = pd.DataFrame.from_csv('e.csv')
e = e.reset_index()
i['date'] = i['date'].map(_DatetimeToString)
total_df = pd.merge(i, e, right_index=False, left_index=False,
right_on=['date'], left_on=['date'], how='left')
total_df = total_df.sort(column='date')
This issue/bug came up for me as well. I was not merging on a datetime series, however, I did have a datetime series in the left dataframe. My solution was to de-dupe:
len(pophist)
2347
pop_merged = pd.merge(left=pophist, right=df_labels, how='left',
left_on ='candidate', right_on ='Slug', indicator = True)
pop_merged.shape
3303
pop_merged2 = pop_merged.drop_duplicates() #note dedupping is required due to issue in how pandas handles datetime dtypes on merge.
len(pop_merged2)
2347