Hi Ashutosh,
Thank you for your kind response. I have tried to increase the heap size by setting following steps:
-Xms4096M
-Xmx4096M
-Max Heap Size 4096
The settings are done on both instance_ID31520 - Servers General and also server_ID3152050.
After that the dev_bootstrap seems like showing successful state with RC=0.
However my server0 and SDM still cannot be started. Do you have any other advice that I can try? I have tried setting fullyMaterializeLobData=false as well but it does not help.
Thanks.
Regards,
Stephan
=======================================================================
dev_Server0:
[Thr 140062614947680] JLaunchISetDebugMode: set debug mode [no]
[Thr 140062527702784] JLaunchIStartFunc: Thread 140062527702784 started as Java VM thread.
**********************************************************************
JHVM_LoadJavaVM: VM Arguments of node [server0]
-> stack : 1048576 Bytes
-> arg[ 0]: exit
-> arg[ 1]: abort
-> arg[ 2]: vfprintf
-> arg[ 3]: -Denv.class.path=:/db2/db2s01/sqllib/java/db2java.zip:/db2/db2s01/sqllib/java/runtime.zip:.:/db2/db2s01/sqllib/java/db2java.zip:/db2/db2s01/sqllib/java/runtime.zip:.
-> arg[ 4]: -XX:MaxNewSize=600M
-> arg[ 5]: -XX:NewSize=600M
-> arg[ 6]: -XX:MaxPermSize=512M
-> arg[ 7]: -XX:PermSize=512M
-> arg[ 8]: -XX:+UseConcMarkSweepGC
-> arg[ 9]: -XX:+DisableExplicitGC
-> arg[ 10]: -XX:TargetSurvivorRatio=90
-> arg[ 11]: -XX:SurvivorRatio=4
-> arg[ 12]: -XX:+PrintGCDetails
-> arg[ 13]: -XX:+PrintGCTimeStamps
-> arg[ 14]: -verbose:gc
-> arg[ 15]: -XX:SoftRefLRUPolicyMSPerMB=1
-> arg[ 16]: -XX:HeapDumpPath=OOM.hprof
-> arg[ 17]: -XX:+HeapDumpOnOutOfMemoryError
-> arg[ 18]: -Djco.jarm=1
-> arg[ 19]: -Djava.awt.headless=true
-> arg[ 20]: -Djava.security.policy=./java.policy
-> arg[ 21]: -Djava.security.egd=file:/dev/urandom
-> arg[ 22]: -Dsun.io.useCanonCaches=false
-> arg[ 23]: -Dorg.omg.CORBA.ORBClass=com.sap.engine.system.ORBProxy
-> arg[ 24]: -Dorg.omg.CORBA.ORBSingletonClass=com.sap.engine.system.ORBSingletonProxy
-> arg[ 25]: -Dorg.omg.PortableInterceptor.ORBInitializerClass.com.sap.engine.services.ts.jts.ots.PortableInterceptor.JTSInitializer
-> arg[ 26]: -Djavax.rmi.CORBA.PortableRemoteObjectClass=com.sap.engine.system.PortableRemoteObjectProxy
-> arg[ 27]: -Dcom.sap.jvm.scenario=j2ee
-> arg[ 28]: -Dcom.wily.introscope.agent.agentName=S01_DVEBMGS00_server0
-> arg[ 29]: -Dcom.wily.introscope.agentProfile=/usr/sap/DA1/SMDA97/SMDAgent/applications.config/com.sap.smd.agent.application.wily/BytecodeAgent/ISAGENT.8.2.4.0-2012-06-26/wily/IntroscopeAgent.profile
-> arg[ 30]: -XX:+JavaMonitorsInStackTrace
-> arg[ 31]: -Xbootclasspath/p:/usr/sap/DA1/SMDA97/SMDAgent/applications.config/com.sap.smd.agent.application.wily/BytecodeAgent/ISAGENT.8.2.4.0-2012-06-26/wily/connectors/AutoProbeConnector.jar:/usr/sap/DA1/SMDA97/SMDAgent/applications.config/com.sap.smd.agent.application.wily/BytecodeAgent/ISAGENT.8.2.4.0-2012-06-26/wily/Agent.jar
-> arg[ 32]: -Dsys.global.dir=/usr/sap/S01/SYS/global
-> arg[ 33]: -Dapplication.home=/usr/sap/S01/DVEBMGS00/exe
-> arg[ 34]: -Djava.class.path=/usr/sap/S01/DVEBMGS00/exe/jstartup.jar:/usr/sap/S01/DVEBMGS00/exe/jvmx.jar:./bin/boot/boot.jar:./bin/boot/jaas.jar:./bin/system/bytecode.jar:.
-> arg[ 35]: -Djava.library.path=/usr/sap/S01/DVEBMGS00/exe/sapjvm_4/jre/lib/amd64/server:/usr/sap/S01/DVEBMGS00/exe/sapjvm_4/jre/lib/amd64:/usr/sap/S01/DVEBMGS00/exe/sapjvm_4/jre/../lib/amd64:/usr/sap/S01/DVEBMGS00/exe:/usr/sap/S01/DVEBMGS00/exe:/usr/sap/S01/DVEBMGS00/exe:/usr/sap/S01/SYS/exe/run:/usr/sap/S01/SYS/exe/uc/linuxx86_64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib:/usr/sap/S01/DVEBMGS00/j2ee/os_libs:/usr/sap/S01/DVEBMGS00/exe:/usr/sap/S01/DVEBMGS00/exe:/usr/sap/S01/DVEBMGS00/exe:/usr/sap/S01/SYS/exe/run:/usr/sap/S01/SYS/exe/uc/linuxx86_64
-> arg[ 36]: -Dmemory.manager=4096M
-> arg[ 37]: -Xmx4096M
-> arg[ 38]: -Xms4096M
-> arg[ 39]: -Xss2M
-> arg[ 40]: -DLoadBalanceRestricted=no
-> arg[ 41]: -Djstartup.mode=JCONTROL
-> arg[ 42]: -Djstartup.ownProcessId=7984
-> arg[ 43]: -Djstartup.ownHardwareId=Z0506874237
-> arg[ 44]: -Djstartup.whoami=server
-> arg[ 45]: -Djstartup.debuggable=no
-> arg[ 46]: -Xjvmx
-> arg[ 47]: -XsapSystem=00
-> arg[ 48]: -XmonGcCallback
-> arg[ 49]: -DSAPINFO=S01_00_server
-> arg[ 50]: -DSAPSTART=1
-> arg[ 51]: -DCONNECT_PORT=29629
-> arg[ 52]: -DSAPSYSTEM=00
-> arg[ 53]: -DSAPSYSTEMNAME=S01
-> arg[ 54]: -DSAPMYNAME=jjsapmon_S01_00
-> arg[ 55]: -DSAPPROFILE=/usr/sap/S01/SYS/profile/S01_DVEBMGS00_jjsapmon
-> arg[ 56]: -DFRFC_FALLBACK=ON
-> arg[ 57]: -DFRFC_FALLBACK_HOST=localhost
-> arg[ 58]: -DSAPSTARTUP=1
-> arg[ 59]: -DSAPSYSTEM=00
-> arg[ 60]: -DSAPSYSTEMNAME=S01
-> arg[ 61]: -DSAPMYNAME=jjsapmon_S01_00
-> arg[ 62]: -DSAPDBHOST=jjsapmon
-> arg[ 63]: -Dj2ee.dbhost=jjsapmon
**********************************************************************
(CompilerOracle read from file /usr/sap/S01/DVEBMGS00/exe/sapjvm_4/jre/.hotspot_compiler)
[Thr 140062527702784] JHVM_LoadJavaVM: Java VM created OK.
Heap
par new generation reserved 614400K, committed 614400K, used 98347K [0x0000000002c30000, 0x0000000028430000, 0x0000000028430000)
eden space 409600K, 24% used [0x0000000002c30000, 0x0000000008c3af48, 0x000000001bc30000)
from space 102400K, 0% used [0x000000001bc30000, 0x000000001bc30000, 0x0000000022030000)
to space 102400K, 0% used [0x0000000022030000, 0x0000000022030000, 0x0000000028430000)
concurrent mark-sweep generation reserved 3579904K, committed 3579904K, used 0K [0x0000000028430000, 0x0000000102c30000, 0x0000000102c30000)
concurrent-mark-sweep perm gen reserved 524288K, committed 524288K, used 2521K [0x0000000102c30000, 0x0000000122c30000, 0x0000000122c30000)
[Thr 140061697693440] JLaunchIExitJava: exit hook is called (rc = 1)
[Thr 140061697693440] **********************************************************************
[Thr 140061697693440] *** ERROR => The Java VM terminated with a non-zero exit code.
[Thr 140061697693440] *** Please see SAP Note 943602 , section 'J2EE Engine exit codes'
[Thr 140061697693440] *** for additional information and trouble shooting.
[Thr 140061697693440] **********************************************************************
[Thr 140061697693440] SigISetIgnoreAction : SIG_IGN for signal SIGCHLD
[Thr 140061697693440] JLaunchCloseProgram: good bye (exitcode = 1)
=======================================================================
dev_bootstrap:
(CompilerOracle read from file /usr/sap/S01/DVEBMGS00/exe/sapjvm_4/jre/.hotspot_compiler)
[Thr 139841563154176] JHVM_LoadJavaVM: Java VM created OK.
**********************************************************************
JHVM_BuildArgumentList: main method arguments of node [bootstrap]
-> arg[ 0]: com.sap.engine.bootstrap.Bootstrap
-> arg[ 1]: ./bootstrap
-> arg[ 2]: ID0031520
**********************************************************************
[Thr 139841563154176] JHVM_RegisterNatives: com.sap.bc.krn.perf.PerfTimes
[Thr 139841231189760] Sun Jun 8 23:18:05 2014
[Thr 139841231189760] JLaunchIExitJava: exit hook is called (rc = 0)
[Thr 139841231189760] SigISetIgnoreAction : SIG_IGN for signal SIGCHLD
[Thr 139841231189760] JLaunchCloseProgram: good bye (exitcode = 0)
=======================================================================
SDM:
[Thr 139851505157984] JLaunchISetDebugMode: set debug mode [no]
[Thr 139851358226176] JLaunchIStartFunc: Thread 139851358226176 started as Java VM thread.
**********************************************************************
JHVM_LoadJavaVM: VM Arguments of node [SDM]
-> stack : 1048576 Bytes
-> arg[ 0]: exit
-> arg[ 1]: abort
-> arg[ 2]: vfprintf
-> arg[ 3]: -Denv.class.path=:/db2/db2s01/sqllib/java/db2java.zip:/db2/db2s01/sqllib/java/runtime.zip:.:/db2/db2s01/sqllib/java/db2java.zip:/db2/db2s01/sqllib/java/runtime.zip:.
-> arg[ 4]: -Dsys.global.dir=/usr/sap/S01/SYS/global
-> arg[ 5]: -Dapplication.home=/usr/sap/S01/DVEBMGS00/exe
-> arg[ 6]: -Djava.class.path=/usr/sap/S01/DVEBMGS00/exe/jstartup.jar:/usr/sap/S01/DVEBMGS00/exe/jvmx.jar:/usr/sap/S01/DVEBMGS00/SDM/program/bin/SDM.jar
-> arg[ 7]: -Djava.library.path=/usr/sap/S01/DVEBMGS00/exe/sapjvm_4/jre/lib/amd64/server:/usr/sap/S01/DVEBMGS00/exe/sapjvm_4/jre/lib/amd64:/usr/sap/S01/DVEBMGS00/exe/sapjvm_4/jre/../lib/amd64:/usr/sap/S01/DVEBMGS00/exe:/usr/sap/S01/DVEBMGS00/exe:/usr/sap/S01/DVEBMGS00/exe:/usr/sap/S01/SYS/exe/run:/usr/sap/S01/SYS/exe/uc/linuxx86_64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib:/usr/sap/S01/DVEBMGS00/j2ee/os_libs:/usr/sap/S01/DVEBMGS00/exe:/usr/sap/S01/DVEBMGS00/exe:/usr/sap/S01/DVEBMGS00/exe:/usr/sap/S01/SYS/exe/run:/usr/sap/S01/SYS/exe/uc/linuxx86_64
-> arg[ 8]: -Dmemory.manager=512M
-> arg[ 9]: -Xmx512M
-> arg[ 10]: -DLoadBalanceRestricted=no
-> arg[ 11]: -Djstartup.mode=JCONTROL
-> arg[ 12]: -Djstartup.ownProcessId=7229
-> arg[ 13]: -Djstartup.ownHardwareId=Z0506874237
-> arg[ 14]: -Djstartup.whoami=sdm
-> arg[ 15]: -Djstartup.debuggable=yes
-> arg[ 16]: -Xjvmx
-> arg[ 17]: -XsapSystem=00
-> arg[ 18]: -XmonGcCallback
-> arg[ 19]: -XdebugPortRange:50002-50002
-> arg[ 20]: -XdebugStateChangeCallback
-> arg[ 21]: -DSAPINFO=S01_00_sdm
-> arg[ 22]: -DSAPSTART=1
-> arg[ 23]: -DCONNECT_PORT=29629
-> arg[ 24]: -DSAPSYSTEM=00
-> arg[ 25]: -DSAPSYSTEMNAME=S01
-> arg[ 26]: -DSAPMYNAME=jjsapmon_S01_00
-> arg[ 27]: -DSAPPROFILE=/usr/sap/S01/SYS/profile/S01_DVEBMGS00_jjsapmon
-> arg[ 28]: -DFRFC_FALLBACK=ON
-> arg[ 29]: -DFRFC_FALLBACK_HOST=localhost
-> arg[ 30]: -DSAPSTARTUP=1
-> arg[ 31]: -DSAPSYSTEM=00
-> arg[ 32]: -DSAPSYSTEMNAME=S01
-> arg[ 33]: -DSAPMYNAME=jjsapmon_S01_00
-> arg[ 34]: -DSAPDBHOST=jjsapmon
-> arg[ 35]: -Dj2ee.dbhost=jjsapmon
**********************************************************************
(CompilerOracle read from file /usr/sap/S01/DVEBMGS00/exe/sapjvm_4/jre/.hotspot_compiler)
[Thr 139851358226176] Sun Jun 8 23:18:17 2014
[Thr 139851358226176] JHVM_LoadJavaVM: Java VM created OK.
**********************************************************************
JHVM_BuildArgumentList: main method arguments of node [SDM]
-> arg[ 0]: server
-> arg[ 1]: sdmhome=/usr/sap/S01/DVEBMGS00/SDM/program
**********************************************************************
[Thr 139851504277248] Sun Jun 8 23:18:20 2014
[Thr 139851504277248] JLaunchRequestFunc: receive command:17, argument:0 from pid:5661
[Thr 139851504277248] JLaunchIShutdownInvoke: set shutdown interval (stop:1402240700/end:1402240820/TO:120)
[Thr 139851504277248] JLaunchProcessCommand: Invoke VM Shutdown
[Thr 139851504277248] JHVM_FrameworkShutdownDirect: invoke direct shutdown
[Thr 139851504277248] JHVM_RegisterNatives: com.sap.bc.proj.jstartup.JStartupFramework
[Thr 139851504277248] JLaunchISetState: change state from [Initial (0)] to [Stopping (5)]
[Thr 139851017135872] Sun Jun 8 23:18:21 2014
[Thr 139851017135872] JLaunchIExitJava: exit hook is called (rc = 0)
[Thr 139851017135872] SigISetIgnoreAction : SIG_IGN for signal SIGCHLD
[Thr 139851017135872] JLaunchCloseProgram: good bye (exitcode = 0)