Integration Server is not getting started

Venkata_Reddy_K · August 27, 2013, 2:00pm

Hi All,

Good day to you.

We are facing a problem while starting the Integration server (version 6.5). When we start the server its getting stuck at port manager started and after that its not getting started.

Please find the below log messages and suggest me on the same.

SERVER LOG:

2013-08-27 13:14:55 CEST [ISS.0028.0012C] WmJDBCAdapter: Startup service (wm.adapter.wmjdbc.admin:registerAdapter)
2013-08-27 13:14:58 CEST [ART.0114.1007E] Adapter Runtime: Error Logged. See Error log for details. Error: [ADA.1.200] The JDBC DataSource class “com.sybase.jdbc2.jdbc.SybDataSource” cannot be located.
com.sybase.jdbc2.jdbc.SybDataSource
2013-08-27 13:15:40 CEST [ART.0114.1007E] Adapter Runtime: Error Logged. See Error log for details. Error: [ADA.1.204] Cannot connect to the database with DataSource class “oracle.jdbc.pool.OracleDataSource”.
Io exception: The Network Adapter could not establish the connection
2013-08-27 13:15:40 CEST [ART.0114.1007E] Adapter Runtime: Error Logged. See Error log for details. Error: [ART.118.5036] Adapter Runtime (Connection): Unable to configure connection manager.
[ADA.1.204] Cannot connect to the database with DataSource class “oracle.jdbc.pool.OracleDataSource”.
Io exception: The Network Adapter could not establish the connection
2013-08-27 13:15:40 CEST [ART.0114.1007E] Adapter Runtime: Error Logged. See Error log for details. Error: [ADA.1.204] Cannot connect to the database with DataSource class “com.sybase.jdbc3.jdbc.SybDataSource”.
JZ006: Caught IOException: java.net.ConnectException: Connection refused (errno:239)
2013-08-27 13:15:42 CEST [ART.0114.1007E] Adapter Runtime: Error Logged. See Error log for details. Error: [ADA.1.204] Cannot connect to the database with DataSource class “oracle.jdbc.pool.OracleDataSource”.
Io exception: The Network Adapter could not establish the connection
2013-08-27 13:15:42 CEST [ART.0114.1007E] Adapter Runtime: Error Logged. See Error log for details. Error:
2013-08-27 13:16:12 CEST [ART.0114.1007E] Adapter Runtime: Error Logged. See Error log for details. Error: [ADA.1.204] Cannot connect to the database with DataSource class “oracle.jdbc.pool.OracleDataSource”.
Io exception: The Network Adapter could not establish the connection
2013-08-27 13:16:12 CEST [ART.0114.1007E] Adapter Runtime: Error Logged. See Error log for details. Error:
2013-08-27 13:16:42 CEST [ART.0114.1007E] Adapter Runtime: Error Logged. See Error log for details. Error: [ADA.1.204] Cannot connect to the database with DataSource class “oracle.jdbc.pool.OracleDataSource”.
Io exception: The Network Adapter could not establish the connection
2013-08-27 13:16:42 CEST [ART.0114.1007E] Adapter Runtime: Error Logged. See Error log for details. Error:
2013-08-27 13:17:12 CEST [ART.0114.1007E] Adapter Runtime: Error Logged. See Error log for details. Error: [ADA.1.204] Cannot connect to the database with DataSource class “oracle.jdbc.pool.OracleDataSource”.
Io exception: The Network Adapter could not establish the connection
2013-08-27 13:17:14 CEST [ART.0114.1007E] Adapter Runtime: Error Logged. See Error log for details. Error: [ADA.1.204] Cannot connect to the database with DataSource class “com.sybase.jdbc3.jdbc.SybDataSource”.
JZ006: Caught IOException: java.net.ConnectException: Connection refused (errno:239)
2013-08-27 13:17:14 CEST [ART.0114.1007E] Adapter Runtime: Error Logged. See Error log for details. Error: [ADA.1.204] Cannot connect to the database with DataSource class “oracle.jdbc.pool.OracleDataSource”.
Io exception: The Network Adapter could not establish the connection
2013-08-27 13:17:14 CEST [ART.0114.1007E] Adapter Runtime: Error Logged. See Error log for details. Error:
2013-08-27 13:17:44 CEST [ART.0114.1007E] Adapter Runtime: Error Logged. See Error log for details. Error: [ADA.1.204] Cannot connect to the database with DataSource class “oracle.jdbc.pool.OracleDataSource”.
Io exception: The Network Adapter could not establish the connection
2013-08-27 13:17:44 CEST [ART.0114.1007E] Adapter Runtime: Error Logged. See Error log for details. Error: [ART.114.13] Adapter Runtime: Error occurred while Adapter Runtime was loading adapter type “JDBCAdapter”.
[ART.114.9] Adapter Runtime: Error(s) while registering adapter type JDBCAdapter.
2013-08-27 13:17:44 CEST [ISS.0028.0013E] Startup service exited with the following error: com.wm.pkg.art.error.DetailedServiceException: [ART.114.13] Adapter Runtime: Error occurred while Adapter Runtime was loading adapter type “JDBCAdapter”.
[ART.114.9] Adapter Runtime: Error(s) while registering adapter type JDBCAdapter.
2013-08-27 13:17:44 CEST [ISS.0028.0012C] WmJDBCAdapter: Startup service (pub.pollingNotificationUtils:startup)
2013-08-27 13:17:44 CEST [ISS.0028.0012C] wMOFTEConsole: Startup service (wMOFTEConsole:startup)
2013-08-27 13:17:44 CEST [ISS.0028.0013E] Startup service exited with the following error: com.wm.app.b2b.server.ServiceException: [ISS.0086.9025] Saved pipeline wMOFParam does not exist
2013-08-27 13:17:44 CEST [ISS.0028.0012C] LNA_CommonUtilities: Startup service (LNA_CommonUtilities.Logging.init:logStartup)
2013-08-27 13:17:44 CEST [ISP.0090.0004C] logging.init.Config – INFO - Config file used: packages/LNA_CommonUtilities/pub/log4j.rollingfileappender.properties
2013-08-27 13:17:44 CEST [ISP.0090.0004C] logging.init.Startup – INFO - Logging started successfully.
2013-08-27 13:17:44 CEST [ISS.0028.0012C] wMOFAgent: Startup service (wMOFAgent:startup)
2013-08-27 13:17:48 CEST [ISS.0028.0012C] wMOFConsole: Startup service (wMOFConsole:startup)
2013-08-27 13:17:49 CEST [ISS.0028.0012C] wMOFTE: Startup service (wMOFTE:startup)
2013-08-27 13:17:49 CEST [ISS.0028.0012C] OpenSSH: Startup service (wm.openssh:loadProperties)
2013-08-27 13:17:49 CEST [ISS.0028.0012C] WmOAAdapter: Startup service (wm.adapter.wmoa.admin:startup)
2013-08-27 13:17:52 CEST [ISS.0025.0036C] Dispatcher started
2013-08-27 13:17:52 CEST [ISS.0025.0005C] Port Manager started

Best Regards,

Venkat.

Sai3 · August 27, 2013, 2:38pm

Hi Venkat,

Below are debug points you can try

1)try start with different port
2)delete repository files and start server again
3)Try to check ports.cnf file in config folder of IS
4)Back up existing config and restore config from webMethodsInstall>IS>Config>Backup
5)Restart of IS installed box

i have question like why you are still using 6.5, Upgrade to latest version.it will fixes may of your issues

Venkata_Reddy_K · August 27, 2013, 4:24pm

Hi Sai,

Thank you for your reply.

We have migrated most of our servers to 8.2, only few servers are still running on 6.5.

We have tried the last four steps , but we did not try by using the different port number as we are in freeze period now.

Is there any alternative way to get rid of this ?

What could be the impact if we use the different port ?

Best Regards,
Venkat.

rmg · August 27, 2013, 4:54pm

So are you trying to run the 65 and 822 servers in parallel on the same primary port or trying to run 65 servers on a different port (that is not primary) assuming both versions are on same OS landscape?

HTH,
RMG

Venkata_Reddy_K · August 27, 2013, 5:18pm

Hi RMG,

Thank you for your reply.

Yes we are running both environments in parallel on a UNIX plat form. 6.5 is running on HPUX and 8.2 is running on Linux platform.

And regarding ports both are running on different ports.

Is it because of port conflict ?

Best Regards,
Venkat.

rmg · August 27, 2013, 5:26pm

OK differrent OS then.

Based on the errors above,I see some thing issue with the data source classes ie DB jars on the 65 servers that are not loading properly and I don’t think it ports related.

OK is this issue started all sudden when starting up 65 servers and have this worked in earlier occassions while both 65 and 822 servers up?

Any recent changes to the 65 env?

HTH,
RMG

Sai3 · August 27, 2013, 6:56pm

try to do GC tunning(both increase and decerease) some time it will work

rmg · August 27, 2013, 7:58pm

What is it to do with GC flushing on this issue can you advise?

Sai3 · August 27, 2013, 8:14pm

Actually i faced a issue long back like my test server hung in middle

When i drecreased GC, it started working fine and later changed to orginal value. it may help them by chance

rmg · August 27, 2013, 8:50pm

But I still don’t think the GC tuning here can resolve this issue as the error says related data source class being held due to some env changes I believe…I have seen this similar error before:

Sai3 · August 28, 2013, 8:50am

i accept with your argument about datasouce issue, but still other packages startup services got started and ports are not intialized

Let us wait for thread starter to try look into Datasouce & GC. Venkat,Could you please update in forum with your resolution/findings

rmg · August 28, 2013, 4:14pm

Yes no big deal:)

Venkata_Reddy_K · August 28, 2013, 4:54pm

Hi RMG/Sai,

Sorry for the delay.

This server was running fine till couple weeks back. Suddenly we got an issue like this.

There was some changes made to in jar files in June month and due to some problem we rolled back the changes that time only. One more thing is as posted earlier we have two parallel environments ( 6.5 & 8.2 ) in which entire 8.2 had been migrated to completely new environment ( new network including applications and DB as well ) as part of DR.

Other servers are running fine in the same environment without any issues.

But I am not really sure that might affect this because this is pointing to different environment.

We are trying to restore the entire setup from the back up and see. I will update the thread once we are done.

rmg · August 28, 2013, 5:03pm

Yes we do suspect some thing surely changed wrt jars etc…

OK good idea, please have your backups restored and see if the issue still persists and start the 65 server:

HTH,
RMG

Sai3 · August 28, 2013, 6:32pm

yes, Good idea to restore and let us know with update

system · September 10, 2013, 6:49am

U mention u run 2 environment. Is 6.5 still using the same server? Have u confirm no network issue in 6.5 server/environment?

Venkata_Reddy_K · September 12, 2013, 10:27am

Hi All,

Good day to you. Sorry for the delay.

Our issue got resolved with out restoring the entire set up.

Steps followed :

Done GC initially,removed all temp files.
Removed some corrupted jar files and replaced with new one.( Due to which the adapter issue is not occurring ).
Restored the config files with two months older files at which the server was running fine.
Started the server . Thats it server is up and running fine.

Thank you for all your inputs.

Best Regards,
Venkat.

Sai3 · September 12, 2013, 1:49pm

Good hear about resolution…

rmg · September 12, 2013, 6:00pm

Thanks for sharing the info back in the forum:)