OutOfMemory Error while running an LDAP Assembly Line in TDI

[jbdu...@gmail.com]

Hi All,

I really like the topics coming in this group. I am facing this issue while trying to run the assembly line on Linux ( RHEL 6.0 ) from the command line. It starts fine and prints the values properly. However, after a few minutes, it starts throwing outOfMemory errors. There is enough space on the machine but I do not know how to set the JVM values and what to change to allow the 400,000 + entries to be executed without any hiccups or errors.

Can you please help me out?

013-12-10 21:38:38,378 INFO [AssemblyLine.AssemblyLines/LDAPSync.1] - [LDAPConnector_1] CTGDIS004I *** Finished dumping Entry
2013-12-10 21:38:38,384 INFO [AssemblyLine.AssemblyLines/LDAPSync.1] - [LDAPConnector_1] CTGDIS495I handleException , update, javax.naming.directory.SchemaViolationException: [LDAP: error code 65 - Object Class Violation]; Remaining name: 'cn=AMAURY ALONZO aa000u,ou=people, o=att,c=us'
2013-12-10 21:38:38,385 ERROR [AssemblyLine.AssemblyLines/LDAPSync.1] - [LDAPConnector_1] CTGDIS810E handleException - cannot handle exception , update
javax.naming.directory.SchemaViolationException: [LDAP: error code 65 - Object Class Violation]; Remaining name: 'cn=AMAURY ALONZO aa000u,ou=people, o=att,c=us'
at com.sun.jndi.ldap.LdapCtx.mapErrorCode(LdapCtx.java:3110)
at com.sun.jndi.ldap.LdapCtx.processReturnCode(LdapCtx.java:3025)
at com.sun.jndi.ldap.LdapCtx.processReturnCode(LdapCtx.java:2832)
at com.sun.jndi.ldap.LdapCtx.c_createSubcontext(LdapCtx.java:803)
at com.sun.jndi.toolkit.ctx.ComponentDirContext.p_createSubcontext(ComponentDirContext.java:331)
at com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.createSubcontext(PartialCompositeDirContext.java:260)
at javax.naming.directory.InitialDirContext.createSubcontext(InitialDirContext.java:127)
at com.ibm.di.connector.LDAPConnector.putEntry(LDAPConnector.java:830)
at com.ibm.di.server.AssemblyLineComponent.executeOperation(AssemblyLineComponent.java:3166)
at com.ibm.di.server.AssemblyLineComponent.add1(AssemblyLineComponent.java:1987)
at com.ibm.di.server.AssemblyLineComponent.update(AssemblyLineComponent.java:1713)
at com.ibm.di.server.AssemblyLine.msExecuteNextConnector(AssemblyLine.java:3683)
at com.ibm.di.server.AssemblyLine.executeMainStep(AssemblyLine.java:3308)
at com.ibm.di.server.AssemblyLine.executeMainLoop(AssemblyLine.java:2944)
at com.ibm.di.server.AssemblyLine.executeMainLoop(AssemblyLine.java:2927)
at com.ibm.di.server.AssemblyLine.executeAL(AssemblyLine.java:2896)
at com.ibm.di.server.AssemblyLine.run(AssemblyLine.java:1296)
2013-12-10 21:38:38,388 ERROR [AssemblyLine.AssemblyLines/LDAPSync.1] - CTGDIS266E Error in NextConnectorOperation. Exception occurred: javax.naming.directory.SchemaViolationException: [LDAP: error code 65 - Object Class Violation]; Remaining name: 'cn=AMAURY ALONZO aa000u,ou=people, o=att,c=us'
javax.naming.directory.SchemaViolationException: [LDAP: error code 65 - Object Class Violation]; Remaining name: 'cn=AMAURY ALONZO aa000u,ou=people, o=att,c=us'
at com.sun.jndi.ldap.LdapCtx.mapErrorCode(LdapCtx.java:3110)
at com.sun.jndi.ldap.LdapCtx.processReturnCode(LdapCtx.java:3025)
at com.sun.jndi.ldap.LdapCtx.processReturnCode(LdapCtx.java:2832)
at com.sun.jndi.ldap.LdapCtx.c_createSubcontext(LdapCtx.java:803)
at com.sun.jndi.toolkit.ctx.ComponentDirContext.p_createSubcontext(ComponentDirContext.java:331)
at com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.createSubcontext(PartialCompositeDirContext.java:260)
at javax.naming.directory.InitialDirContext.createSubcontext(InitialDirContext.java:127)
at com.ibm.di.connector.LDAPConnector.putEntry(LDAPConnector.java:830)
at com.ibm.di.server.AssemblyLineComponent.executeOperation(AssemblyLineComponent.java:3166)
at com.ibm.di.server.AssemblyLineComponent.add1(AssemblyLineComponent.java:1987)
at com.ibm.di.server.AssemblyLineComponent.update(AssemblyLineComponent.java:1713)
at com.ibm.di.server.AssemblyLine.msExecuteNextConnector(AssemblyLine.java:3683)
at com.ibm.di.server.AssemblyLine.executeMainStep(AssemblyLine.java:3308)
at com.ibm.di.server.AssemblyLine.executeMainLoop(AssemblyLine.java:2944)
at com.ibm.di.server.AssemblyLine.executeMainLoop(AssemblyLine.java:2927)
at com.ibm.di.server.AssemblyLine.executeAL(AssemblyLine.java:2896)
at com.ibm.di.server.AssemblyLine.run(AssemblyLine.java:1296)
2013-12-10 21:38:38,390 INFO [AssemblyLine.AssemblyLines/LDAPSync.1] - CTGDIS100I Printing the Connector statistics.
2013-12-10 21:38:38,391 INFO [AssemblyLine.AssemblyLines/LDAPSync.1] - [WebphoneSource_1] Get:1, Skip:1
2013-12-10 21:38:38,391 INFO [AssemblyLine.AssemblyLines/LDAPSync.1] - [LDAPConnector_1] Lookup:1, Errors:1
2013-12-10 21:38:38,391 INFO [AssemblyLine.AssemblyLines/LDAPSync.1] - [DumpWorkEntry] Calls: 0
2013-12-10 21:38:38,391 INFO [AssemblyLine.AssemblyLines/LDAPSync.1] - [AddPerson2Group] Calls: 0
2013-12-10 21:38:38,391 INFO [AssemblyLine.AssemblyLines/LDAPSync.1] - CTGDIS104I Total: Get:1, Lookup:1, Skip:1, Errors:2.
2013-12-10 21:38:38,392 INFO [AssemblyLine.AssemblyLines/LDAPSync.1] - CTGDIS101I Finished printing the Connector statistics.
2013-12-10 21:38:38,392 ERROR [AssemblyLine.AssemblyLines/LDAPSync.1] - CTGDIS077I Failed with error: [LDAP: error code 65 - Object Class Violation].
2013-12-10 21:38:38,392 ERROR [_usr_local_opt_tdi_V7.1_tdisol_WebPhoneSync.xml] - CTGDIS078I AssemblyLine AssemblyLines/LDAPSync failed with error: [LDAP: error code 65 - Object Class Violation].
2013-12-10 21:38:39,058 INFO [_usr_local_opt_tdi_V7.1_tdisol_WebPhoneSync.xml] - CTGDIS037I Server terminates because only main thread is left.
2013-12-10 21:38:39,059 INFO [_usr_local_opt_tdi_V7.1_tdisol_WebPhoneSync.xml] - CTGDIS174I Config Instance _usr_local_opt_tdi_V7.1_tdisol_WebPhoneSync.xml exited with status 0.
2013-12-10 21:38:39,059 INFO [server] - CTGDIS228I Unregister server: _usr_local_opt_tdi_V7.1_tdisol_WebPhoneSync.xml.
2013-12-10 21:38:39,063 INFO [server] - CTGDIS627I IBM Tivoli Directory Integrator Shutdown.

Thanks,
JItesh

[Franzw]

Are you sure you posted the correct error ? This is an ldap object class violation - nothing to do with an OOM exception. The error shown basically tells you that an update is not conforming to the ldap schema - the most usual reason for this is a missing objectclass on the update - but that is pure guess...

OOM resolution (if there is no memoryleak that is) is described here : http://publib.boulder.ibm.com/infocenter/tivihelp/v2r1/index.jsp?topic=%2Fcom.ibm.IBMDI.doc_7.1.1%2Fpdguide42.htm

But in general it is not possible to help you very well if you do not tell os more about what you are trying to do - we are not (all of us) good mind readers - Eddie is actually quite good - but you really need to provide much more detail of your solution to receive competent help.

Regards
Franz Wolfhagen