orientdb jdbc etl after completing ETL there is no record at graph db

62 views
Skip to first unread message

kurtuluş yılmaz

unread,
Mar 30, 2015, 9:36:09 AM3/30/15
to orient-...@googlegroups.com
Hi;
I am using orientETL to migrate data from mysql to orientDB. Etl process finishes sucessfully but  when I open the orient studio there no record at db. 
ETL process ends like this.

[4377:vertex] DEBUG Transformer output: v(Member)[#12:4342]

[4379:vertex] DEBUG Transformer input: {member_id:12703030,death:N,name:fatih ,lname:savaş,adres:,sehir:0,tel:,postakodu:null,semt:,ceptel:530-4261261,add_date:2015-03-30 16:22:37.0,fax:null,dog_tar:null,cinsiyet:null,gelir_duz:null,sektor:null,gorev:null,ilgialani:null,egit:null,medenihal:null,nereden:null,amac:null,kategori:null,duy:null,dontask:0000000000000000,gsmOperator:0,birthdate_day_month:null,birthdate_year:null}

[4379:vertex] DEBUG Transformer output: v(Member)[#12:4343]

END ETL PROCESSOR

+ extracted 4,381 records (4,394 records/sec) - 4,381 records -> loaded 2,190 vertices (2,197 vertices/sec) Total time: 1815ms [0 warnings, 0 errors]

My config file is


{

    "config": {

        "log": "debug"

    },

    "extractor": {

        "jdbc": {

            "driver": "com.mysql.jdbc.Driver",

            "url": "jdbc:mysql://ap-elk-mysql2.pool.gittigidiyor.net:3306/gg",

            "userName": "elek_read",

            "userPassword": "SPvhrIiU1sNeP",

            "query": "select * from `gg`.`member` where member_id > 12700834"

        }

    },

    "transformers": [

        {

            "vertex": {

                "class": "Member"

            }

        }

    ],

    "loader": {

        "orientdb": {

            "dbURL": "plocal:/Users/ykurtulus/orientdb-community-2.0.5/databases/ElekMigrationTest8",

"dbUser": "root",

"dbPassword": "Kaos8619",

"dbAutoCreate": true,

"tx": true,

"batchCommit": 1000,

"wal" : false,

"dbType": "graph",

"classes": [

       {"name": "Member", "extends": "V"}    

     ]

        }

    }

}


and when I use the console I get an error  : java.lang.ArrayIndexOutOfBoundsException: 0 [ONetworkProtocolHttpDb]

Can you help about what I am doing wrong.

Best Regards.





kurtuluş yılmaz

unread,
Mar 30, 2015, 11:37:05 AM3/30/15
to orient-...@googlegroups.com
Hi Again,
Error at logs is

quested: POST /command/ElekMigrationTest10/sql/-/20 [ONetworkProtocolHttpDb]Caught exception

com.orientechnologies.orient.core.exception.OCommandExecutionException: Error on execution of command: sql.select * from Member

at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.executeCommand(OAbstractPaginatedStorage.java:1195)

at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.command(OAbstractPaginatedStorage.java:1178)

at com.orientechnologies.orient.core.command.OCommandRequestTextAbstract.execute(OCommandRequestTextAbstract.java:63)

at com.orientechnologies.orient.server.network.protocol.http.command.post.OServerCommandPostCommand.execute(OServerCommandPostCommand.java:81)

at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.service(ONetworkProtocolHttpAbstract.java:174)

at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.execute(ONetworkProtocolHttpAbstract.java:574)

at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:69)

Caused by: java.lang.ArrayIndexOutOfBoundsException: 0

at com.orientechnologies.orient.core.iterator.ORecordIteratorClusters.updateClusterRange(ORecordIteratorClusters.java:374)

at com.orientechnologies.orient.core.iterator.ORecordIteratorClass.config(ORecordIteratorClass.java:123)

at com.orientechnologies.orient.core.iterator.ORecordIteratorClass.<init>(ORecordIteratorClass.java:82)

at com.orientechnologies.orient.core.sql.OCommandExecutorSQLResultsetAbstract.searchInClasses(OCommandExecutorSQLResultsetAbstract.java:447)

at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.searchInClasses(OCommandExecutorSQLSelect.java:768)

at com.orientechnologies.orient.core.sql.OCommandExecutorSQLResultsetAbstract.assignTarget(OCommandExecutorSQLResultsetAbstract.java:194)

at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.assignTarget(OCommandExecutorSQLSelect.java:438)

at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.executeSearch(OCommandExecutorSQLSelect.java:420)

at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.execute(OCommandExecutorSQLSelect.java:391)

at com.orientechnologies.orient.core.sql.OCommandExecutorSQLDelegate.execute(OCommandExecutorSQLDelegate.java:64)

at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.executeCommand(OAbstractPaginatedStorage.java:1189)

... 6 more


30 Mart 2015 Pazartesi 16:36:09 UTC+3 tarihinde kurtuluş yılmaz yazdı:

kurtuluş yılmaz

unread,
Mar 30, 2015, 4:15:15 PM3/30/15
to orient-...@googlegroups.com
Hi all;
I find the resolution of my problem. I did not create class Member  before running etl and ETL creates class Member with error so I got an exception. To solve this problem you must create orient class before runnig ETL. 
Best Regards.


30 Mart 2015 Pazartesi 16:36:09 UTC+3 tarihinde kurtuluş yılmaz yazdı:
Hi;
Reply all
Reply to author
Forward
0 new messages