Received: by 10.205.126.4 with SMTP id gu4mr1936734bkc.8.1341595966887;
        Fri, 06 Jul 2012 10:32:46 -0700 (PDT)
X-BeenThere: neo4j@googlegroups.com
Received: by 10.204.154.131 with SMTP id o3ls4974321bkw.6.gmail; Fri, 06 Jul
 2012 10:32:44 -0700 (PDT)
Received: by 10.204.154.76 with SMTP id n12mr3736397bkw.1.1341595963955;
        Fri, 06 Jul 2012 10:32:43 -0700 (PDT)
Received: by 10.204.154.76 with SMTP id n12mr3736396bkw.1.1341595963943;
        Fri, 06 Jul 2012 10:32:43 -0700 (PDT)
Return-Path: <michael.hun...@neopersistence.com>
Received: from mail-bk0-f52.google.com (mail-bk0-f52.google.com [209.85.214.52])
        by gmr-mx.google.com with ESMTPS id j4si8847640bkj.3.2012.07.06.10.32.43
        (version=TLSv1/SSLv3 cipher=OTHER);
        Fri, 06 Jul 2012 10:32:43 -0700 (PDT)
Received-SPF: pass (google.com: domain of michael.hun...@neopersistence.com designates 209.85.214.52 as permitted sender) client-ip=209.85.214.52;
Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of michael.hun...@neopersistence.com designates 209.85.214.52 as permitted sender) smtp.mail=michael.hun...@neopersistence.com
Received: by bkcjf3 with SMTP id jf3so5171848bkc.39
        for <neo4j@googlegroups.com>; Fri, 06 Jul 2012 10:32:43 -0700 (PDT)
        d=google.com; s=20120113;
        h=content-type:mime-version:subject:from:in-reply-to:date
         :content-transfer-encoding:message-id:references:to:x-mailer
         :x-gm-message-state;
        bh=y/v0aREFdQj53Vko0UirdGnT7fYcht/l94ncUtXTkhY=;
        b=ieTNhiNP91Qtxp8qgtX2caquKKqaSVEOyDaXzPjOchEReAdlIrrUNDmD+AWPLifVLq
         r0texfOaXfgnnd0OaH/0MmxWEfO1/HmzdkK4VMrHzs0aa5WPP2r4/A/cTxYjWIgasAGV
         jv57j0oRlmThmcB58GRbqMuvtaJgH4TKnOiCKoAwruc8uv9XpbxRYbCgkYlBKI8AwIHt
         aIyqfOqH8uxlnbA00k8tS+p/MZHbrgVm/fudOy+VhJcZNx09U624udv0k3W3bgJOKvWQ
         5xBr2wIwX22zfHDGjyvwGKfcaGVX7WRL95ZSN9hQAg044hR2HbsqD7Qtde5z1uJ1eRAj
         8W6w==
Received: by 10.204.148.83 with SMTP id o19mr15837847bkv.96.1341595963568;
        Fri, 06 Jul 2012 10:32:43 -0700 (PDT)
Return-Path: <michael.hun...@neopersistence.com>
Received: from [192.168.111.100] (146-52-36-225-dynip.superkabel.de. [146.52.36.225])
        by mx.google.com with ESMTPS id n17sm8496065bks.6.2012.07.06.10.32.41
        (version=TLSv1/SSLv3 cipher=OTHER);
        Fri, 06 Jul 2012 10:32:42 -0700 (PDT)
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Apple Message framework v1084)
Subject: Re: [Neo4j] OutOfMemeryError (GC) on creating a large number of nodes
From: Michael Hunger <michael.hun...@neotechnology.com>
In-Reply-To: <57304458-a354-46cf-8bcf-f6a587fe56df@googlegroups.com>
Date: Fri, 6 Jul 2012 19:32:40 +0200
Content-Transfer-Encoding: quoted-printable
Message-Id: <1250374E-66FE-45EF-886B-E9E977BEF...@neotechnology.com>
References: <57304458-a354-46cf-8bcf-f6a587fe56df@googlegroups.com>
To: neo4j@googlegroups.com
X-Mailer: Apple Mail (2.1084)
X-Gm-Message-State: ALoCoQm5xl0y3sXOzJYk4YXMZdS/HGlBZNhJ8DkOWBgRdOQaQkHLnKYh3RM37tJaPjOf3Uzh0KRo

Can you please share your code?

Michael

Am 06.07.2012 um 19:28 schrieb pt:

> Hi,
>=20
> On my PC, I can only have -Xmx2048m for max heap for JVM allowed. I =
tried to import an XML data which is quite huge, contains data about 7.5 =
million nodes.  The XML file itself is about 120MB in bz2 format ( from =
the original size 1.5GB.)
>=20
> I am only able to create about 600,000 nodes but no further. JAVA =
report the heap problem from GC exceeding limit. What the code does =
until now is read the XML data and creates the nodes  and indexes the =
properties of these nodes. And the code performs a transaction every =
1000 nodes created.=20
>=20
> How can I fix this problem that I am able to reach the end of the file =
? I am not sure if data import using batch insertion could solve this =
problem. I thought that any transaction which writes graph would do also =
the clean-up for the written nodes ?=20
>=20
>=20
> I will be so grateful for any suggestion.
>=20
> Thank you!
> Pattreeya
>=20
>=20