Question: How do I solve the issue when put_multi not loading all data from a text file

7 views
Skip to first unread message

LYMLeon

unread,
Nov 5, 2015, 9:27:18 PM11/5/15
to appengine-ndb-discuss
Hi,

Currently I'm trying to write data from a text file to NDB on local datastore using the development web server. I have around ~4200 entity on the text file but on the Datastore Viewer, only 1000 entities had been loaded.
The method that I'm using to put the data is:

        listOfEntities = []


        f
= open("tagTrend_refine.txt")
        lines
= f.readlines()
        f
.close()
       
for line in lines:
            temp
= line.strip().split("\t")
            data
= TagRefine(
                tag
= temp[0],
                trendData
= temp[1]
           
)
            listOfEntities
.append(data)
        ndb
.put_multi(listOfEntities)
\

May I know what the problem is? Am I hitting some kind of write limit of NDB?

Thanks a lot.

LYMLeon

unread,
Nov 5, 2015, 9:33:23 PM11/5/15
to appengine-ndb-discuss
Seems like I was careless, Datastore Viewer is only fetching 1000 entity. 
Reply all
Reply to author
Forward
0 new messages