I'm working on a new website which aims to give all Android developers
much more information about what's happening with the market and some
tools to see how their apps are doing in relation to other apps. As
part of the services, we are going to supply a downloadable .csv file
containing all apps on the market, their market ratings, the index of
where they are in the "Popular" order (if they show up at all), and
two other rating systems we have developed (which are considerably
better than the market ratings), and another file containing a list of
all developers. The files will be available to anyone who wants to
download them.
While programming this it has occurred to me many times that a lot of
the work I'm doing is being duplicated in whole or in part by most of
the people on this list, and if we cooperated a little we could save
each other a ton of work and/or bandwidth. For instance, the file I
will share that contains the app information will contain the package
name of the app, so any dev that is working with this API could use it
to download the complete app information much more efficiently than
trying to get it by the different techniques we are all using to try
to get complete lists from the market. And the file with dev info
could be used to pull all the dev's apps fairly efficiently.
SO... my thought was that if I supplied these files to everyone it
would make all our lives easier... but to do it I need to be sure my
own data is very up to date. I'm wondering if some other devs on this
list who have fairly complete data would be willing to share it with
me, so I can share it with everyone. If just a few of us cooperated we
could save everyone a lot of time and effort.
Anyone willing to help out?
OH... the first test file I created for the apps is available here :
> I'm working on a new website which aims to give all Android developers
> much more information about what's happening with the market and some
> tools to see how their apps are doing in relation to other apps. As
> part of the services, we are going to supply a downloadable .csv file
> containing all apps on the market, their market ratings, the index of
> where they are in the "Popular" order (if they show up at all), and
> two other rating systems we have developed (which are considerably
> better than the market ratings), and another file containing a list of
> all developers. The files will be available to anyone who wants to
> download them.
> While programming this it has occurred to me many times that a lot of
> the work I'm doing is being duplicated in whole or in part by most of
> the people on this list, and if we cooperated a little we could save
> each other a ton of work and/or bandwidth. For instance, the file I
> will share that contains the app information will contain the package
> name of the app, so any dev that is working with this API could use it
> to download the complete app information much more efficiently than
> trying to get it by the different techniques we are all using to try
> to get complete lists from the market. And the file with dev info
> could be used to pull all the dev's apps fairly efficiently.
> SO... my thought was that if I supplied these files to everyone it
> would make all our lives easier... but to do it I need to be sure my
> own data is very up to date. I'm wondering if some other devs on this
> list who have fairly complete data would be willing to share it with
> me, so I can share it with everyone. If just a few of us cooperated we
> could save everyone a lot of time and effort.
> Anyone willing to help out?
> OH... the first test file I created for the apps is available here :
On Mon, Nov 8, 2010 at 2:37 AM, Ian <ian.shaun.tho...@gmail.com> wrote: > Ive been thinking of something like this too.. It would be great if > one of the major sites made an API to interface its information.
> On Nov 6, 3:45 pm, Brad <rbg...@gmail.com> wrote: >> I'm working on a new website which aims to give all Android developers >> much more information about what's happening with the market and some >> tools to see how their apps are doing in relation to other apps. As >> part of the services, we are going to supply a downloadable .csv file >> containing all apps on the market, their market ratings, the index of >> where they are in the "Popular" order (if they show up at all), and >> two other rating systems we have developed (which are considerably >> better than the market ratings), and another file containing a list of >> all developers. The files will be available to anyone who wants to >> download them.
>> While programming this it has occurred to me many times that a lot of >> the work I'm doing is being duplicated in whole or in part by most of >> the people on this list, and if we cooperated a little we could save >> each other a ton of work and/or bandwidth. For instance, the file I >> will share that contains the app information will contain the package >> name of the app, so any dev that is working with this API could use it >> to download the complete app information much more efficiently than >> trying to get it by the different techniques we are all using to try >> to get complete lists from the market. And the file with dev info >> could be used to pull all the dev's apps fairly efficiently.
>> SO... my thought was that if I supplied these files to everyone it >> would make all our lives easier... but to do it I need to be sure my >> own data is very up to date. I'm wondering if some other devs on this >> list who have fairly complete data would be willing to share it with >> me, so I can share it with everyone. If just a few of us cooperated we >> could save everyone a lot of time and effort.
>> Anyone willing to help out?
>> OH... the first test file I created for the apps is available here :
>> It's not complete, and the fields (in order) are: >> My id # >> package name >> market rating >> No Crappy Apps Rating >> User Rating
>> Hope to hear from a bunch of you !
>> Thanks
>> Brad.
> -- > You received this message because you are subscribed to the Google Groups "android-market-api" group. > To post to this group, send email to android-market-api@googlegroups.com. > To unsubscribe from this group, send email to android-market-api+unsubscribe@googlegroups.com. > For more options, visit this group at http://groups.google.com/group/android-market-api?hl=en.
I should have added that I have already decided to share the
information, and if people let me know what they want, I can easily
add more fields, but I think most people will still need to use the
API to pull some information... I'm just hoping to supply the
information people need to get fairly complete data without having to
poll for every possible combination of Locale, category, view type,
SDK version, operator, app Type, and order type. I've been doing it,
and I'm now to the point of running 1,000 queries for every one that
returns new or updated information. It's an incredible waste of
resources and bandwidth.
For now, I'll put out one file of app package names (with current
version id) because it's the only unique identifier for an app, and by
having the current version, anyone could determine if they need to
update their information for that app. The other file will be
developer id's, and it's only real purpose is to make sure the list is
complete... If I have all the dev Id's I should have all the apps. So,
my hope is that other dev's will supply me with any package names, and
dev id's, I'm missing. Then I can pull them and make them available to
anyone who wants them.
I'm hoping that a few of you will be willing to write something to
compare my list's against yours and send me a list of anything I'm
missing. If it gets to the point where I am fairly confident that I've
got everything, then I would consider making a file available
including all the app info, including the extended info... but if I do
that, the file would be big enough to cause some problems if people
downloaded it constantly, so I'd have to only allow access to it from
a web service or web page and limit the number of downloads per
developer to one a day or so.
If you want to help, send me a .csv file of dev id's and package names
(separate files) and I'll whip up a program to read and compare
them... It won't matter if you send duplicates. It just needs to be a
single field per row with either the dev id or package name.
On Nov 7, 10:37 am, Ian <ian.shaun.tho...@gmail.com> wrote:
I've made android market crawler and now have ~22k applications. You
could search applications by package name using API. Access is open
for everyone and free. You could find docs here:
http://checkware.ru/warenet.html
Hope that might help
On Nov 7, 12:45 am, Brad <rbg...@gmail.com> wrote:
> I'm working on a new website which aims to give all Android developers
> much more information about what's happening with the market and some
> tools to see how their apps are doing in relation to other apps. As
> part of the services, we are going to supply a downloadable .csv file
> containing all apps on the market, their market ratings, the index of
> where they are in the "Popular" order (if they show up at all), and
> two other rating systems we have developed (which are considerably
> better than the market ratings), and another file containing a list of
> all developers. The files will be available to anyone who wants to
> download them.
> While programming this it has occurred to me many times that a lot of
> the work I'm doing is being duplicated in whole or in part by most of
> the people on this list, and if we cooperated a little we could save
> each other a ton of work and/or bandwidth. For instance, the file I
> will share that contains the app information will contain the package
> name of the app, so any dev that is working with this API could use it
> to download the complete app information much more efficiently than
> trying to get it by the different techniques we are all using to try
> to get complete lists from the market. And the file with dev info
> could be used to pull all the dev's apps fairly efficiently.
> SO... my thought was that if I supplied these files to everyone it
> would make all our lives easier... but to do it I need to be sure my
> own data is very up to date. I'm wondering if some other devs on this
> list who have fairly complete data would be willing to share it with
> me, so I can share it with everyone. If just a few of us cooperated we
> could save everyone a lot of time and effort.
> Anyone willing to help out?
> OH... the first test file I created for the apps is available here :
I make a fast check for same application returned from this site and information fetched from android market and seems taht your info is not up to date.
Cheers
On 11 November 2010 20:35, dernasherbrezon <dernasherbre...@gmail.com>wrote:
> I've made android market crawler and now have ~22k applications. You > could search applications by package name using API. Access is open > for everyone and free. You could find docs here: > http://checkware.ru/warenet.html
> Hope that might help
> On Nov 7, 12:45 am, Brad <rbg...@gmail.com> wrote: > > I'm working on a new website which aims to give all Android developers > > much more information about what's happening with the market and some > > tools to see how their apps are doing in relation to other apps. As > > part of the services, we are going to supply a downloadable .csv file > > containing all apps on the market, their market ratings, the index of > > where they are in the "Popular" order (if they show up at all), and > > two other rating systems we have developed (which are considerably > > better than the market ratings), and another file containing a list of > > all developers. The files will be available to anyone who wants to > > download them.
> > While programming this it has occurred to me many times that a lot of > > the work I'm doing is being duplicated in whole or in part by most of > > the people on this list, and if we cooperated a little we could save > > each other a ton of work and/or bandwidth. For instance, the file I > > will share that contains the app information will contain the package > > name of the app, so any dev that is working with this API could use it > > to download the complete app information much more efficiently than > > trying to get it by the different techniques we are all using to try > > to get complete lists from the market. And the file with dev info > > could be used to pull all the dev's apps fairly efficiently.
> > SO... my thought was that if I supplied these files to everyone it > > would make all our lives easier... but to do it I need to be sure my > > own data is very up to date. I'm wondering if some other devs on this > > list who have fairly complete data would be willing to share it with > > me, so I can share it with everyone. If just a few of us cooperated we > > could save everyone a lot of time and effort.
> > Anyone willing to help out?
> > OH... the first test file I created for the apps is available here :
> > It's not complete, and the fields (in order) are: > > My id # > > package name > > market rating > > No Crappy Apps Rating > > User Rating
> > Hope to hear from a bunch of you !
> > Thanks
> > Brad.
> -- > You received this message because you are subscribed to the Google Groups > "android-market-api" group. > To post to this group, send email to android-market-api@googlegroups.com. > To unsubscribe from this group, send email to > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com> > . > For more options, visit this group at > http://groups.google.com/group/android-market-api?hl=en.
Not yet. I get 503 exception while using the same loginid for quering
by category/price/etc, so now I'm working on improving algorithm.
Silly, that we are all doing the same things.
On Nov 11, 9:53 pm, Peter Vukadinov <p.vukadi...@gmail.com> wrote:
> I make a fast check for same application returned from this site and
> information fetched from android market and seems taht your info is not up
> to date.
> Cheers
> On 11 November 2010 20:35, dernasherbrezon <dernasherbre...@gmail.com>wrote:
> > Hi Brad,
> > I've made android market crawler and now have ~22k applications. You
> > could search applications by package name using API. Access is open
> > for everyone and free. You could find docs here:
> >http://checkware.ru/warenet.html
> > Hope that might help
> > On Nov 7, 12:45 am, Brad <rbg...@gmail.com> wrote:
> > > I'm working on a new website which aims to give all Android developers
> > > much more information about what's happening with the market and some
> > > tools to see how their apps are doing in relation to other apps. As
> > > part of the services, we are going to supply a downloadable .csv file
> > > containing all apps on the market, their market ratings, the index of
> > > where they are in the "Popular" order (if they show up at all), and
> > > two other rating systems we have developed (which are considerably
> > > better than the market ratings), and another file containing a list of
> > > all developers. The files will be available to anyone who wants to
> > > download them.
> > > While programming this it has occurred to me many times that a lot of
> > > the work I'm doing is being duplicated in whole or in part by most of
> > > the people on this list, and if we cooperated a little we could save
> > > each other a ton of work and/or bandwidth. For instance, the file I
> > > will share that contains the app information will contain the package
> > > name of the app, so any dev that is working with this API could use it
> > > to download the complete app information much more efficiently than
> > > trying to get it by the different techniques we are all using to try
> > > to get complete lists from the market. And the file with dev info
> > > could be used to pull all the dev's apps fairly efficiently.
> > > SO... my thought was that if I supplied these files to everyone it
> > > would make all our lives easier... but to do it I need to be sure my
> > > own data is very up to date. I'm wondering if some other devs on this
> > > list who have fairly complete data would be willing to share it with
> > > me, so I can share it with everyone. If just a few of us cooperated we
> > > could save everyone a lot of time and effort.
> > > Anyone willing to help out?
> > > OH... the first test file I created for the apps is available here :
> > > It's not complete, and the fields (in order) are:
> > > My id #
> > > package name
> > > market rating
> > > No Crappy Apps Rating
> > > User Rating
> > > Hope to hear from a bunch of you !
> > > Thanks
> > > Brad.
> > --
> > You received this message because you are subscribed to the Google Groups
> > "android-market-api" group.
> > To post to this group, send email to android-market-api@googlegroups.com.
> > To unsubscribe from this group, send email to
> > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com>
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/android-market-api?hl=en.
Ok... I'll have a look at it and see if you have any I don't.
Thanks...
You might want to try my file also... I've got 64,000+ apps in it
right now, and I'm generating the file nightly (about 20 minutes after
midnight UTC time). I mention the format for pulling the latest file
in one of the messages above. As of tonight it only contains the
fields I mention above, but tonight I am going to change it to put the
current version number in it, and also the developer id. It will make
it much more useful for anyone else. I'll post back here after I've
made the change, and give the field list and let you know the file
name. I'm going to see if I can just write the same file name every
time, so that whenever you pull it, it will be the last one generated.
Oh.. on a related note.. Does anyone know what the total apps in the
market right now.... I've been working on the assumption that there
over 70,000 apps, but now I hear the actual number today could be over
100,000.
What's the highest number anyone has?
On Nov 11, 10:35 am, dernasherbrezon <dernasherbre...@gmail.com>
wrote:
> I've made android market crawler and now have ~22k applications. You
> could search applications by package name using API. Access is open
> for everyone and free. You could find docs here:http://checkware.ru/warenet.html
> Hope that might help
> On Nov 7, 12:45 am, Brad <rbg...@gmail.com> wrote:
> > I'm working on a new website which aims to give all Android developers
> > much more information about what's happening with the market and some
> > tools to see how their apps are doing in relation to other apps. As
> > part of the services, we are going to supply a downloadable .csv file
> > containing all apps on the market, their market ratings, the index of
> > where they are in the "Popular" order (if they show up at all), and
> > two other rating systems we have developed (which are considerably
> > better than the market ratings), and another file containing a list of
> > all developers. The files will be available to anyone who wants to
> > download them.
> > While programming this it has occurred to me many times that a lot of
> > the work I'm doing is being duplicated in whole or in part by most of
> > the people on this list, and if we cooperated a little we could save
> > each other a ton of work and/or bandwidth. For instance, the file I
> > will share that contains the app information will contain the package
> > name of the app, so any dev that is working with this API could use it
> > to download the complete app information much more efficiently than
> > trying to get it by the different techniques we are all using to try
> > to get complete lists from the market. And the file with dev info
> > could be used to pull all the dev's apps fairly efficiently.
> > SO... my thought was that if I supplied these files to everyone it
> > would make all our lives easier... but to do it I need to be sure my
> > own data is very up to date. I'm wondering if some other devs on this
> > list who have fairly complete data would be willing to share it with
> > me, so I can share it with everyone. If just a few of us cooperated we
> > could save everyone a lot of time and effort.
> > Anyone willing to help out?
> > OH... the first test file I created for the apps is available here :
I checked just now and i have 112,494 distinct package names in my database (http://www.appcellar.com). If somebody is compiling the list now I can give the data. I'm fetching all applications per version/locale/author once a day.
On Fri, Nov 12, 2010 at 9:17 AM, Brad <rbg...@gmail.com> wrote: > Ok... I'll have a look at it and see if you have any I don't. > Thanks...
> You might want to try my file also... I've got 64,000+ apps in it > right now, and I'm generating the file nightly (about 20 minutes after > midnight UTC time). I mention the format for pulling the latest file > in one of the messages above. As of tonight it only contains the > fields I mention above, but tonight I am going to change it to put the > current version number in it, and also the developer id. It will make > it much more useful for anyone else. I'll post back here after I've > made the change, and give the field list and let you know the file > name. I'm going to see if I can just write the same file name every > time, so that whenever you pull it, it will be the last one generated.
> Oh.. on a related note.. Does anyone know what the total apps in the > market right now.... I've been working on the assumption that there > over 70,000 apps, but now I hear the actual number today could be over > 100,000.
> What's the highest number anyone has?
> On Nov 11, 10:35 am, dernasherbrezon <dernasherbre...@gmail.com> > wrote: > > Hi Brad,
> > I've made android market crawler and now have ~22k applications. You > > could search applications by package name using API. Access is open > > for everyone and free. You could find docs here: > http://checkware.ru/warenet.html
> > Hope that might help
> > On Nov 7, 12:45 am, Brad <rbg...@gmail.com> wrote:
> > > I'm working on a new website which aims to give all Android developers > > > much more information about what's happening with the market and some > > > tools to see how their apps are doing in relation to other apps. As > > > part of the services, we are going to supply a downloadable .csv file > > > containing all apps on the market, their market ratings, the index of > > > where they are in the "Popular" order (if they show up at all), and > > > two other rating systems we have developed (which are considerably > > > better than the market ratings), and another file containing a list of > > > all developers. The files will be available to anyone who wants to > > > download them.
> > > While programming this it has occurred to me many times that a lot of > > > the work I'm doing is being duplicated in whole or in part by most of > > > the people on this list, and if we cooperated a little we could save > > > each other a ton of work and/or bandwidth. For instance, the file I > > > will share that contains the app information will contain the package > > > name of the app, so any dev that is working with this API could use it > > > to download the complete app information much more efficiently than > > > trying to get it by the different techniques we are all using to try > > > to get complete lists from the market. And the file with dev info > > > could be used to pull all the dev's apps fairly efficiently.
> > > SO... my thought was that if I supplied these files to everyone it > > > would make all our lives easier... but to do it I need to be sure my > > > own data is very up to date. I'm wondering if some other devs on this > > > list who have fairly complete data would be willing to share it with > > > me, so I can share it with everyone. If just a few of us cooperated we > > > could save everyone a lot of time and effort.
> > > Anyone willing to help out?
> > > OH... the first test file I created for the apps is available here :
> > > It's not complete, and the fields (in order) are: > > > My id # > > > package name > > > market rating > > > No Crappy Apps Rating > > > User Rating
> > > Hope to hear from a bunch of you !
> > > Thanks
> > > Brad.
> -- > You received this message because you are subscribed to the Google Groups > "android-market-api" group. > To post to this group, send email to android-market-api@googlegroups.com. > To unsubscribe from this group, send email to > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com> > . > For more options, visit this group at > http://groups.google.com/group/android-market-api?hl=en.
Yeah... if you can send the package name to me.. or make them available somewhere, I'll add the information, and it should be in my file whenever it is recreated.
> I checked just now and i have 112,494 distinct package names in my > database (http://www.appcellar.com). If somebody is compiling the list > now I can give the data. I'm fetching all applications per > version/locale/author once a day.
> On Fri, Nov 12, 2010 at 9:17 AM, Brad <rbg...@gmail.com > <mailto:rbg...@gmail.com>> wrote:
> Ok... I'll have a look at it and see if you have any I don't. > Thanks...
> You might want to try my file also... I've got 64,000+ apps in it > right now, and I'm generating the file nightly (about 20 minutes after > midnight UTC time). I mention the format for pulling the latest file > in one of the messages above. As of tonight it only contains the > fields I mention above, but tonight I am going to change it to put the > current version number in it, and also the developer id. It will make > it much more useful for anyone else. I'll post back here after I've > made the change, and give the field list and let you know the file > name. I'm going to see if I can just write the same file name every > time, so that whenever you pull it, it will be the last one generated.
> Oh.. on a related note.. Does anyone know what the total apps in the > market right now.... I've been working on the assumption that there > over 70,000 apps, but now I hear the actual number today could be over > 100,000.
> What's the highest number anyone has?
> On Nov 11, 10:35 am, dernasherbrezon <dernasherbre...@gmail.com > <mailto:dernasherbre...@gmail.com>> > wrote: > > Hi Brad,
> > I've made android market crawler and now have ~22k applications. You > > could search applications by package name using API. Access is open > > for everyone and free. You could find docs > here:http://checkware.ru/warenet.html
> > Hope that might help
> > On Nov 7, 12:45 am, Brad <rbg...@gmail.com > <mailto:rbg...@gmail.com>> wrote:
> > > I'm working on a new website which aims to give all Android > developers > > > much more information about what's happening with the market > and some > > > tools to see how their apps are doing in relation to other > apps. As > > > part of the services, we are going to supply a downloadable > .csv file > > > containing all apps on the market, their market ratings, the > index of > > > where they are in the "Popular" order (if they show up at > all), and > > > two other rating systems we have developed (which are considerably > > > better than the market ratings), and another file containing a > list of > > > all developers. The files will be available to anyone who wants to > > > download them.
> > > While programming this it has occurred to me many times that a > lot of > > > the work I'm doing is being duplicated in whole or in part by > most of > > > the people on this list, and if we cooperated a little we > could save > > > each other a ton of work and/or bandwidth. For instance, the > file I > > > will share that contains the app information will contain the > package > > > name of the app, so any dev that is working with this API > could use it > > > to download the complete app information much more efficiently > than > > > trying to get it by the different techniques we are all using > to try > > > to get complete lists from the market. And the file with dev info > > > could be used to pull all the dev's apps fairly efficiently.
> > > SO... my thought was that if I supplied these files to everyone it > > > would make all our lives easier... but to do it I need to be > sure my > > > own data is very up to date. I'm wondering if some other devs > on this > > > list who have fairly complete data would be willing to share > it with > > > me, so I can share it with everyone. If just a few of us > cooperated we > > > could save everyone a lot of time and effort.
> > > Anyone willing to help out?
> > > OH... the first test file I created for the apps is available > here :
> > > It's not complete, and the fields (in order) are: > > > My id # > > > package name > > > market rating > > > No Crappy Apps Rating > > > User Rating
> > > Hope to hear from a bunch of you !
> > > Thanks
> > > Brad.
> -- > You received this message because you are subscribed to the Google > Groups "android-market-api" group. > To post to this group, send email to > android-market-api@googlegroups.com > <mailto:android-market-api@googlegroups.com>. > To unsubscribe from this group, send email to > android-market-api+unsubscribe@googlegroups.com > <mailto:android-market-api%2Bunsubscribe@googlegroups.com>. > For more options, visit this group at > http://groups.google.com/group/android-market-api?hl=en.
> -- > You received this message because you are subscribed to the Google > Groups "android-market-api" group. > To post to this group, send email to android-market-api@googlegroups.com. > To unsubscribe from this group, send email to > android-market-api+unsubscribe@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/android-market-api?hl=en.
On Fri, Nov 12, 2010 at 9:47 AM, Brad Gies <rbg...@gmail.com> wrote:
> Yeah... if you can send the package name to me.. or make them available > somewhere, I'll add the information, and it should be in my file whenever it > is recreated.
> Every person is born with a brain... Those who use it well are the > successful happy ones - Brad Gies
> Adversity can make or break you... It's your choice... Choose wisely - Brad > Gies
> Never doubt that a small group of thoughtful, committed people can > change the world. Indeed. It is the only thing that ever has - Margaret > Mead
> On 11/11/2010 5:42 PM, Marc Lester Tan wrote:
>> Hi guys,
>> I checked just now and i have 112,494 distinct package names in my >> database (http://www.appcellar.com). If somebody is compiling the list >> now I can give the data. I'm fetching all applications per >> version/locale/author once a day.
>> On Fri, Nov 12, 2010 at 9:17 AM, Brad <rbg...@gmail.com <mailto: >> rbg...@gmail.com>> wrote:
>> Ok... I'll have a look at it and see if you have any I don't. >> Thanks...
>> You might want to try my file also... I've got 64,000+ apps in it >> right now, and I'm generating the file nightly (about 20 minutes after >> midnight UTC time). I mention the format for pulling the latest file >> in one of the messages above. As of tonight it only contains the >> fields I mention above, but tonight I am going to change it to put the >> current version number in it, and also the developer id. It will make >> it much more useful for anyone else. I'll post back here after I've >> made the change, and give the field list and let you know the file >> name. I'm going to see if I can just write the same file name every >> time, so that whenever you pull it, it will be the last one generated.
>> Oh.. on a related note.. Does anyone know what the total apps in the >> market right now.... I've been working on the assumption that there >> over 70,000 apps, but now I hear the actual number today could be over >> 100,000.
>> What's the highest number anyone has?
>> On Nov 11, 10:35 am, dernasherbrezon <dernasherbre...@gmail.com >> <mailto:dernasherbre...@gmail.com>>
>> wrote: >> > Hi Brad,
>> > I've made android market crawler and now have ~22k applications. You >> > could search applications by package name using API. Access is open >> > for everyone and free. You could find docs >> here:http://checkware.ru/warenet.html
>> > Hope that might help
>> > On Nov 7, 12:45 am, Brad <rbg...@gmail.com >> <mailto:rbg...@gmail.com>> wrote:
>> > > I'm working on a new website which aims to give all Android >> developers >> > > much more information about what's happening with the market >> and some >> > > tools to see how their apps are doing in relation to other >> apps. As >> > > part of the services, we are going to supply a downloadable >> .csv file >> > > containing all apps on the market, their market ratings, the >> index of >> > > where they are in the "Popular" order (if they show up at >> all), and >> > > two other rating systems we have developed (which are considerably >> > > better than the market ratings), and another file containing a >> list of >> > > all developers. The files will be available to anyone who wants to >> > > download them.
>> > > While programming this it has occurred to me many times that a >> lot of >> > > the work I'm doing is being duplicated in whole or in part by >> most of >> > > the people on this list, and if we cooperated a little we >> could save >> > > each other a ton of work and/or bandwidth. For instance, the >> file I >> > > will share that contains the app information will contain the >> package >> > > name of the app, so any dev that is working with this API >> could use it >> > > to download the complete app information much more efficiently >> than >> > > trying to get it by the different techniques we are all using >> to try >> > > to get complete lists from the market. And the file with dev info >> > > could be used to pull all the dev's apps fairly efficiently.
>> > > SO... my thought was that if I supplied these files to everyone it >> > > would make all our lives easier... but to do it I need to be >> sure my >> > > own data is very up to date. I'm wondering if some other devs >> on this >> > > list who have fairly complete data would be willing to share >> it with >> > > me, so I can share it with everyone. If just a few of us >> cooperated we >> > > could save everyone a lot of time and effort.
>> > > Anyone willing to help out?
>> > > OH... the first test file I created for the apps is available >> here :
>> > > It's not complete, and the fields (in order) are: >> > > My id # >> > > package name >> > > market rating >> > > No Crappy Apps Rating >> > > User Rating
>> > > Hope to hear from a bunch of you !
>> > > Thanks
>> > > Brad.
>> -- >> You received this message because you are subscribed to the Google >> Groups "android-market-api" group. >> To post to this group, send email to >> android-market-api@googlegroups.com >> <mailto:android-market-api@googlegroups.com>.
>> To unsubscribe from this group, send email to >> android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com> >> <mailto:android-market-api%2Bunsubscribe@googlegroups.com<android-market-ap i%252Bunsubscribe@googlegroups.com> >> >.
>> -- >> You received this message because you are subscribed to the Google Groups >> "android-market-api" group. >> To post to this group, send email to android-market-api@googlegroups.com. >> To unsubscribe from this group, send email to >> android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com> >> . >> For more options, visit this group at >> http://groups.google.com/group/android-market-api?hl=en.
> -- > You received this message because you are subscribed to the Google Groups > "android-market-api" group. > To post to this group, send email to android-market-api@googlegroups.com. > To unsubscribe from this group, send email to > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com> > . > For more options, visit this group at > http://groups.google.com/group/android-market-api?hl=en.
Hah... that'll give me something to do tonight :). But seriously... thanks... it's much appreciated.
By the way, Marc, I've been on your site a couple of times and it's really well done..
I'll make it available on my site for anyone else that wants it. Probably won't be finished tonight, because the way I'm creating the file right now requires me to pull the info from the market before it goes into the table I'm pulling the data from, but in the next day or two it should be done.
Really, really much appreciated and I'll try to figure out how to give you credit when someone pulls the file from my site.
> On Fri, Nov 12, 2010 at 9:47 AM, Brad Gies <rbg...@gmail.com > <mailto:rbg...@gmail.com>> wrote:
> Yeah... if you can send the package name to me.. or make them > available somewhere, I'll add the information, and it should be in > my file whenever it is recreated.
> Every person is born with a brain... Those who use it well are the > successful happy ones - Brad Gies
> Adversity can make or break you... It's your choice... Choose > wisely - Brad Gies
> Never doubt that a small group of thoughtful, committed people can > change the world. Indeed. It is the only thing that ever has - > Margaret Mead
> On 11/11/2010 5:42 PM, Marc Lester Tan wrote:
> Hi guys,
> I checked just now and i have 112,494 distinct package names > in my database (http://www.appcellar.com). If somebody is > compiling the list now I can give the data. I'm fetching all > applications per version/locale/author once a day.
> On Fri, Nov 12, 2010 at 9:17 AM, Brad <rbg...@gmail.com > <mailto:rbg...@gmail.com> <mailto:rbg...@gmail.com > <mailto:rbg...@gmail.com>>> wrote:
> Ok... I'll have a look at it and see if you have any I don't. > Thanks...
> You might want to try my file also... I've got 64,000+ apps > in it > right now, and I'm generating the file nightly (about 20 > minutes after > midnight UTC time). I mention the format for pulling the > latest file > in one of the messages above. As of tonight it only > contains the > fields I mention above, but tonight I am going to change it > to put the > current version number in it, and also the developer id. It > will make > it much more useful for anyone else. I'll post back here > after I've > made the change, and give the field list and let you know > the file > name. I'm going to see if I can just write the same file > name every > time, so that whenever you pull it, it will be the last one > generated.
> Oh.. on a related note.. Does anyone know what the total > apps in the > market right now.... I've been working on the assumption > that there > over 70,000 apps, but now I hear the actual number today > could be over > 100,000.
> What's the highest number anyone has?
> On Nov 11, 10:35 am, dernasherbrezon > <dernasherbre...@gmail.com <mailto:dernasherbre...@gmail.com> > <mailto:dernasherbre...@gmail.com > <mailto:dernasherbre...@gmail.com>>>
> wrote: > > Hi Brad,
> > I've made android market crawler and now have ~22k > applications. You > > could search applications by package name using API. Access > is open > > for everyone and free. You could find docs > here:http://checkware.ru/warenet.html
> > Hope that might help
> > On Nov 7, 12:45 am, Brad <rbg...@gmail.com > <mailto:rbg...@gmail.com> > <mailto:rbg...@gmail.com <mailto:rbg...@gmail.com>>> wrote:
> > > I'm working on a new website which aims to give all Android > developers > > > much more information about what's happening with the market > and some > > > tools to see how their apps are doing in relation to other > apps. As > > > part of the services, we are going to supply a downloadable > .csv file > > > containing all apps on the market, their market ratings, the > index of > > > where they are in the "Popular" order (if they show up at > all), and > > > two other rating systems we have developed (which are > considerably > > > better than the market ratings), and another file containing a > list of > > > all developers. The files will be available to anyone who > wants to > > > download them.
> > > While programming this it has occurred to me many times that a > lot of > > > the work I'm doing is being duplicated in whole or in part by > most of > > > the people on this list, and if we cooperated a little we > could save > > > each other a ton of work and/or bandwidth. For instance, the > file I > > > will share that contains the app information will contain the > package > > > name of the app, so any dev that is working with this API > could use it > > > to download the complete app information much more efficiently > than > > > trying to get it by the different techniques we are all using > to try > > > to get complete lists from the market. And the file with > dev info > > > could be used to pull all the dev's apps fairly efficiently.
> > > SO... my thought was that if I supplied these files to > everyone it > > > would make all our lives easier... but to do it I need to be > sure my > > > own data is very up to date. I'm wondering if some other devs > on this > > > list who have fairly complete data would be willing to share > it with > > > me, so I can share it with everyone. If just a few of us > cooperated we > > > could save everyone a lot of time and effort.
> > > Anyone willing to help out?
> > > OH... the first test file I created for the apps is available > here :
> > > It's not complete, and the fields (in order) are: > > > My id # > > > package name > > > market rating > > > No Crappy Apps Rating > > > User Rating
> > > Hope to hear from a bunch of you !
> > > Thanks
> > > Brad.
> -- > You received this message because you are subscribed to the > Google > Groups "android-market-api" group. > To post to this group, send email to > android-market-api@googlegroups.com > <mailto:android-market-api@googlegroups.com> > <mailto:android-market-api@googlegroups.com > <mailto:android-market-api@googlegroups.com>>.
> To unsubscribe from this group, send email to > android-market-api+unsubscribe@googlegroups.com > <mailto:android-market-api%2Bunsubscribe@googlegroups.com> > <mailto:android-market-api%2Bunsubscribe@googlegroups.com > <mailto:android-market-api%252Bunsubscribe@googlegroups.com>>.
> -- > You received this message because you are subscribed to the > Google Groups "android-market-api" group. > To post to this group, send email to > android-market-api@googlegroups.com > <mailto:android-market-api@googlegroups.com>. > To unsubscribe from this group, send email to > android-market-api+unsubscribe@googlegroups.com > <mailto:android-market-api%2Bunsubscribe@googlegroups.com>. > For more
On Fri, Nov 12, 2010 at 1:01 PM, Brad Gies <rbg...@gmail.com> wrote: > Hah... that'll give me something to do tonight :). But seriously... > thanks... it's much appreciated.
> By the way, Marc, I've been on your site a couple of times and it's really > well done..
> I'll make it available on my site for anyone else that wants it. Probably > won't be finished tonight, because the way I'm creating the file right now > requires me to pull the info from the market before it goes into the table > I'm pulling the data from, but in the next day or two it should be done.
> Really, really much appreciated and I'll try to figure out how to give you > credit when someone pulls the file from my site.
>> On Fri, Nov 12, 2010 at 9:47 AM, Brad Gies <rbg...@gmail.com <mailto: >> rbg...@gmail.com>> wrote:
>> Yeah... if you can send the package name to me.. or make them >> available somewhere, I'll add the information, and it should be in >> my file whenever it is recreated.
>> Every person is born with a brain... Those who use it well are the >> successful happy ones - Brad Gies
>> Adversity can make or break you... It's your choice... Choose >> wisely - Brad Gies
>> Never doubt that a small group of thoughtful, committed people can >> change the world. Indeed. It is the only thing that ever has - >> Margaret Mead
>> On 11/11/2010 5:42 PM, Marc Lester Tan wrote:
>> Hi guys,
>> I checked just now and i have 112,494 distinct package names >> in my database (http://www.appcellar.com). If somebody is >> compiling the list now I can give the data. I'm fetching all >> applications per version/locale/author once a day.
>> Ok... I'll have a look at it and see if you have any I don't. >> Thanks...
>> You might want to try my file also... I've got 64,000+ apps >> in it >> right now, and I'm generating the file nightly (about 20 >> minutes after >> midnight UTC time). I mention the format for pulling the >> latest file >> in one of the messages above. As of tonight it only >> contains the >> fields I mention above, but tonight I am going to change it >> to put the >> current version number in it, and also the developer id. It >> will make >> it much more useful for anyone else. I'll post back here >> after I've >> made the change, and give the field list and let you know >> the file >> name. I'm going to see if I can just write the same file >> name every >> time, so that whenever you pull it, it will be the last one >> generated.
>> Oh.. on a related note.. Does anyone know what the total >> apps in the >> market right now.... I've been working on the assumption >> that there >> over 70,000 apps, but now I hear the actual number today >> could be over >> 100,000.
>> What's the highest number anyone has?
>> On Nov 11, 10:35 am, dernasherbrezon >> <dernasherbre...@gmail.com <mailto:dernasherbre...@gmail.com> >> <mailto:dernasherbre...@gmail.com
>> > I've made android market crawler and now have ~22k >> applications. You >> > could search applications by package name using API. Access >> is open >> > for everyone and free. You could find docs >> here:http://checkware.ru/warenet.html
>> > Hope that might help
>> > On Nov 7, 12:45 am, Brad <rbg...@gmail.com >> <mailto:rbg...@gmail.com> >> <mailto:rbg...@gmail.com <mailto:rbg...@gmail.com>>> wrote:
>> > > I'm working on a new website which aims to give all Android >> developers >> > > much more information about what's happening with the market >> and some >> > > tools to see how their apps are doing in relation to other >> apps. As >> > > part of the services, we are going to supply a downloadable >> .csv file >> > > containing all apps on the market, their market ratings, the >> index of >> > > where they are in the "Popular" order (if they show up at >> all), and >> > > two other rating systems we have developed (which are >> considerably >> > > better than the market ratings), and another file containing a >> list of >> > > all developers. The files will be available to anyone who >> wants to >> > > download them.
>> > > While programming this it has occurred to me many times that a >> lot of >> > > the work I'm doing is being duplicated in whole or in part by >> most of >> > > the people on this list, and if we cooperated a little we >> could save >> > > each other a ton of work and/or bandwidth. For instance, the >> file I >> > > will share that contains the app information will contain the >> package >> > > name of the app, so any dev that is working with this API >> could use it >> > > to download the complete app information much more efficiently >> than >> > > trying to get it by the different techniques we are all using >> to try >> > > to get complete lists from the market. And the file with >> dev info >> > > could be used to pull all the dev's apps fairly efficiently.
>> > > SO... my thought was that if I supplied these files to >> everyone it >> > > would make all our lives easier... but to do it I need to be >> sure my >> > > own data is very up to date. I'm wondering if some other devs >> on this >> > > list who have fairly complete data would be willing to share >> it with >> > > me, so I can share it with everyone. If just a few of us >> cooperated we >> > > could save everyone a lot of time and effort.
>> > > Anyone willing to help out?
>> > > OH... the first test file I created for the apps is available >> here :
>> > > It's not complete, and the fields (in order) are: >> > > My id # >> > > package name >> > > market rating >> > > No Crappy Apps Rating >> > > User Rating
>> > > Hope to hear from a bunch of you !
>> > > Thanks
>> > > Brad.
>> -- >> You received this message because you are subscribed to the >> Google >> Groups "android-market-api" group. >> To post to this group, send email to >> android-market-api@googlegroups.com >> <mailto:android-market-api@googlegroups.com> >> <mailto:android-market-api@googlegroups.com >> <mailto:android-market-api@googlegroups.com>>.
>> To unsubscribe from this group, send email to >> android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com> >> <mailto:android-market-api%2Bunsubscribe@googlegroups.com<android-market-ap i%252Bunsubscribe@googlegroups.com>
That would be fantastic.. Thanks very much... I think I will add some of the fields you sent to my file also... because I noticed while looking through your data and comparing it to mine that in some cases you had a higher number for "Market Rating Count" than I did, and sometimes I has a higher number than you did. It's obviously just a matter of who updated the number last... but I found it helpful for me because if your number was higher I used that to schedule that app for an update. If you're interested in using my file to do the same for you, I should have most of the data pulled from the market by the end of the weekend, and I'll change the format at that time.
For anyone else that want to use your file.. I'll save them some time... if they use MySQL
I just created a new file in my MySQL called appmarketlist (to match the name of Marc's file), and using your fields (NO ID FIELD), then I used this command to import it : mysqlimport -u root --fields-enclosed-by \" --fields-terminated-by , DBNAME PATH_TO_FILE\appmarketlist.csv
Obviously, change the db name and path to what you need.. and WOW... is that import ever fast!!! It imported all 112,000 rows in about a second. Hah.. but it did take almost an hour to get the syntax right :). After it was done I added the id field and it was ready to use.
> I checked just now and i have 112,494 distinct package names in my database
> (http://www.appcellar.com). If somebody is compiling the list now I can give
> the data. I'm fetching all applications per version/locale/author once a
> day.
> On Fri, Nov 12, 2010 at 9:17 AM, Brad <rbg...@gmail.com> wrote:
> > Ok... I'll have a look at it and see if you have any I don't.
> > Thanks...
> > You might want to try my file also... I've got 64,000+ apps in it
> > right now, and I'm generating the file nightly (about 20 minutes after
> > midnight UTC time). I mention the format for pulling the latest file
> > in one of the messages above. As of tonight it only contains the
> > fields I mention above, but tonight I am going to change it to put the
> > current version number in it, and also the developer id. It will make
> > it much more useful for anyone else. I'll post back here after I've
> > made the change, and give the field list and let you know the file
> > name. I'm going to see if I can just write the same file name every
> > time, so that whenever you pull it, it will be the last one generated.
> > Oh.. on a related note.. Does anyone know what the total apps in the
> > market right now.... I've been working on the assumption that there
> > over 70,000 apps, but now I hear the actual number today could be over
> > 100,000.
> > What's the highest number anyone has?
> > On Nov 11, 10:35 am, dernasherbrezon <dernasherbre...@gmail.com>
> > wrote:
> > > Hi Brad,
> > > I've made android market crawler and now have ~22k applications. You
> > > could search applications by package name using API. Access is open
> > > for everyone and free. You could find docs here:
> >http://checkware.ru/warenet.html
> > > Hope that might help
> > > On Nov 7, 12:45 am, Brad <rbg...@gmail.com> wrote:
> > > > I'm working on a new website which aims to give all Android developers
> > > > much more information about what's happening with the market and some
> > > > tools to see how their apps are doing in relation to other apps. As
> > > > part of the services, we are going to supply a downloadable .csv file
> > > > containing all apps on the market, their market ratings, the index of
> > > > where they are in the "Popular" order (if they show up at all), and
> > > > two other rating systems we have developed (which are considerably
> > > > better than the market ratings), and another file containing a list of
> > > > all developers. The files will be available to anyone who wants to
> > > > download them.
> > > > While programming this it has occurred to me many times that a lot of
> > > > the work I'm doing is being duplicated in whole or in part by most of
> > > > the people on this list, and if we cooperated a little we could save
> > > > each other a ton of work and/or bandwidth. For instance, the file I
> > > > will share that contains the app information will contain the package
> > > > name of the app, so any dev that is working with this API could use it
> > > > to download the complete app information much more efficiently than
> > > > trying to get it by the different techniques we are all using to try
> > > > to get complete lists from the market. And the file with dev info
> > > > could be used to pull all the dev's apps fairly efficiently.
> > > > SO... my thought was that if I supplied these files to everyone it
> > > > would make all our lives easier... but to do it I need to be sure my
> > > > own data is very up to date. I'm wondering if some other devs on this
> > > > list who have fairly complete data would be willing to share it with
> > > > me, so I can share it with everyone. If just a few of us cooperated we
> > > > could save everyone a lot of time and effort.
> > > > Anyone willing to help out?
> > > > OH... the first test file I created for the apps is available here :
> > > > It's not complete, and the fields (in order) are:
> > > > My id #
> > > > package name
> > > > market rating
> > > > No Crappy Apps Rating
> > > > User Rating
> > > > Hope to hear from a bunch of you !
> > > > Thanks
> > > > Brad.
> > --
> > You received this message because you are subscribed to the Google Groups
> > "android-market-api" group.
> > To post to this group, send email to android-market-api@googlegroups.com.
> > To unsubscribe from this group, send email to
> > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com>
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/android-market-api?hl=en.
Yup, although I think some of them are failing already. Haven't checked for a few months. 503's can be prevented by using several gmail accounts. I bought a domain from google then bulk upload the list of users. Some accounts will return 503's eventually but then you just have to refresh them by creating another set of users then bulk upload. I'm aware that my catalog doesn't have the 2.2 apps.
On Tue, Nov 16, 2010 at 6:43 AM, styler <styler1...@gmail.com> wrote: > Youre updating 112k apps every night? How do you get around the 503's? > What is the interval in which you are querying?
> On Nov 11, 7:42 pm, Marc Lester Tan <mail...@gmail.com> wrote: > > Hi guys,
> > I checked just now and i have 112,494 distinct package names in my > database > > (http://www.appcellar.com). If somebody is compiling the list now I can > give > > the data. I'm fetching all applications per version/locale/author once a > > day.
> > On Fri, Nov 12, 2010 at 9:17 AM, Brad <rbg...@gmail.com> wrote: > > > Ok... I'll have a look at it and see if you have any I don't. > > > Thanks...
> > > You might want to try my file also... I've got 64,000+ apps in it > > > right now, and I'm generating the file nightly (about 20 minutes after > > > midnight UTC time). I mention the format for pulling the latest file > > > in one of the messages above. As of tonight it only contains the > > > fields I mention above, but tonight I am going to change it to put the > > > current version number in it, and also the developer id. It will make > > > it much more useful for anyone else. I'll post back here after I've > > > made the change, and give the field list and let you know the file > > > name. I'm going to see if I can just write the same file name every > > > time, so that whenever you pull it, it will be the last one generated.
> > > Oh.. on a related note.. Does anyone know what the total apps in the > > > market right now.... I've been working on the assumption that there > > > over 70,000 apps, but now I hear the actual number today could be over > > > 100,000.
> > > What's the highest number anyone has?
> > > On Nov 11, 10:35 am, dernasherbrezon <dernasherbre...@gmail.com> > > > wrote: > > > > Hi Brad,
> > > > I've made android market crawler and now have ~22k applications. You > > > > could search applications by package name using API. Access is open > > > > for everyone and free. You could find docs here: > > >http://checkware.ru/warenet.html
> > > > Hope that might help
> > > > On Nov 7, 12:45 am, Brad <rbg...@gmail.com> wrote:
> > > > > I'm working on a new website which aims to give all Android > developers > > > > > much more information about what's happening with the market and > some > > > > > tools to see how their apps are doing in relation to other apps. As > > > > > part of the services, we are going to supply a downloadable .csv > file > > > > > containing all apps on the market, their market ratings, the index > of > > > > > where they are in the "Popular" order (if they show up at all), and > > > > > two other rating systems we have developed (which are considerably > > > > > better than the market ratings), and another file containing a list > of > > > > > all developers. The files will be available to anyone who wants to > > > > > download them.
> > > > > While programming this it has occurred to me many times that a lot > of > > > > > the work I'm doing is being duplicated in whole or in part by most > of > > > > > the people on this list, and if we cooperated a little we could > save > > > > > each other a ton of work and/or bandwidth. For instance, the file I > > > > > will share that contains the app information will contain the > package > > > > > name of the app, so any dev that is working with this API could use > it > > > > > to download the complete app information much more efficiently than > > > > > trying to get it by the different techniques we are all using to > try > > > > > to get complete lists from the market. And the file with dev info > > > > > could be used to pull all the dev's apps fairly efficiently.
> > > > > SO... my thought was that if I supplied these files to everyone it > > > > > would make all our lives easier... but to do it I need to be sure > my > > > > > own data is very up to date. I'm wondering if some other devs on > this > > > > > list who have fairly complete data would be willing to share it > with > > > > > me, so I can share it with everyone. If just a few of us cooperated > we > > > > > could save everyone a lot of time and effort.
> > > > > Anyone willing to help out?
> > > > > OH... the first test file I created for the apps is available here > :
> > > > > It's not complete, and the fields (in order) are: > > > > > My id # > > > > > package name > > > > > market rating > > > > > No Crappy Apps Rating > > > > > User Rating
> > > > > Hope to hear from a bunch of you !
> > > > > Thanks
> > > > > Brad.
> > > -- > > > You received this message because you are subscribed to the Google > Groups > > > "android-market-api" group. > > > To post to this group, send email to > android-market-api@googlegroups.com. > > > To unsubscribe from this group, send email to > > > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com><android-market-api%2Bunsubs > cribe@googlegroups.com> > > > . > > > For more options, visit this group at > > >http://groups.google.com/group/android-market-api?hl=en.
> -- > You received this message because you are subscribed to the Google Groups > "android-market-api" group. > To post to this group, send email to android-market-api@googlegroups.com. > To unsubscribe from this group, send email to > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com> > . > For more options, visit this group at > http://groups.google.com/group/android-market-api?hl=en.
See I have acquired ~30 domains with the android keyword and I'm
currently piecing together a site in php. However I'd like to just be
able to have it run with as little monitoring effort, and time will
tell if the 503 leaves. They talk about using an exponential back-off
algorithm when you get the 503's. I still don't know if that means 20
minutes or 2 days or what. I guess you never know with that.
So your accounts do get banned for life?
On Nov 15, 7:36 pm, Marc Lester Tan <mail...@gmail.com> wrote:
> Yup, although I think some of them are failing already. Haven't checked for
> a few months. 503's can be prevented by using several gmail accounts. I
> bought a domain from google then bulk upload the list of users. Some
> accounts will return 503's eventually but then you just have to refresh them
> by creating another set of users then bulk upload. I'm aware that my catalog
> doesn't have the 2.2 apps.
> Marc
> On Tue, Nov 16, 2010 at 6:43 AM, styler <styler1...@gmail.com> wrote:
> > Youre updating 112k apps every night? How do you get around the 503's?
> > What is the interval in which you are querying?
> > On Nov 11, 7:42 pm, Marc Lester Tan <mail...@gmail.com> wrote:
> > > Hi guys,
> > > I checked just now and i have 112,494 distinct package names in my
> > database
> > > (http://www.appcellar.com). If somebody is compiling the list now I can
> > give
> > > the data. I'm fetching all applications per version/locale/author once a
> > > day.
> > > On Fri, Nov 12, 2010 at 9:17 AM, Brad <rbg...@gmail.com> wrote:
> > > > Ok... I'll have a look at it and see if you have any I don't.
> > > > Thanks...
> > > > You might want to try my file also... I've got 64,000+ apps in it
> > > > right now, and I'm generating the file nightly (about 20 minutes after
> > > > midnight UTC time). I mention the format for pulling the latest file
> > > > in one of the messages above. As of tonight it only contains the
> > > > fields I mention above, but tonight I am going to change it to put the
> > > > current version number in it, and also the developer id. It will make
> > > > it much more useful for anyone else. I'll post back here after I've
> > > > made the change, and give the field list and let you know the file
> > > > name. I'm going to see if I can just write the same file name every
> > > > time, so that whenever you pull it, it will be the last one generated.
> > > > Oh.. on a related note.. Does anyone know what the total apps in the
> > > > market right now.... I've been working on the assumption that there
> > > > over 70,000 apps, but now I hear the actual number today could be over
> > > > 100,000.
> > > > What's the highest number anyone has?
> > > > On Nov 11, 10:35 am, dernasherbrezon <dernasherbre...@gmail.com>
> > > > wrote:
> > > > > Hi Brad,
> > > > > I've made android market crawler and now have ~22k applications. You
> > > > > could search applications by package name using API. Access is open
> > > > > for everyone and free. You could find docs here:
> > > >http://checkware.ru/warenet.html
> > > > > Hope that might help
> > > > > On Nov 7, 12:45 am, Brad <rbg...@gmail.com> wrote:
> > > > > > I'm working on a new website which aims to give all Android
> > developers
> > > > > > much more information about what's happening with the market and
> > some
> > > > > > tools to see how their apps are doing in relation to other apps. As
> > > > > > part of the services, we are going to supply a downloadable .csv
> > file
> > > > > > containing all apps on the market, their market ratings, the index
> > of
> > > > > > where they are in the "Popular" order (if they show up at all), and
> > > > > > two other rating systems we have developed (which are considerably
> > > > > > better than the market ratings), and another file containing a list
> > of
> > > > > > all developers. The files will be available to anyone who wants to
> > > > > > download them.
> > > > > > While programming this it has occurred to me many times that a lot
> > of
> > > > > > the work I'm doing is being duplicated in whole or in part by most
> > of
> > > > > > the people on this list, and if we cooperated a little we could
> > save
> > > > > > each other a ton of work and/or bandwidth. For instance, the file I
> > > > > > will share that contains the app information will contain the
> > package
> > > > > > name of the app, so any dev that is working with this API could use
> > it
> > > > > > to download the complete app information much more efficiently than
> > > > > > trying to get it by the different techniques we are all using to
> > try
> > > > > > to get complete lists from the market. And the file with dev info
> > > > > > could be used to pull all the dev's apps fairly efficiently.
> > > > > > SO... my thought was that if I supplied these files to everyone it
> > > > > > would make all our lives easier... but to do it I need to be sure
> > my
> > > > > > own data is very up to date. I'm wondering if some other devs on
> > this
> > > > > > list who have fairly complete data would be willing to share it
> > with
> > > > > > me, so I can share it with everyone. If just a few of us cooperated
> > we
> > > > > > could save everyone a lot of time and effort.
> > > > > > Anyone willing to help out?
> > > > > > OH... the first test file I created for the apps is available here
> > :
> > > > > > It's not complete, and the fields (in order) are:
> > > > > > My id #
> > > > > > package name
> > > > > > market rating
> > > > > > No Crappy Apps Rating
> > > > > > User Rating
> > > > > > Hope to hear from a bunch of you !
> > > > > > Thanks
> > > > > > Brad.
> > > > --
> > > > You received this message because you are subscribed to the Google
> > Groups
> > > > "android-market-api" group.
> > > > To post to this group, send email to
> > android-market-api@googlegroups.com.
> > > > To unsubscribe from this group, send email to
> > > > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com><android-market-api%2Bunsubs
> > cribe@googlegroups.com>
> > > > .
> > > > For more options, visit this group at
> > > >http://groups.google.com/group/android-market-api?hl=en.
> > --
> > You received this message because you are subscribed to the Google Groups
> > "android-market-api" group.
> > To post to this group, send email to android-market-api@googlegroups.com.
> > To unsubscribe from this group, send email to
> > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com>
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/android-market-api?hl=en.
I use exponential back-off as well but limited up to 1 minute only. If after X tries using different google accounts, then drop the particular request and move on to the next.
On Tue, Nov 16, 2010 at 10:47 AM, styler <styler1...@gmail.com> wrote: > See I have acquired ~30 domains with the android keyword and I'm > currently piecing together a site in php. However I'd like to just be > able to have it run with as little monitoring effort, and time will > tell if the 503 leaves. They talk about using an exponential back-off > algorithm when you get the 503's. I still don't know if that means 20 > minutes or 2 days or what. I guess you never know with that.
> So your accounts do get banned for life?
> On Nov 15, 7:36 pm, Marc Lester Tan <mail...@gmail.com> wrote: > > Yup, although I think some of them are failing already. Haven't checked > for > > a few months. 503's can be prevented by using several gmail accounts. I > > bought a domain from google then bulk upload the list of users. Some > > accounts will return 503's eventually but then you just have to refresh > them > > by creating another set of users then bulk upload. I'm aware that my > catalog > > doesn't have the 2.2 apps.
> > Marc
> > On Tue, Nov 16, 2010 at 6:43 AM, styler <styler1...@gmail.com> wrote: > > > Youre updating 112k apps every night? How do you get around the 503's? > > > What is the interval in which you are querying?
> > > On Nov 11, 7:42 pm, Marc Lester Tan <mail...@gmail.com> wrote: > > > > Hi guys,
> > > > I checked just now and i have 112,494 distinct package names in my > > > database > > > > (http://www.appcellar.com). If somebody is compiling the list now I > can > > > give > > > > the data. I'm fetching all applications per version/locale/author > once a > > > > day.
> > > > On Fri, Nov 12, 2010 at 9:17 AM, Brad <rbg...@gmail.com> wrote: > > > > > Ok... I'll have a look at it and see if you have any I don't. > > > > > Thanks...
> > > > > You might want to try my file also... I've got 64,000+ apps in it > > > > > right now, and I'm generating the file nightly (about 20 minutes > after > > > > > midnight UTC time). I mention the format for pulling the latest > file > > > > > in one of the messages above. As of tonight it only contains the > > > > > fields I mention above, but tonight I am going to change it to put > the > > > > > current version number in it, and also the developer id. It will > make > > > > > it much more useful for anyone else. I'll post back here after I've > > > > > made the change, and give the field list and let you know the file > > > > > name. I'm going to see if I can just write the same file name every > > > > > time, so that whenever you pull it, it will be the last one > generated.
> > > > > Oh.. on a related note.. Does anyone know what the total apps in > the > > > > > market right now.... I've been working on the assumption that there > > > > > over 70,000 apps, but now I hear the actual number today could be > over > > > > > 100,000.
> > > > > What's the highest number anyone has?
> > > > > On Nov 11, 10:35 am, dernasherbrezon <dernasherbre...@gmail.com> > > > > > wrote: > > > > > > Hi Brad,
> > > > > > I've made android market crawler and now have ~22k applications. > You > > > > > > could search applications by package name using API. Access is > open > > > > > > for everyone and free. You could find docs here: > > > > >http://checkware.ru/warenet.html
> > > > > > Hope that might help
> > > > > > On Nov 7, 12:45 am, Brad <rbg...@gmail.com> wrote:
> > > > > > > I'm working on a new website which aims to give all Android > > > developers > > > > > > > much more information about what's happening with the market > and > > > some > > > > > > > tools to see how their apps are doing in relation to other > apps. As > > > > > > > part of the services, we are going to supply a downloadable > .csv > > > file > > > > > > > containing all apps on the market, their market ratings, the > index > > > of > > > > > > > where they are in the "Popular" order (if they show up at all), > and > > > > > > > two other rating systems we have developed (which are > considerably > > > > > > > better than the market ratings), and another file containing a > list > > > of > > > > > > > all developers. The files will be available to anyone who wants > to > > > > > > > download them.
> > > > > > > While programming this it has occurred to me many times that a > lot > > > of > > > > > > > the work I'm doing is being duplicated in whole or in part by > most > > > of > > > > > > > the people on this list, and if we cooperated a little we could > > > save > > > > > > > each other a ton of work and/or bandwidth. For instance, the > file I > > > > > > > will share that contains the app information will contain the > > > package > > > > > > > name of the app, so any dev that is working with this API could > use > > > it > > > > > > > to download the complete app information much more efficiently > than > > > > > > > trying to get it by the different techniques we are all using > to > > > try > > > > > > > to get complete lists from the market. And the file with dev > info > > > > > > > could be used to pull all the dev's apps fairly efficiently.
> > > > > > > SO... my thought was that if I supplied these files to everyone > it > > > > > > > would make all our lives easier... but to do it I need to be > sure > > > my > > > > > > > own data is very up to date. I'm wondering if some other devs > on > > > this > > > > > > > list who have fairly complete data would be willing to share it > > > with > > > > > > > me, so I can share it with everyone. If just a few of us > cooperated > > > we > > > > > > > could save everyone a lot of time and effort.
> > > > > > > Anyone willing to help out?
> > > > > > > OH... the first test file I created for the apps is available > here > > > :
> > > > > > > It's not complete, and the fields (in order) are: > > > > > > > My id # > > > > > > > package name > > > > > > > market rating > > > > > > > No Crappy Apps Rating > > > > > > > User Rating
> > > > > > > Hope to hear from a bunch of you !
> > > > > > > Thanks
> > > > > > > Brad.
> > > > > -- > > > > > You received this message because you are subscribed to the Google > > > Groups > > > > > "android-market-api" group. > > > > > To post to this group, send email to > > > android-market-api@googlegroups.com. > > > > > To unsubscribe from this group, send email to > > > > > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com><android-market-api%2Bunsubs > cribe@googlegroups.com><android-market-api%2Bunsubs > > > cribe@googlegroups.com> > > > > > . > > > > > For more options, visit this group at > > > > >http://groups.google.com/group/android-market-api?hl=en.
> > > -- > > > You received this message because you are subscribed to the Google > Groups > > > "android-market-api" group. > > > To post to this group, send email to > android-market-api@googlegroups.com. > > > To unsubscribe from this group, send email to > > > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com><android-market-api%2Bunsubs > cribe@googlegroups.com> > > > . > > > For more options, visit this group at > > >http://groups.google.com/group/android-market-api?hl=en.
> -- > You received this message because you are subscribed to the Google Groups > "android-market-api" group. > To post to this group, send email to android-market-api@googlegroups.com. > To unsubscribe from this group, send email to > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com> > . > For more options, visit this group at > http://groups.google.com/group/android-market-api?hl=en.
> I use exponential back-off as well but limited up to 1 minute only. If after
> X tries using different google accounts, then drop the particular request
> and move on to the next.
> On Tue, Nov 16, 2010 at 10:47 AM, styler <styler1...@gmail.com> wrote:
> > See I have acquired ~30 domains with the android keyword and I'm
> > currently piecing together a site in php. However I'd like to just be
> > able to have it run with as little monitoring effort, and time will
> > tell if the 503 leaves. They talk about using an exponential back-off
> > algorithm when you get the 503's. I still don't know if that means 20
> > minutes or 2 days or what. I guess you never know with that.
> > So your accounts do get banned for life?
> > On Nov 15, 7:36 pm, Marc Lester Tan <mail...@gmail.com> wrote:
> > > Yup, although I think some of them are failing already. Haven't checked
> > for
> > > a few months. 503's can be prevented by using several gmail accounts. I
> > > bought a domain from google then bulk upload the list of users. Some
> > > accounts will return 503's eventually but then you just have to refresh
> > them
> > > by creating another set of users then bulk upload. I'm aware that my
> > catalog
> > > doesn't have the 2.2 apps.
> > > Marc
> > > On Tue, Nov 16, 2010 at 6:43 AM, styler <styler1...@gmail.com> wrote:
> > > > Youre updating 112k apps every night? How do you get around the 503's?
> > > > What is the interval in which you are querying?
> > > > On Nov 11, 7:42 pm, Marc Lester Tan <mail...@gmail.com> wrote:
> > > > > Hi guys,
> > > > > I checked just now and i have 112,494 distinct package names in my
> > > > database
> > > > > (http://www.appcellar.com). If somebody is compiling the list now I
> > can
> > > > give
> > > > > the data. I'm fetching all applications per version/locale/author
> > once a
> > > > > day.
> > > > > On Fri, Nov 12, 2010 at 9:17 AM, Brad <rbg...@gmail.com> wrote:
> > > > > > Ok... I'll have a look at it and see if you have any I don't.
> > > > > > Thanks...
> > > > > > You might want to try my file also... I've got 64,000+ apps in it
> > > > > > right now, and I'm generating the file nightly (about 20 minutes
> > after
> > > > > > midnight UTC time). I mention the format for pulling the latest
> > file
> > > > > > in one of the messages above. As of tonight it only contains the
> > > > > > fields I mention above, but tonight I am going to change it to put
> > the
> > > > > > current version number in it, and also the developer id. It will
> > make
> > > > > > it much more useful for anyone else. I'll post back here after I've
> > > > > > made the change, and give the field list and let you know the file
> > > > > > name. I'm going to see if I can just write the same file name every
> > > > > > time, so that whenever you pull it, it will be the last one
> > generated.
> > > > > > Oh.. on a related note.. Does anyone know what the total apps in
> > the
> > > > > > market right now.... I've been working on the assumption that there
> > > > > > over 70,000 apps, but now I hear the actual number today could be
> > over
> > > > > > 100,000.
> > > > > > What's the highest number anyone has?
> > > > > > On Nov 11, 10:35 am, dernasherbrezon <dernasherbre...@gmail.com>
> > > > > > wrote:
> > > > > > > Hi Brad,
> > > > > > > I've made android market crawler and now have ~22k applications.
> > You
> > > > > > > could search applications by package name using API. Access is
> > open
> > > > > > > for everyone and free. You could find docs here:
> > > > > >http://checkware.ru/warenet.html
> > > > > > > Hope that might help
> > > > > > > On Nov 7, 12:45 am, Brad <rbg...@gmail.com> wrote:
> > > > > > > > I'm working on a new website which aims to give all Android
> > > > developers
> > > > > > > > much more information about what's happening with the market
> > and
> > > > some
> > > > > > > > tools to see how their apps are doing in relation to other
> > apps. As
> > > > > > > > part of the services, we are going to supply a downloadable
> > .csv
> > > > file
> > > > > > > > containing all apps on the market, their market ratings, the
> > index
> > > > of
> > > > > > > > where they are in the "Popular" order (if they show up at all),
> > and
> > > > > > > > two other rating systems we have developed (which are
> > considerably
> > > > > > > > better than the market ratings), and another file containing a
> > list
> > > > of
> > > > > > > > all developers. The files will be available to anyone who wants
> > to
> > > > > > > > download them.
> > > > > > > > While programming this it has occurred to me many times that a
> > lot
> > > > of
> > > > > > > > the work I'm doing is being duplicated in whole or in part by
> > most
> > > > of
> > > > > > > > the people on this list, and if we cooperated a little we could
> > > > save
> > > > > > > > each other a ton of work and/or bandwidth. For instance, the
> > file I
> > > > > > > > will share that contains the app information will contain the
> > > > package
> > > > > > > > name of the app, so any dev that is working with this API could
> > use
> > > > it
> > > > > > > > to download the complete app information much more efficiently
> > than
> > > > > > > > trying to get it by the different techniques we are all using
> > to
> > > > try
> > > > > > > > to get complete lists from the market. And the file with dev
> > info
> > > > > > > > could be used to pull all the dev's apps fairly efficiently.
> > > > > > > > SO... my thought was that if I supplied these files to everyone
> > it
> > > > > > > > would make all our lives easier... but to do it I need to be
> > sure
> > > > my
> > > > > > > > own data is very up to date. I'm wondering if some other devs
> > on
> > > > this
> > > > > > > > list who have fairly complete data would be willing to share it
> > > > with
> > > > > > > > me, so I can share it with everyone. If just a few of us
> > cooperated
> > > > we
> > > > > > > > could save everyone a lot of time and effort.
> > > > > > > > Anyone willing to help out?
> > > > > > > > OH... the first test file I created for the apps is available
> > here
> > > > :
> > > > > > > > It's not complete, and the fields (in order) are:
> > > > > > > > My id #
> > > > > > > > package name
> > > > > > > > market rating
> > > > > > > > No Crappy Apps Rating
> > > > > > > > User Rating
> > > > > > > > Hope to hear from a bunch of you !
> > > > > > > > Thanks
> > > > > > > > Brad.
> > > > > > --
> > > > > > You received this message because you are subscribed to the Google
> > > > Groups
> > > > > > "android-market-api" group.
> > > > > > To post to this group, send email to
> > > > android-market-api@googlegroups.com.
> > > > > > To unsubscribe from this group, send email to
> > > > > > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com><android-market-api%2Bunsubs
> > cribe@googlegroups.com><android-market-api%2Bunsubs
> > > > cribe@googlegroups.com>
> > > > > > .
> > > > > > For more options, visit this group at
> > > > > >http://groups.google.com/group/android-market-api?hl=en.
> > > > --
> > > > You received this message because you are subscribed to the Google
> > Groups
> > > > "android-market-api" group.
> > > > To post to this group, send email to
> > android-market-api@googlegroups.com.
> > > > To unsubscribe from this group, send email to
> > > > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com><android-market-api%2Bunsubs
> > cribe@googlegroups.com>
> > > > .
> > > > For more options, visit this group at
> > > >http://groups.google.com/group/android-market-api?hl=en.
> > --
> > You received this message because you are subscribed to the Google Groups
> > "android-market-api" group.
> > To post to this group, send email to android-market-api@googlegroups.com.
> > To unsubscribe from this group, send email to
> > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com>
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/android-market-api?hl=en.
I have a separate thread that fetches all the 800 authors (newest apps first) then add the authors to my db if it doesn't exist yet. then same process goes on (fetch all authors from db, fetch their apps..so on and so forth.....)
On Wed, Nov 17, 2010 at 3:30 AM, styler <styler1...@gmail.com> wrote: > so are you using setQuery at all, or how do you discover the new > applications are they are published on the market?
> On Nov 16, 2:01 am, Marc Lester Tan <mail...@gmail.com> wrote: > > I use exponential back-off as well but limited up to 1 minute only. If > after > > X tries using different google accounts, then drop the particular request > > and move on to the next.
> > On Tue, Nov 16, 2010 at 10:47 AM, styler <styler1...@gmail.com> wrote: > > > See I have acquired ~30 domains with the android keyword and I'm > > > currently piecing together a site in php. However I'd like to just be > > > able to have it run with as little monitoring effort, and time will > > > tell if the 503 leaves. They talk about using an exponential back-off > > > algorithm when you get the 503's. I still don't know if that means 20 > > > minutes or 2 days or what. I guess you never know with that.
> > > So your accounts do get banned for life?
> > > On Nov 15, 7:36 pm, Marc Lester Tan <mail...@gmail.com> wrote: > > > > Yup, although I think some of them are failing already. Haven't > checked > > > for > > > > a few months. 503's can be prevented by using several gmail accounts. > I > > > > bought a domain from google then bulk upload the list of users. Some > > > > accounts will return 503's eventually but then you just have to > refresh > > > them > > > > by creating another set of users then bulk upload. I'm aware that my > > > catalog > > > > doesn't have the 2.2 apps.
> > > > Marc
> > > > On Tue, Nov 16, 2010 at 6:43 AM, styler <styler1...@gmail.com> > wrote: > > > > > Youre updating 112k apps every night? How do you get around the > 503's? > > > > > What is the interval in which you are querying?
> > > > > On Nov 11, 7:42 pm, Marc Lester Tan <mail...@gmail.com> wrote: > > > > > > Hi guys,
> > > > > > I checked just now and i have 112,494 distinct package names in > my > > > > > database > > > > > > (http://www.appcellar.com). If somebody is compiling the list > now I > > > can > > > > > give > > > > > > the data. I'm fetching all applications per version/locale/author > > > once a > > > > > > day.
> > > > > > On Fri, Nov 12, 2010 at 9:17 AM, Brad <rbg...@gmail.com> wrote: > > > > > > > Ok... I'll have a look at it and see if you have any I don't. > > > > > > > Thanks...
> > > > > > > You might want to try my file also... I've got 64,000+ apps in > it > > > > > > > right now, and I'm generating the file nightly (about 20 > minutes > > > after > > > > > > > midnight UTC time). I mention the format for pulling the latest > > > file > > > > > > > in one of the messages above. As of tonight it only contains > the > > > > > > > fields I mention above, but tonight I am going to change it to > put > > > the > > > > > > > current version number in it, and also the developer id. It > will > > > make > > > > > > > it much more useful for anyone else. I'll post back here after > I've > > > > > > > made the change, and give the field list and let you know the > file > > > > > > > name. I'm going to see if I can just write the same file name > every > > > > > > > time, so that whenever you pull it, it will be the last one > > > generated.
> > > > > > > Oh.. on a related note.. Does anyone know what the total apps > in > > > the > > > > > > > market right now.... I've been working on the assumption that > there > > > > > > > over 70,000 apps, but now I hear the actual number today could > be > > > over > > > > > > > 100,000.
> > > > > > > What's the highest number anyone has?
> > > > > > > > I've made android market crawler and now have ~22k > applications. > > > You > > > > > > > > could search applications by package name using API. Access > is > > > open > > > > > > > > for everyone and free. You could find docs here: > > > > > > >http://checkware.ru/warenet.html
> > > > > > > > Hope that might help
> > > > > > > > On Nov 7, 12:45 am, Brad <rbg...@gmail.com> wrote:
> > > > > > > > > I'm working on a new website which aims to give all Android > > > > > developers > > > > > > > > > much more information about what's happening with the > market > > > and > > > > > some > > > > > > > > > tools to see how their apps are doing in relation to other > > > apps. As > > > > > > > > > part of the services, we are going to supply a downloadable > > > .csv > > > > > file > > > > > > > > > containing all apps on the market, their market ratings, > the > > > index > > > > > of > > > > > > > > > where they are in the "Popular" order (if they show up at > all), > > > and > > > > > > > > > two other rating systems we have developed (which are > > > considerably > > > > > > > > > better than the market ratings), and another file > containing a > > > list > > > > > of > > > > > > > > > all developers. The files will be available to anyone who > wants > > > to > > > > > > > > > download them.
> > > > > > > > > While programming this it has occurred to me many times > that a > > > lot > > > > > of > > > > > > > > > the work I'm doing is being duplicated in whole or in part > by > > > most > > > > > of > > > > > > > > > the people on this list, and if we cooperated a little we > could > > > > > save > > > > > > > > > each other a ton of work and/or bandwidth. For instance, > the > > > file I > > > > > > > > > will share that contains the app information will contain > the > > > > > package > > > > > > > > > name of the app, so any dev that is working with this API > could > > > use > > > > > it > > > > > > > > > to download the complete app information much more > efficiently > > > than > > > > > > > > > trying to get it by the different techniques we are all > using > > > to > > > > > try > > > > > > > > > to get complete lists from the market. And the file with > dev > > > info > > > > > > > > > could be used to pull all the dev's apps fairly > efficiently.
> > > > > > > > > SO... my thought was that if I supplied these files to > everyone > > > it > > > > > > > > > would make all our lives easier... but to do it I need to > be > > > sure > > > > > my > > > > > > > > > own data is very up to date. I'm wondering if some other > devs > > > on > > > > > this > > > > > > > > > list who have fairly complete data would be willing to > share it > > > > > with > > > > > > > > > me, so I can share it with everyone. If just a few of us > > > cooperated > > > > > we > > > > > > > > > could save everyone a lot of time and effort.
> > > > > > > > > Anyone willing to help out?
> > > > > > > > > OH... the first test file I created for the apps is > available > > > here > > > > > :
> > > > > > > > > It's not complete, and the fields (in order) are: > > > > > > > > > My id # > > > > > > > > > package name > > > > > > > > > market rating > > > > > > > > > No Crappy Apps Rating > > > > > > > > > User Rating
> > > > > > > > > Hope to hear from a bunch of you !
> > > > > > > > > Thanks
> > > > > > > > > Brad.
> > > > > > > -- > > > > > > > You received this message because you are subscribed to the > Google > > > > > Groups > > > > > > > "android-market-api" group. > > > > > > > To post to this group, send email to > > > > > android-market-api@googlegroups.com. > > > > > > > To unsubscribe from this group, send email to > > > > > > > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com><android-market-api%2Bunsubs > cribe@googlegroups.com><android-market-api%2Bunsubs > > > cribe@googlegroups.com><android-market-api%2Bunsubs > > > > > cribe@googlegroups.com> > > > > > > > . > > > > > > > For more options, visit this group at > > > > > > >http://groups.google.com/group/android-market-api?hl=en.
> > > > > -- > > > > > You received this message because you are subscribed to the Google > > > Groups > > > > > "android-market-api" group. > > > > > To post to this group, send email to > > > android-market-api@googlegroups.com. > > > > > To unsubscribe from this group, send email to > > > > > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com><android-market-api%2Bunsubs > cribe@googlegroups.com><android-market-api%2Bunsubs > > > cribe@googlegroups.com> > > > > > . > > > > > For more options, visit this group at > > > > >http://groups.google.com/group/android-market-api?hl=en.
> > > -- > > > You received this message because you are subscribed to the Google > Groups > > > "android-market-api" group. > > > To post to this group, send email to > android-market-api@googlegroups.com. > > > To unsubscribe from this group, send email to > > > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com><android-market-api%2Bunsubs > cribe@googlegroups.com> > > > . > > > For more options, visit this group at > > >http://groups.google.com/group/android-market-api?hl=en.
> -- > You received this message because you are subscribed to the Google Groups > "android-market-api" group. > To post to this group, send email to android-market-api@googlegroups.com. > To unsubscribe from this group, send email to
> I have a separate thread that fetches all the 800 authors (newest apps > first) then add the authors to my db if it doesn't exist yet. then > same process goes on (fetch all authors from db, fetch their apps..so > on and so forth.....)
> On Wed, Nov 17, 2010 at 3:30 AM, styler <styler1...@gmail.com > <mailto:styler1...@gmail.com>> wrote:
> so are you using setQuery at all, or how do you discover the new > applications are they are published on the market?
> On Nov 16, 2:01 am, Marc Lester Tan <mail...@gmail.com > <mailto:mail...@gmail.com>> wrote: > > I use exponential back-off as well but limited up to 1 minute > only. If after > > X tries using different google accounts, then drop the > particular request > > and move on to the next.
> > On Tue, Nov 16, 2010 at 10:47 AM, styler <styler1...@gmail.com > <mailto:styler1...@gmail.com>> wrote: > > > See I have acquired ~30 domains with the android keyword and I'm > > > currently piecing together a site in php. However I'd like to > just be > > > able to have it run with as little monitoring effort, and time > will > > > tell if the 503 leaves. They talk about using an exponential > back-off > > > algorithm when you get the 503's. I still don't know if that > means 20 > > > minutes or 2 days or what. I guess you never know with that.
> > > So your accounts do get banned for life?
> > > On Nov 15, 7:36 pm, Marc Lester Tan <mail...@gmail.com > <mailto:mail...@gmail.com>> wrote: > > > > Yup, although I think some of them are failing already. > Haven't checked > > > for > > > > a few months. 503's can be prevented by using several gmail > accounts. I > > > > bought a domain from google then bulk upload the list of > users. Some > > > > accounts will return 503's eventually but then you just have > to refresh > > > them > > > > by creating another set of users then bulk upload. I'm aware > that my > > > catalog > > > > doesn't have the 2.2 apps.
> > > > Marc
> > > > On Tue, Nov 16, 2010 at 6:43 AM, styler > <styler1...@gmail.com <mailto:styler1...@gmail.com>> wrote: > > > > > Youre updating 112k apps every night? How do you get > around the 503's? > > > > > What is the interval in which you are querying?
> > > > > On Nov 11, 7:42 pm, Marc Lester Tan <mail...@gmail.com > <mailto:mail...@gmail.com>> wrote: > > > > > > Hi guys,
> > > > > > I checked just now and i have 112,494 distinct package > names in my > > > > > database > > > > > > (http://www.appcellar.com). If somebody is compiling the > list now I > > > can > > > > > give > > > > > > the data. I'm fetching all applications per > version/locale/author > > > once a > > > > > > day.
> > > > > > On Fri, Nov 12, 2010 at 9:17 AM, Brad <rbg...@gmail.com > <mailto:rbg...@gmail.com>> wrote: > > > > > > > Ok... I'll have a look at it and see if you have any I > don't. > > > > > > > Thanks...
> > > > > > > You might want to try my file also... I've got 64,000+ > apps in it > > > > > > > right now, and I'm generating the file nightly (about > 20 minutes > > > after > > > > > > > midnight UTC time). I mention the format for pulling > the latest > > > file > > > > > > > in one of the messages above. As of tonight it only > contains the > > > > > > > fields I mention above, but tonight I am going to > change it to put > > > the > > > > > > > current version number in it, and also the developer > id. It will > > > make > > > > > > > it much more useful for anyone else. I'll post back > here after I've > > > > > > > made the change, and give the field list and let you > know the file > > > > > > > name. I'm going to see if I can just write the same > file name every > > > > > > > time, so that whenever you pull it, it will be the > last one > > > generated.
> > > > > > > Oh.. on a related note.. Does anyone know what the > total apps in > > > the > > > > > > > market right now.... I've been working on the > assumption that there > > > > > > > over 70,000 apps, but now I hear the actual number > today could be > > > over > > > > > > > 100,000.
> > > > > > > What's the highest number anyone has?
> > > > > > > > I've made android market crawler and now have ~22k > applications. > > > You > > > > > > > > could search applications by package name using API. > Access is > > > open > > > > > > > > for everyone and free. You could find docs here: > > > > > > >http://checkware.ru/warenet.html
> > > > > > > > Hope that might help
> > > > > > > > On Nov 7, 12:45 am, Brad <rbg...@gmail.com > <mailto:rbg...@gmail.com>> wrote:
> > > > > > > > > I'm working on a new website which aims to give > all Android > > > > > developers > > > > > > > > > much more information about what's happening with > the market > > > and > > > > > some > > > > > > > > > tools to see how their apps are doing in relation > to other > > > apps. As > > > > > > > > > part of the services, we are going to supply a > downloadable > > > .csv > > > > > file > > > > > > > > > containing all apps on the market, their market > ratings, the > > > index > > > > > of > > > > > > > > > where they are in the "Popular" order (if they > show up at all), > > > and > > > > > > > > > two other rating systems we have developed (which are > > > considerably > > > > > > > > > better than the market ratings), and another file > containing a > > > list > > > > > of > > > > > > > > > all developers. The files will be available to > anyone who wants > > > to > > > > > > > > > download them.
> > > > > > > > > While programming this it has occurred to me many > times that a > > > lot > > > > > of > > > > > > > > > the work I'm doing is being duplicated in whole or > in part by > > > most > > > > > of > > > > > > > > > the people on this list, and if we cooperated a > little we could > > > > > save > > > > > > > > > each other a ton of work and/or bandwidth. For > instance, the > > > file I > > > > > > > > > will share that contains the app information will > contain the > > > > > package > > > > > > > > > name of the app, so any dev that is working with > this API could > > > use > > > > > it > > > > > > > > > to download the complete app information much more > efficiently > > > than > > > > > > > > > trying to get it by the different techniques we > are all using > > > to > > > > > try > > > > > > > > > to get complete lists from the market. And the > file with dev > > > info > > > > > > > > > could be used to pull all the dev's apps fairly > efficiently.
> > > > > > > > > SO... my thought was that if I supplied these > files to everyone > > > it > > > > > > > > > would make all our lives easier... but to do it I > need to be > > > sure > > > > > my > > > > > > > > > own data is very up to date. I'm wondering if some > other devs > > > on > > > > > this > > > > > > > > > list who have fairly complete data would be > willing to share it > > > > > with > > > > > > > > > me, so I can share it with everyone. If just a few > of us > > > cooperated > > > > > we > > > > > > > > > could save everyone a lot of time and effort.
> > > > > > > > > Anyone willing to help out?
> > > > > > > > > OH... the first test file I created for the apps > is available > > > here > > > > > :
> I have a separate thread that fetches all the 800 authors (newest apps > first) then add the authors to my db if it doesn't exist yet. then same > process goes on (fetch all authors from db, fetch their apps..so on and so > forth.....)
> On Wed, Nov 17, 2010 at 3:30 AM, styler <styler1...@gmail.com> wrote:
>> so are you using setQuery at all, or how do you discover the new >> applications are they are published on the market?
>> On Nov 16, 2:01 am, Marc Lester Tan <mail...@gmail.com> wrote: >> > I use exponential back-off as well but limited up to 1 minute only. If >> after >> > X tries using different google accounts, then drop the particular >> request >> > and move on to the next.
>> > On Tue, Nov 16, 2010 at 10:47 AM, styler <styler1...@gmail.com> wrote: >> > > See I have acquired ~30 domains with the android keyword and I'm >> > > currently piecing together a site in php. However I'd like to just be >> > > able to have it run with as little monitoring effort, and time will >> > > tell if the 503 leaves. They talk about using an exponential back-off >> > > algorithm when you get the 503's. I still don't know if that means 20 >> > > minutes or 2 days or what. I guess you never know with that.
>> > > So your accounts do get banned for life?
>> > > On Nov 15, 7:36 pm, Marc Lester Tan <mail...@gmail.com> wrote: >> > > > Yup, although I think some of them are failing already. Haven't >> checked >> > > for >> > > > a few months. 503's can be prevented by using several gmail >> accounts. I >> > > > bought a domain from google then bulk upload the list of users. Some >> > > > accounts will return 503's eventually but then you just have to >> refresh >> > > them >> > > > by creating another set of users then bulk upload. I'm aware that my >> > > catalog >> > > > doesn't have the 2.2 apps.
>> > > > Marc
>> > > > On Tue, Nov 16, 2010 at 6:43 AM, styler <styler1...@gmail.com> >> wrote: >> > > > > Youre updating 112k apps every night? How do you get around the >> 503's? >> > > > > What is the interval in which you are querying?
>> > > > > On Nov 11, 7:42 pm, Marc Lester Tan <mail...@gmail.com> wrote: >> > > > > > Hi guys,
>> > > > > > I checked just now and i have 112,494 distinct package names in >> my >> > > > > database >> > > > > > (http://www.appcellar.com). If somebody is compiling the list >> now I >> > > can >> > > > > give >> > > > > > the data. I'm fetching all applications per >> version/locale/author >> > > once a >> > > > > > day.
>> > > > > > On Fri, Nov 12, 2010 at 9:17 AM, Brad <rbg...@gmail.com> wrote: >> > > > > > > Ok... I'll have a look at it and see if you have any I don't. >> > > > > > > Thanks...
>> > > > > > > You might want to try my file also... I've got 64,000+ apps in >> it >> > > > > > > right now, and I'm generating the file nightly (about 20 >> minutes >> > > after >> > > > > > > midnight UTC time). I mention the format for pulling the >> latest >> > > file >> > > > > > > in one of the messages above. As of tonight it only contains >> the >> > > > > > > fields I mention above, but tonight I am going to change it to >> put >> > > the >> > > > > > > current version number in it, and also the developer id. It >> will >> > > make >> > > > > > > it much more useful for anyone else. I'll post back here after >> I've >> > > > > > > made the change, and give the field list and let you know the >> file >> > > > > > > name. I'm going to see if I can just write the same file name >> every >> > > > > > > time, so that whenever you pull it, it will be the last one >> > > generated.
>> > > > > > > Oh.. on a related note.. Does anyone know what the total apps >> in >> > > the >> > > > > > > market right now.... I've been working on the assumption that >> there >> > > > > > > over 70,000 apps, but now I hear the actual number today could >> be >> > > over >> > > > > > > 100,000.
>> > > > > > > What's the highest number anyone has?
>> > > > > > > > I've made android market crawler and now have ~22k >> applications. >> > > You >> > > > > > > > could search applications by package name using API. Access >> is >> > > open >> > > > > > > > for everyone and free. You could find docs here: >> > > > > > >http://checkware.ru/warenet.html
>> > > > > > > > Hope that might help
>> > > > > > > > On Nov 7, 12:45 am, Brad <rbg...@gmail.com> wrote:
>> > > > > > > > > I'm working on a new website which aims to give all >> Android >> > > > > developers >> > > > > > > > > much more information about what's happening with the >> market >> > > and >> > > > > some >> > > > > > > > > tools to see how their apps are doing in relation to other >> > > apps. As >> > > > > > > > > part of the services, we are going to supply a >> downloadable >> > > .csv >> > > > > file >> > > > > > > > > containing all apps on the market, their market ratings, >> the >> > > index >> > > > > of >> > > > > > > > > where they are in the "Popular" order (if they show up at >> all), >> > > and >> > > > > > > > > two other rating systems we have developed (which are >> > > considerably >> > > > > > > > > better than the market ratings), and another file >> containing a >> > > list >> > > > > of >> > > > > > > > > all developers. The files will be available to anyone who >> wants >> > > to >> > > > > > > > > download them.
>> > > > > > > > > While programming this it has occurred to me many times >> that a >> > > lot >> > > > > of >> > > > > > > > > the work I'm doing is being duplicated in whole or in part >> by >> > > most >> > > > > of >> > > > > > > > > the people on this list, and if we cooperated a little we >> could >> > > > > save >> > > > > > > > > each other a ton of work and/or bandwidth. For instance, >> the >> > > file I >> > > > > > > > > will share that contains the app information will contain >> the >> > > > > package >> > > > > > > > > name of the app, so any dev that is working with this API >> could >> > > use >> > > > > it >> > > > > > > > > to download the complete app information much more >> efficiently >> > > than >> > > > > > > > > trying to get it by the different techniques we are all >> using >> > > to >> > > > > try >> > > > > > > > > to get complete lists from the market. And the file with >> dev >> > > info >> > > > > > > > > could be used to pull all the dev's apps fairly >> efficiently.
>> > > > > > > > > SO... my thought was that if I supplied these files to >> everyone >> > > it >> > > > > > > > > would make all our lives easier... but to do it I need to >> be >> > > sure >> > > > > my >> > > > > > > > > own data is very up to date. I'm wondering if some other >> devs >> > > on >> > > > > this >> > > > > > > > > list who have fairly complete data would be willing to >> share it >> > > > > with >> > > > > > > > > me, so I can share it with everyone. If just a few of us >> > > cooperated >> > > > > we >> > > > > > > > > could save everyone a lot of time and effort.
>> > > > > > > > > Anyone willing to help out?
>> > > > > > > > > OH... the first test file I created for the apps is >> available >> > > here >> > > > > :
>> > > > > > > > > It's not complete, and the fields (in order) are: >> > > > > > > > > My id # >> > > > > > > > > package name >> > > > > > > > > market rating >> > > > > > > > > No Crappy Apps Rating >> > > > > > > > > User Rating
>> > > > > > > > > Hope to hear from a bunch of you !
>> > > > > > > > > Thanks
>> > > > > > > > > Brad.
>> > > > > > > -- >> > > > > > > You received this message because you are subscribed to the >> Google >> > > > > Groups >> > > > > > > "android-market-api" group. >> > > > > > > To post to this group, send email to >> > > > > android-market-api@googlegroups.com. >> > > > > > > To unsubscribe from this group, send email to >> > > > > > > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com><android-market-api%2Bunsubs >> cribe@googlegroups.com><android-market-api%2Bunsubs >> > > cribe@googlegroups.com><android-market-api%2Bunsubs >> > > > > cribe@googlegroups.com> >> > > > > > > . >> > > > > > > For more options, visit this group at >> > > > > > >http://groups.google.com/group/android-market-api?hl=en.
>> > > > > -- >> > > > > You received this message because you are subscribed to the Google >> > > Groups >> > > > > "android-market-api" group. >> > > > > To post to this group, send email to >> > > android-market-api@googlegroups.com. >> > > > > To unsubscribe from this group, send email to >> > > > > android-market-api+unsubscribe@googlegroups.com<android-market-api%2Bunsubs cribe@googlegroups.com><android-market-api%2Bunsubs >> cribe@googlegroups.com><android-market-api%2Bunsubs >> > > cribe@googlegroups.com> >> > > > > . >> > > > > For more options, visit this group at >> > > > >http://groups.google.com/group/android-market-api?hl=en.
>> > > -- >> > > You received this message because you are subscribed to the Google >> Groups >> > > "android-market-api" group. >> > > To post to this group, send
You have something going on with your site, I'm guessing there is some javascript that is causing this but in chrome, on the top 200 pages, your site freezes.
> On Wed, Nov 17, 2010 at 11:34 PM, Tyler Williamson > <styler1...@gmail.com <mailto:styler1...@gmail.com>> wrote:
> That seems like a good idea! Cool thanks!
> On 11/17/2010 9:33 AM, Marc Lester Tan wrote: >> I have a separate thread that fetches all the 800 authors (newest >> apps first) then add the authors to my db if it doesn't exist >> yet. then same process goes on (fetch all authors from db, fetch >> their apps..so on and so forth.....)
>> On Wed, Nov 17, 2010 at 3:30 AM, styler <styler1...@gmail.com >> <mailto:styler1...@gmail.com>> wrote:
>> so are you using setQuery at all, or how do you discover the new >> applications are they are published on the market?
>> On Nov 16, 2:01 am, Marc Lester Tan <mail...@gmail.com >> <mailto:mail...@gmail.com>> wrote: >> > I use exponential back-off as well but limited up to 1 >> minute only. If after >> > X tries using different google accounts, then drop the >> particular request >> > and move on to the next.
>> > On Tue, Nov 16, 2010 at 10:47 AM, styler >> <styler1...@gmail.com <mailto:styler1...@gmail.com>> wrote: >> > > See I have acquired ~30 domains with the android keyword >> and I'm >> > > currently piecing together a site in php. However I'd >> like to just be >> > > able to have it run with as little monitoring effort, and >> time will >> > > tell if the 503 leaves. They talk about using an >> exponential back-off >> > > algorithm when you get the 503's. I still don't know if >> that means 20 >> > > minutes or 2 days or what. I guess you never know with that.
>> > > So your accounts do get banned for life?
>> > > On Nov 15, 7:36 pm, Marc Lester Tan <mail...@gmail.com >> <mailto:mail...@gmail.com>> wrote: >> > > > Yup, although I think some of them are failing already. >> Haven't checked >> > > for >> > > > a few months. 503's can be prevented by using several >> gmail accounts. I >> > > > bought a domain from google then bulk upload the list >> of users. Some >> > > > accounts will return 503's eventually but then you just >> have to refresh >> > > them >> > > > by creating another set of users then bulk upload. I'm >> aware that my >> > > catalog >> > > > doesn't have the 2.2 apps.
>> > > > Marc
>> > > > On Tue, Nov 16, 2010 at 6:43 AM, styler >> <styler1...@gmail.com <mailto:styler1...@gmail.com>> wrote: >> > > > > Youre updating 112k apps every night? How do you get >> around the 503's? >> > > > > What is the interval in which you are querying?
>> > > > > On Nov 11, 7:42 pm, Marc Lester Tan >> <mail...@gmail.com <mailto:mail...@gmail.com>> wrote: >> > > > > > Hi guys,
>> > > > > > I checked just now and i have 112,494 distinct >> package names in my >> > > > > database >> > > > > > (http://www.appcellar.com). If somebody is >> compiling the list now I >> > > can >> > > > > give >> > > > > > the data. I'm fetching all applications per >> version/locale/author >> > > once a >> > > > > > day.
>> > > > > > On Fri, Nov 12, 2010 at 9:17 AM, Brad >> <rbg...@gmail.com <mailto:rbg...@gmail.com>> wrote: >> > > > > > > Ok... I'll have a look at it and see if you have >> any I don't. >> > > > > > > Thanks...
>> > > > > > > You might want to try my file also... I've got >> 64,000+ apps in it >> > > > > > > right now, and I'm generating the file nightly >> (about 20 minutes >> > > after >> > > > > > > midnight UTC time). I mention the format for >> pulling the latest >> > > file >> > > > > > > in one of the messages above. As of tonight it >> only contains the >> > > > > > > fields I mention above, but tonight I am going to >> change it to put >> > > the >> > > > > > > current version number in it, and also the >> developer id. It will >> > > make >> > > > > > > it much more useful for anyone else. I'll post >> back here after I've >> > > > > > > made the change, and give the field list and let >> you know the file >> > > > > > > name. I'm going to see if I can just write the >> same file name every >> > > > > > > time, so that whenever you pull it, it will be >> the last one >> > > generated.
>> > > > > > > Oh.. on a related note.. Does anyone know what >> the total apps in >> > > the >> > > > > > > market right now.... I've been working on the >> assumption that there >> > > > > > > over 70,000 apps, but now I hear the actual >> number today could be >> > > over >> > > > > > > 100,000.
>> > > > > > > What's the highest number anyone has?
>> > > > > > > > I've made android market crawler and now have >> ~22k applications. >> > > You >> > > > > > > > could search applications by package name using >> API. Access is >> > > open >> > > > > > > > for everyone and free. You could find docs here: >> > > > > > >http://checkware.ru/warenet.html
>> > > > > > > > Hope that might help
>> > > > > > > > On Nov 7, 12:45 am, Brad <rbg...@gmail.com >> <mailto:rbg...@gmail.com>> wrote:
>> > > > > > > > > I'm working on a new website which aims to >> give all Android >> > > > > developers >> > > > > > > > > much more information about what's happening >> with the market >> > > and >> > > > > some >> > > > > > > > > tools to see how their apps are doing in >> relation to other >> > > apps. As >> > > > > > > > > part of the services, we are going to supply >> a downloadable >> > > .csv >> > > > > file >> > > > > > > > > containing all apps on the market, their >> market ratings, the >> > > index >> > > > > of >> > > > > > > > > where they are in the "Popular" order (if >> they show up at all), >> > > and >> > > > > > > > > two other rating systems we have developed >> (which are >> > > considerably >> > > > > > > > > better than the market ratings), and another >> file containing a >> > > list >> > > > > of >> > > > > > > > > all developers. The files will be available >> to anyone who wants >> > > to >> > > > > > > > > download them.
>> > > > > > > > > While programming this it has occurred to me >> many times that a >> > > lot >> > > > > of >> > > > > > > > > the work I'm doing is being duplicated in >> whole or in part by >> > > most >> > > > > of >> > > > > > > > > the people on this list, and if we cooperated >> a little we could >> > > > > save >> > > > > > > > > each other a ton of work and/or bandwidth. >> For instance, the >> > > file I >> > > > > > > > > will share that contains the app information >> will contain the >> > > > > package >> > > > > > > > > name of the app, so any dev that is working >> with this API could >> > > use >> > > > > it >> > > > > > > > > to download the complete app information much >> more efficiently >> > > than >> > > > > > > > > trying to get it by the different techniques >> we are all using >> > > to >> > > > > try >> > > > > > > > > to get complete lists from the market. And >> the file with dev >> > > info >> > > > > > > > > could be used to pull all the dev's apps >> fairly efficiently.
>> > > > > > > > > SO... my thought was that if I supplied these >> files to everyone >> > > it >> > > > > > > > > would make all our lives easier... but to do >> it I need to be >> > > sure >> > > > > my >> > > > > > > > > own data is very up to date. I'm wondering if >> some other devs >> > > on >> > > > > this >> > > > > > > > > list who have fairly
