Re: Issue 20 in google-sites-liberation: Only Exports 10% of Site

[google-site...@googlecode.com]

Comment #9 on issue 20 by victorpereyra: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

Hi, we have activated the java console but it doesn't show the output while
running the
tool. Is there any other way we can get this information, so we can post
the
informaction?

--
You received this message because you are listed in the owner
or CC fields of this issue, or because you starred this issue.
You may adjust your issue notification preferences at:
http://code.google.com/hosting/settings

[google-site...@googlecode.com]

Comment #10 on issue 20 by gk5...@kickstyle.net: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

Another bug report has indicated that the latest updates to Google Sites
has fixed the
problem. Please try your exports again and see if it works.

[google-site...@googlecode.com]

Comment #11 on issue 20 by victorpereyra: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

The problem persists, the GSL downloads some files, but then, it stops (see
attachment)

Attachments:
WF_058.jpg 133 KB

[google-site...@googlecode.com]

Comment #12 on issue 20 by teleservices: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

I have the same issue using Mac OS X 5.8.

I am not sure how to determine my exact java config (anyone?) and do not
know where
to find any logs that may have been generated.

Please explain how I can help trouble shoot this issue.

I have included a screenshot...

Attachments:
Picture 1.png 115 KB

[google-site...@googlecode.com]

Comment #13 on issue 20 by nelson.matt.c: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

This error is reproducible on MacOSX and Ubunutu. Below is the output from
the
terminal in Ubuntu...

$ java -jar google-sites-liberation-1.0.1.jar
Exception in thread "Thread-2" java.lang.NullPointerException at
com.google.gdata.util.common.base.Preconditions.checkNotNull(Preconditions.java:187)
at com.google.sites.liberation.util.XmlElement.addText(XmlElement.java:76)
at
com.google.sites.liberation.export.HistoryExporterImpl.exportHistory(HistoryExporterImpl.java:77)
at
com.google.sites.liberation.export.RevisionsExporterImpl.exportRevisions(RevisionsExporterImpl.java:100)
at
com.google.sites.liberation.export.SiteExporterImpl.exportSite(SiteExporterImpl.java:133)
at
com.google.sites.liberation.util.GuiMain$ImportExportRunnable.run(GuiMain.java:279)
at java.lang.Thread.run(Thread.java:619)

[google-site...@googlecode.com]

Comment #14 on issue 20 by victorpereyra: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

In my case, this error is reproducible on Windows XP, on 3 different
networks, on 3
different computers.

[google-site...@googlecode.com]

Comment #15 on issue 20 by XavierBlak: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

Reproducible on a Win XP machine. It retrieves the entries okay and then
starts
grabbing the pages. And then at a seemingly random spot it dies. I don't
know if the
last page it lists is the one it dies on but it is a different page each
time I tried it.

C:\>java -jar google-sites-liberation-1.0.1.jar
Exception in thread "Thread-4" java.lang.NullPointerException: text
at
com.google.common.base.Preconditions.checkNotNull(Preconditions.java:203)
at
com.google.sites.liberation.renderers.RendererUtils.getHyperLink(RendererUtils.java:140)
at
com.google.sites.liberation.renderers.RendererUtils.getAuthorElement(RendererUtils.java:71)
at
com.google.sites.liberation.renderers.ContentRendererImpl.renderContent(ContentRendererImpl.java:39)
at
com.google.sites.liberation.export.PageExporterImpl.exportPage(PageExporterImpl.java:123)
at
com.google.sites.liberation.export.SiteExporterImpl.exportPage(SiteExporterImpl.java:158)
at
com.google.sites.liberation.export.SiteExporterImpl.exportSite(SiteExporterImpl.java:131)
at
com.google.sites.liberation.util.GuiMain$ImportExportRunnable.run(GuiMain.java:279)
at java.lang.Thread.run(Unknown Source)

[google-site...@googlecode.com]

Comment #16 on issue 20 by victorpereyra: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

I dont know if it's related but, after the recent update to Google Sites
Api, I could
download 1 site, I'm trying with another one that is larger the the first
one.

[google-site...@googlecode.com]

Comment #17 on issue 20 by teleservices: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

I just tried again from MacBook Pro OS X 10.5.8:

$ java -jar google-sites-liberation-1.0.1.jar
Jan 27, 2010 8:21:11 AM
com.google.sites.liberation.export.InMemoryEntryStore addEntry
WARNING: All non-page entries must have a parent!
Exception in thread "Thread-2" java.lang.NullPointerException: text

at
com.google.common.base.Preconditions.checkNotNull(Preconditions.java:203)
at
com.google.sites.liberation.renderers.RendererUtils.getHyperLink(RendererUtils.java:140)
at
com.google.sites.liberation.renderers.RendererUtils.getAuthorElement(RendererUtils.java:71)
at
com.google.sites.liberation.renderers.ContentRendererImpl.renderContent(ContentRendererImpl.java:39)
at
com.google.sites.liberation.export.PageExporterImpl.exportPage(PageExporterImpl.java:123)
at
com.google.sites.liberation.export.SiteExporterImpl.exportPage(SiteExporterImpl.java:158)
at
com.google.sites.liberation.export.SiteExporterImpl.exportSite(SiteExporterImpl.java:131)
at
com.google.sites.liberation.util.GuiMain$ImportExportRunnable.run(GuiMain.java:279)

at java.lang.Thread.run(Thread.java:613)

SEE my previoiusly posted screenshot (it about the same)

This is a potentially invaluable tool. Anyone ever going to deal with
this?...

[google-site...@googlecode.com]

Comment #18 on issue 20 by victorpereyra: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

4 months and no news... the issue persists besides the google sites api
update...

[google-site...@googlecode.com]

Comment #19 on issue 20 by joseluisrprado: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

I got it...
The problem is that the page that stops de export was edited by a user that
has been deleted from out google
apps account.
When you try to see the revision history, it says that the page was edited
by an "unkwon user".
That must be it.

Can anyone edit the code in
com.google.sites.liberation.renderers.RendererUtils.getAuthorElement(RendererUtils.java:72)
and protect the line...

/**
* Creates a new hCard element for the given entry.
*/
static XmlElement getAuthorElement(BaseContentEntry<?> entry) {
checkNotNull(entry);
XmlElement element = new XmlElement("span");
element.setAttribute("class", "author");
XmlElement vcard = new XmlElement("span");
vcard.setAttribute("class", "vcard");
Person author = entry.getAuthors().get(0);
String name = author.getName();
String email = author.getEmail();
if (name == null) {
if (email == null) { // THIS LINE IS NEW
XmlElement link = getHyperLink("mailto:", "unknown author"); // THIS
LINE IS NEW
} else { // THIS LINE IS NEW
XmlElement link = getHyperLink("mailto:" + email, email);
} // THIS LINE IS NEW
link.setAttribute("class", "email");
vcard.addElement(link);
} else {
XmlElement link = getHyperLink("mailto:" + email, name);
link.setAttribute("class", "fn");
vcard.addElement(link);
}
return element.addElement(vcard);
}




Current progress: 0%.
Exporting page: Question?rio de Permiss?es do Sistema Inteq.
Exception in thread "main" java.lang.NullPointerException: text
at
com.google.common.base.Preconditions.checkNotNull(Preconditions.java:203)
at
com.google.sites.liberation.renderers.RendererUtils.getHyperLink(RendererUtils.java:141)
at
com.google.sites.liberation.renderers.RendererUtils.getAuthorElement(RendererUtils.java:72)

at
com.google.sites.liberation.renderers.ContentRendererImpl.renderContent(ContentRendererImpl.java:39)
at
com.google.sites.liberation.export.PageExporterImpl.exportPage(PageExporterImpl.java:123)
at
com.google.sites.liberation.export.SiteExporterImpl.exportPage(SiteExporterImpl.java:158)
at
com.google.sites.liberation.export.SiteExporterImpl.exportSite(SiteExporterImpl.java:131)

at com.google.sites.liberation.export.Main.doMain(Main.java:81)
at com.google.sites.liberation.export.Main.main(Main.java:97)

[google-site...@googlecode.com]

Comment #20 on issue 20 by stratogicCloud: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

build or fill business technology gaps based on your specific vertical,
platform, target capability development and product direction. Cloud
Computing was started from a non-traditional IT player. Amazon.com, the
famous web based bookseller, has changed the traditional computer hosting
model by offering hosted computers
<a href="http://stratogic.com/">Hosting</a>

[google-site...@googlecode.com]

Comment #21 on issue 20 by vikash.kodati: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

Hi All. If this issue was resolved for any of you, kindly let me know.

[google-site...@googlecode.com]

Comment #22 on issue 20 by teleservices: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

This useless program is still useless. I just tried it again (MBP 10.5.8).

All I get is a full barber-pole progress bar and a disabled "Done" button.

At one point it did do partial downloads - again, useless.

I think it should be pulled and stop wasting people's time.

Here is a command line run:

java -cp google-sites-liberation-1.0.3.jar \
> com.google.sites.liberation.export.Main \
> -h sites.google.com \
> -d decdynamics.com \
> -w team \
> -u USER \
> -p PASSWORD \
> -f team/ \
> -r
Exception in thread "main" java.lang.UnsupportedClassVersionError: Bad
version number in .class file
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:676)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
at java.net.URLClassLoader.access$100(URLClassLoader.java:56)
at java.net.URLClassLoader$1.run(URLClassLoader.java:195)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:317)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:280)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:375)
at com.google.sites.liberation.export.Main.doMain(Main.java:67)
at com.google.sites.liberation.export.Main.main(Main.java:97)
~/Desktop/google liberation  java -version
java version "1.5.0_24"
Java(TM) 2 Runtime Environment, Standard Edition (build
1.5.0_24-b02-357-9M3165)
Java HotSpot(TM) Client VM (build 1.5.0_24-149, mixed mode, sharing)

[google-site...@googlecode.com]

Comment #23 on issue 20 by michal.s...@gmail.com: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

Hi, I have exact same problem as reported in comment #19. Here is my
stacktrace:

WARNING: All entries should have a unique non-null id!
Exception in thread "Thread-2" java.lang.NullPointerException: text

at
com.google.common.base.Preconditions.checkNotNull(Preconditions.java:203)
at
com.google.sites.liberation.renderers.RendererUtils.getHyperLink(RendererUtils.java:141)
at
com.google.sites.liberation.renderers.RendererUtils.getAuthorElement(RendererUtils.java:72)
at
com.google.sites.liberation.renderers.ContentRendererImpl.renderContent(ContentRendererImpl.java:39)
at
com.google.sites.liberation.export.PageExporterImpl.exportPage(PageExporterImpl.java:123)
at
com.google.sites.liberation.export.SiteExporterImpl.exportPage(SiteExporterImpl.java:158)
at
com.google.sites.liberation.export.SiteExporterImpl.exportSite(SiteExporterImpl.java:131)
at

com.google.sites.liberation.util.GuiMain$ImportExportRunnable.run(GuiMain.java:279)
at java.lang.Thread.run(Thread.java:680)

Any workarounds? (I can't do the export, it always crashes at the same
point)

[google-site...@googlecode.com]

Comment #24 on issue 20 by onebit.h...@gmail.com: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

Why no reply from google ?
Lets it dies without any fix, why public it to customer ?

[google-site...@googlecode.com]

Comment #25 on issue 20 by valentin...@googlemail.com: Only Exports 10% of
Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

It worked for me most of the time, the only trouble seemed to be network
connection problems.

But today this error "All entries should have a unique non-null id!" keeps
showing up permanently now - in a site which did not change from the last
successful backup yesterday! Seems to me that there is something broken
within sites, and this triggers this error such that one can no more backup
sites. However according to the app dashboard everything is shown "OK" on
sites, which I doubt, because I checked with two different ISPs with
different routes to Google on two different machines, both show the exact
same behavior, so the only probable common error source is Google.

I even updated sites-liberation.jar to 1.0.4, no help.

The error message is non-helpful and there certainly is missing a fix like
a retry feature, which skips what was done properly and only retries what
failed. A complete run currently only backups portions of a site (at least
here), and you cannot be sure that N partial backups done really cover all
data in a site.

Again to stress it, I have an automated daily backup, and it ran fine the
last, say, 100 days. So, please, Google, fix that. Thanks.

Here is one example:

Retrieved 1120 entries.
Jul 1, 2011 12:58:31 PM
com.google.sites.liberation.export.ContinuousContentFeed$FeedIterator
catchException
WARNING: Error retrieving response from query.
com.google.gdata.util.ServiceException: Internal Server Error
Internal Error

at
com.google.gdata.client.http.HttpGDataRequest.handleErrorResponse(HttpGDataRequest.java:588)
at
com.google.gdata.client.http.GoogleGDataRequest.handleErrorResponse(GoogleGDataRequest.java:543)
at
com.google.gdata.client.http.HttpGDataRequest.checkResponse(HttpGDataRequest.java:536)
at
com.google.gdata.client.http.HttpGDataRequest.execute(HttpGDataRequest.java:515)
at
com.google.gdata.client.http.GoogleGDataRequest.execute(GoogleGDataRequest.java:515)
at com.google.gdata.client.Service.getFeed(Service.java:1053)
at com.google.gdata.client.Service.getFeed(Service.java:995)
at
com.google.gdata.client.GoogleService.getFeed(GoogleService.java:662)
at com.google.gdata.client.Service.getFeed(Service.java:952)
at
com.google.sites.liberation.util.EntryProviderImpl.getEntries(EntryProviderImpl.java:45)
at
com.google.sites.liberation.export.ContinuousContentFeed$FeedIterator.getEntries(ContinuousContentFeed.java:141)
at
com.google.sites.liberation.export.ContinuousContentFeed$FeedIterator.computeNext(ContinuousContentFeed.java:115)
at
com.google.sites.liberation.export.ContinuousContentFeed$FeedIterator.computeNext(ContinuousContentFeed.java:95)
at
com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:135)
at
com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:130)
at
com.google.sites.liberation.export.SiteExporterImpl.exportSite(SiteExporterImpl.java:101)

at com.google.sites.liberation.export.Main.doMain(Main.java:81)
at com.google.sites.liberation.export.Main.main(Main.java:97)

Jul 1, 2011 12:59:14 PM
com.google.sites.liberation.export.InMemoryEntryStore addEntry

WARNING: All entries should have a unique non-null id!

Retrieved 1140 entries.

[google-site...@googlecode.com]

Comment #26 on issue 20 by ccat...@gmail.com: Only Exports 10% of Site
http://code.google.com/p/google-sites-liberation/issues/detail?id=20

@ #6:

Thank you SO much. Your method worked flawlessly and instantly, completely
bypassing this tool.

[google-site...@googlecode.com]

Comment #27 on issue 20 by star1...@gmail.com: Only Exports 10% of Site
https://code.google.com/p/google-sites-liberation/issues/detail?id=20

I had same problem too. Some pages were exported by this tool, not all of
them. I noticed liberation tool exports recent posts only. So, I modified
old posts little, for example, just click the modification button and
save(I did modification more easier than this in the site management, but I
can't explain this well...). Then, I could export all the posts.


--
You received this message because this project is configured to send all
issue notifications to this address.
You may adjust your notification preferences at:
https://code.google.com/hosting/settings