Problems Importing XML Catalog

[adina...@gmail.com]

Hello,

I am working on creating a website where the library catalog of a
cultural institute can be browsed online. I am new to both Wordpress
and Scriblio, but have managed to install everything properly, and am
now at the point of importing the catalog, which is in XML format (the
original program used to create it is called Buchwalter).
The plugins I've activated are: bSuite, Scriblio, Scriblio Catalog
Importer and Scriblio III Catalog Importer. The widgets I added are
Scrib Search Editor and Facets 1, 4 and 5.
I've been trying to import a demo XML so far, and did this from Tools
-Import, but am not sure any longer if I uploaded it with Livejournal
or Wordpress. My list of posts only shows one post, whereas the
Categories section shows 103 uncategorized Posts. When I click on them
I get to my one post. I have the same problem on the webpage, I can
see some fo the entries under "Related Items", but when I click on
them I get a page error.

What can I do in order to make things work?

Thanks for your help,
Adina

[adina...@gmail.com]

Another detail is that when I go to Tools-Import-Scriblio Catalog
Importer the page I get is blank, which is why I imported the file
with something else... I am already working on converting the XML to
MARC, which means that if I could get this Importer to work, things
should look up... but how do I do that? :)

Thanks,
Adina

[adina...@gmail.com]

Hey, could you guys at least tell me where I can find some answers if
not here?
Thanks.

[Casey Bisson]

This is the correct place to ask questions.

The MARC connector _still_ hasn't been updated for 2.7 yet, so that's
why you're getting a blank screen.

If things go well, I'll have a new version of the MARC connector
available before the end of the week.

--Casey

[Casey Bisson]

I was a few days late:

http://wordpress.org/extend/plugins/scriblio-connector-marcfile/
http://svn.wp-plugins.org/scriblio-connector-marcfile/trunk/

It's not necessarily bug-free yet, so please test and report.

[adina...@gmail.com]

Apparently the program that was used for the library can only export
data into CSV, text or HTML, so I was wrong about already having
access to an XML file. Does anyone know how I could convert CSV/text/
HTML to MARC? I downloaded MarcEdit but haven't quite managed to get
it to do these things yet... Unfortunately I can't give any feedback
about the MARC connector until I get my documents into the MARC
format.

Thank you so much for your help.

Adina

On 9 Jun., 06:42, Casey Bisson <ca...@scriblio.net> wrote:
> I was a few days late:
>

> http://wordpress.org/extend/plugins/scriblio-connector-marcfile/http://svn.wp-plugins.org/scriblio-connector-marcfile/trunk/

[Shannon Astolfi]

Adina,

MarcEdit includes something called the Delimited Text Translator, which allows you to specify the delimiter that an input file is using and output that file as MARC. I would suggest using CSV and the Delimited Text Translator to convert your data.

Shannon

[Casey Bisson]

That's a lot better than what I was going to suggest: modify the MARC
connector to accept and parse a CSV file. Even with fgetcsv, that'd
probably be more work.
http://php.net/fgetcsv

[adina...@gmail.com]

I used the Delimited Text translator and the MarcMaker and got my MARC
file, but when I try to import it (I tried both with the Importer for
the 2.7 version you added here, and the one for the Scriblio 2.8) I
get the following erorrs:


Scriblio Catalog Importer

Reading the file and parsing 1976 records. Please be patient.

1.
2.
3.
4.
5.
.................
1973.
1974.
1975.
1976.

Warnings
bottom · errors

1. Invalid record length "00079"
2. Invalid record length "00079"
..................
1972. Invalid record length "00079"
1973. Invalid record length "00079"
1974. Invalid record length "00079"
1975. Invalid record length "00079"
1976. Invalid record length "00079"

Processing complete.

1976 of 1976 records harvested. with 1976 warnings and 0 errors.

So no posts to be seen, and when I go to publish harvested records, 0
posts to publish.


Adina

On 9 Jun., 22:59, Casey Bisson <ca...@scriblio.net> wrote:
> That's a lot better than what I was going to suggest: modify the MARC  
> connector to accept and parse a CSV file. Even with fgetcsv, that'd  

> probably be more work.http://php.net/fgetcsv

[Casey Bisson]

The "invalid record length" warnings are a bug in the php-marc library
and don't indicate a problem.

Getting no records is likely the result of trying to use a field as
source ID that doesn't exist in the MARC record. Try using "none" for
that option.

--Casey

[adina...@gmail.com]

Well, the problems keep piling up, right now I can't open the site any
longer, and the wordpress login page doesn't work either....
Some other details:
"GET / HTTP/1.1
Host: rkibibliothek.byethost3.com
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:
1.9.0.11) Gecko/2009060215 Firefox/3.0.11 (.NET CLR 3.5.30729)
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/
*;q=0.8
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 300
Connection: keep-alive

HTTP/1.0 500 Internal Server Error
Date: Tue, 16 Jun 2009 1027 GMT
Server: Apache
Cache-Control: no-store, must-revalidate, max-age=0, proxy-revalidate,
no-transform
Expires: Tue, 16 Jun 2009 1027 GMT
Vary: Accept-Encoding,User-Agent
Pragma: no-cache
Content-Length: 0
Content-Type: text/html
X-Cache: MISS from demil1.byetcluster.com, MISS from eic.com
X-Cache-Lookup: MISS from demil1.byetcluster.com:80, MISS from ecom:
3128
Via: 1.0 demil1.byetcluster.com:80 (Lusca/LUSCA_1.0)"

So what now, uninstalling and reistalling everything again?

On Jun 12, 3:26 pm, Casey Bisson <ca...@scriblio.net> wrote:
> The "invalid record length" warnings are a bug in the php-marc library  
> and don't indicate a problem.
>
> Getting no records is likely the result of trying to use a field as  
> source ID that doesn't exist in the MARC record. Try using "none" for  
> that option.
>
> --Casey
>

[adina...@gmail.com]

I reinstalled Wordpress (twice!), I tried importing and using "none"
for the field of source ID and get the same error nonetheless.... Any
other ideas of what I could do?

Adina

On Jun 17, 12:03 pm, "adinalun...@gmail.com" <adinalun...@gmail.com>
wrote:

[Casey Bisson]

Does the error disappear if you disable all the plugins (by renaming
or moving their folders out of the /wp-content/plugins directory)?
It's more than a little likely that the MARC connector is broken.

Perhaps you can share a list of what plugins you're currently using
and their versions?

--Casey

[adina...@gmail.com]

I tried importing with all other plugins disabled (including the
Scriblio plugin, the only active one left was the MARC connector) and
got the follinwg screen: "Scriblio Catalog Importer
Reading the file and parsing 1977 records. Please be patient."
without anything else happening after this.
If I try to import with the scriblio plugin also enabled i get the
same old error.

The plugins I have are:
Akismet
Version 2.2.4 | By Matt Mullenweg | Visit plugin site
Hello Dolly
Version 1.5 | By Matt Mullenweg | Visit plugin site
Scriblio
Version 2.7-r2 | By Casey Bisson | Visit plugin site
Scriblio MARC File Connector
Version 2.7 b3 | By Casey Bisson | Visit plugin site

On Jun 18, 2:16 pm, Casey Bisson <ca...@scriblio.net> wrote:
> Does the error disappear if you disable all the plugins (by renaming  
> or moving their folders out of the /wp-content/plugins directory)?  
> It's more than a little likely that the MARC connector is broken.
>
> Perhaps you can share a list of what plugins you're currently using  
> and their versions?
>
> --Casey
>

[Casey Bisson]

bSuite isn't included in your list, but is required for Scriblio to work correctly (though that's probably not the problem here). 

Are you getting this 500 error only as you try to import records? Can you access other sections of the WordPress dashboard without errors? 

I just noticed in the error response you provided that the web request is going through a Lusca proxy. Can you determine if the proxy is generating the error, or is that coming from the WordPress host directly? The file parser can take a long time to execute, causing many proxies to terminate the connection and return errors, including 500 errors.

--Casey

On Jun 18, 2009, at 9:37 AM, adina...@gmail.com wrote:

I tried importing with all other plugins disabled (including the
Scriblio plugin, the only active one left was the MARC connector) and
got the follinwg screen: "Scriblio Catalog Importer
Reading the file and parsing 1977 records. Please be patient."
without anything else happening after this.
If I try to import with the scriblio plugin also enabled i get the
same old error.

The plugins I have are:
Akismet
Version 2.2.4 | By Matt Mullenweg | Visit plugin site
Hello Dolly
Version 1.5 | By Matt Mullenweg | Visit plugin site
Scriblio
Version 2.7-r2 | By Casey Bisson | Visit plugin site
Scriblio MARC File Connector
Version 2.7 b3 | By Casey Bisson | Visit plugin site

On Jun 18, 2:16 pm, Casey Bisson <ca...@scriblio.net> wrote:

Does the error disappear if you disable all the plugins (by renaming  

or moving their folders out of the /wp-content/plugins directory)?  

It's more than a little likely that the MARC connector is broken.

Perhaps you can share a list of what plugins you're currently using  

and their versions?

--Casey

...

[adina...@gmail.com]

I don't know if I get the 500 error only as I try to import, since I
noticed this error a while afterwards, so it definately doesn't show
up immediately ( I can still see the site after failed (or ongoing?)
attempts of importing).
When I get this error I can't access Wordpress or see the site at all
other than by ftp, which Is why I reinstalled it twice....
I'm not sure how to determine whether the proxy is  generating the
error, or is that coming from the WordPress host directly.
I installed bsuite, should bsuite and scriblio both be activated when
I try to import from MARC?

Thanks.
Adina

On Jun 18, 3:55 pm, Casey Bisson <ca...@scriblio.net> wrote:
> bSuite isn't included in your list, but is required for Scriblio to  
> work correctly (though that's probably not the problem here).
>
> Are you getting this 500 error only as you try to import records? Can  
> you access other sections of the WordPress dashboard without errors?
>
> I just noticed in the error response you provided that the web request  
> is going through a Lusca proxy. Can you determine if the proxy is  
> generating the error, or is that coming from the WordPress host  
> directly? The file parser can take a long time to execute, causing  
> many proxies to terminate the connection and return errors, including  
> 500 errors.
>
> --Casey
>

[Casey Bisson]

Please test the following with a fresh install of WordPress, exploring
various sections of the dashboard at each step:

1: WordPress with the default theme and no plugins.

2: WordPress with the default theme and bSuite activated.

3: WordPress with the default theme and bSuite and Scriblio activated.

4: WordPress with the default theme and bSuite, Scriblio, and MARC
connector activated.

Please describe what you discover at each stage. If you encounter an
error, please describe the actions that preceded the error and include
the URL path you were trying to access.

Regarding how to identify the true source of a 500 error, I can only
say that I rarely encounter them. PHP errors usually do not result in
HTTP errors. I have seen them with broken invalid HTTPd configuration
settings (in Apache conf files, .htaccess files and elsewhere). And
it's also the error that Varnish (the reverse proxy that I'm most
familiar with) often emits when the connection to the upstream server
times out.

http://en.wikipedia.org/wiki/List_of_HTTP_status_codes#5xx_Server_Error

[adina...@gmail.com]

I'm not sure going through these four steps makes a difference...
since the error appears quite some time after I go through all these
steps, so I can't definately say which point triggers the error, but
would assume it is the attemp to import files with MARC, since I
haven't had this error before starting to use this plugin..

On Jun 18, 4:21 pm, Casey Bisson <ca...@scriblio.net> wrote:
> Please test the following with a fresh install of WordPress, exploring  
> various sections of the dashboard at each step:
>
> 1: WordPress with the default theme and no plugins.
>
> 2: WordPress with the default theme and bSuite activated.
>
> 3: WordPress with the default theme and bSuite and Scriblio activated.
>
> 4: WordPress with the default theme and bSuite, Scriblio, and MARC  
> connector activated.
>
> Please describe what you discover at each stage. If you encounter an  
> error, please describe the actions that preceded the error and include  
> the URL path you were trying to access.
>
> Regarding how to identify the true source of a 500 error, I can only  
> say that I rarely encounter them. PHP errors usually do not result in  
> HTTP errors. I have seen them with broken invalid HTTPd configuration  
> settings (in Apache conf files, .htaccess files and elsewhere). And  
> it's also the error that Varnish (the reverse proxy that I'm most  
> familiar with) often emits when the connection to the upstream server  
> times out.
>
> http://en.wikipedia.org/wiki/List_of_HTTP_status_codes#5xx_Server_Error
>

[Casey Bisson]

The steps I suggested were to isolate where the error was appearing as
a means to identify its cause.

If the only activity that results in 500 errors is trying to upload or
parse a marc file (both are time consuming actions), then it's very
likely that a proxy is at fault.

You might try uploading a file with only one or two records, as that
should upload and parse much quicker.

--Casey