Error Status when using Google Apps Email Audit API

[Scott]

Two weeks ago we started getting an error status on all exports.  We were using GAM, but started working directly with the API calls in a new app.  I uploaded a new GPG key thinking that might also be the issue.  However, we are still getting errors.  We have provisioning enabled for our domain.  Any ideas?  The status of error really doesn't help us or give us much information.  Thanks.

[Michael Manoochehri]

Hi Scott,

• Can you be more specific about the error status you are receiving?
  
• Also, specifically, what type of call are you making to the API?

Michael

[Scott]

Here is the script to request a mailbox export:

public static void startExport(String adminUser, String adminPwd, String exportUserEmail)
    {
        System.out.println("admin user " + adminUser);
        MailBoxDumpRequest request = new MailBoxDumpRequest();
        request.setAdminEmailAddress(adminUser);
        request.setUserEmailAddress(exportUserEmail);

        request.setIncludeDeleted(true);
        request.setPackageContent("FULL_MESSAGE");
        
        try
        {
            AuditService service = new AuditService(adminUser, adminPwd, "<domain>", "<domain>-auditapp-v1");
            GenericEntry mailboxDumpEntry = service.createMailboxDumpRequest(request);
            System.out.println(mailboxDumpEntry.getId());
        }catch(Exception exp)
        {
            System.out.println(exp.getMessage());
        }
    }

Here is the status:

Request ID: 23966540

 User: <user>

 Status: ERROR

 Request Date: 2011-06-16 20:42

 Requested By: <admin>

 Requested Parts: FULL_MESSAGE

 Request Filter: None

 Include Deleted: true

Thanks.

[Scott]

Anyone have any ideas?  This is a big issue for us.  Thanks.

[Claudio Cherubino]

Hi Scott,

Our logs for your domain only show a series of invalid requests (HTTP response code 400) sent on June 29th, for privacy reasons we can only go back in time for 10 days.

Can you please send a new mailbox dump request now so that we can track it down and understand what goes wrong?

Thanks

Claudio

On Thu, Jul 7, 2011 at 12:33 PM, Scott <sst...@hyattvoi.com> wrote:

Anyone have any ideas?  This is a big issue for us.  Thanks.

--
You received this message because you are subscribed to the Google Groups "Google Apps Domain Information and Management APIs" group.

To view this discussion on the web visit https://groups.google.com/d/msg/google-apps-mgmt-apis/-/sk27yn9QW0UJ.

To post to this group, send email to google-app...@googlegroups.com.
To unsubscribe from this group, send email to google-apps-mgmt...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/google-apps-mgmt-apis?hl=en.

[Scott]

I just submitted another audit export request.  It is pending...

Thank you.

[Claudio Cherubino]

Our logs show the export request is valid, please monitor its status and let us know if you eventually get an error.

Thanks

Claudio

On Thu, Jul 7, 2011 at 1:07 PM, Scott <sst...@hyattvoi.com> wrote:

I just submitted another audit export request.  It is pending...

Thank you.

--

You received this message because you are subscribed to the Google Groups "Google Apps Domain Information and Management APIs" group.

To view this discussion on the web visit https://groups.google.com/d/msg/google-apps-mgmt-apis/-/YZ853vCGwrYJ.

[Scott]

 Request ID: 26039522

  User: aconrad@<domain>

  Status: ERROR

  Request Date: 2011-07-07 20:06

  Requested By: ssteele@<domain>

  Requested Parts: FULL_MESSAGE

  Request Filter: None

  Include Deleted: true

Thanks!

[Michael Manoochehri]

Hi Scott,

Your code looks correct, but I have had no luck reproducing this error, and I don't have evidence that the API is malfunctioning. If possible, please try to run the same mailbox request using cUrl from the command line:

Create an GData XML file with your relative parameters called "mailboxDump.xml." See this page for an example of what the XML should look like, but something like this:

<atom:entry xmlns:atom='http://www.w3.org/2005/Atom' xmlns:apps='http://schemas.google.com/apps/2006'>
   <apps:property name='beginDate' value='2009-07-01 04:30'/>
   <apps:property name='endDate' value='2009-08-30 20:00'/>
   <apps:property name='includeDeleted' value='false'/>
   <apps:property name='searchQuery' value='in:chat'/>
   <apps:property name='packageContent' value='FULL_MESSAGE'/>
</atom:entry>

Then grab an Auth Token (it's the long string after "Auth=" - and save it for the next steps):

>> curl https://www.google.com/accounts/ClientLogin -d Email=(your admin email) -d Passwd=(your admin password) -d accountType=HOSTED -d service=apps

Then call the API using a raw cUrl request like so (replace variables with your info):

>> curl --silent --request POST --data "@mailboxDump.xml" --header "Content-Type:application/atom+xml" --header "Authorization: GoogleLogin auth=$AUTHTOKEN" "https://apps-apis.google.com/a/feeds/compliance/audit/mail/export/$DOMAIN/$USER"

Check the status of the request with:

>> curl --silent --request GET --header "Content-Type:application/atom+xml" --header "Authorization: GoogleLogin auth=$AUTHTOKEN" "https://apps-apis.google.com/a/feeds/compliance/audit/mail/export/$DOMAIN/$USER/$REQUESTID"

Also, if this method still produces an error message, please let us know how long it takes for the "PENDING" state to turn into an "ERROR" state.

- Michael

[Scott]

I submitted via curl on 7-20 at 2:18pm EDT.  I saw an ERROR status at 3:08pm.  Thanks.

[Scott]

Any more information on this would be greatly appreciated.  We are still experiencing an ERROR status with our export requests.  Thanks.

[Claudio Cherubino]

Hi Scott,

Sorry for the delay, the engineers are still investigating your issue.

They have found the entries corresponding to your failed requests in our logs and are now tracking down the root cause.

Thanks for your patience, we'll get in touch with you as soon as we have more details to share

Claudio

On Tue, Jul 26, 2011 at 6:37 AM, Scott <sst...@hyattvoi.com> wrote:

Any more information on this would be greatly appreciated.  We are still experiencing an ERROR status with our export requests.  Thanks.

--

You received this message because you are subscribed to the Google Groups "Google Apps Domain Information and Management APIs" group.

To view this discussion on the web visit https://groups.google.com/d/msg/google-apps-mgmt-apis/-/_1bG2PBIqxIJ.

[Scott]

Any further progress on this?  We have obviously been unable to export mailboxes and have reached our user limit for over two weeks.  Thank you.

[Claudio Cherubino]

Scott,

The engineers fixed the issue and the new code is going through our QA/release process before hitting production.

Unfortunately, I don't have an ETA for that yet.

Claudio

On Wed, Aug 3, 2011 at 7:11 AM, Scott <sst...@hyattvoi.com> wrote:

Any further progress on this?  We have obviously been unable to export mailboxes and have reached our user limit for over two weeks.  Thank you.

--

You received this message because you are subscribed to the Google Groups "Google Apps Domain Information and Management APIs" group.

To view this discussion on the web visit https://groups.google.com/d/msg/google-apps-mgmt-apis/-/nZUHJiaKwZUJ.

[Scott]

This is finally working again.  What was the cause of this?  Was our domain the only one affected?  Thanks.

[Claudio Cherubino]

Scott,

Glad to hear that, the engineers fixed a bug in our data storage backend.

You were the first (and only one so far) reporting this issue which shouldn't now affect anyone.

Thanks

Claudio

On Mon, Aug 8, 2011 at 11:52 AM, Scott <sst...@hyattvoi.com> wrote:

This is finally working again.  What was the cause of this?  Was our domain the only one affected?  Thanks.

--
You received this message because you are subscribed to the Google Groups "Google Apps Domain Information and Management APIs" group.

To view this discussion on the web visit https://groups.google.com/d/msg/google-apps-mgmt-apis/-/W5IiwGn9p44J.