401 Unauthorized for all requests for AllCertificateRecordsCSVFormatv4

[Rob Stradling]

Since the early hours of this morning I've been getting a 401 Unauthorized response to every request for https://ccadb.my.salesforce-sites.com/ccadb/AllCertificateRecordsCSVFormatv4.

Since this is intended to be a publicly accessible CSV report, am I right that this current behaviour is not intentional?

[Wayne]

Hi Rob,

Saved me starting an email thread as I was just about to ask the same question. This also applies to v3 (obsolete).

- Wayne

[Wayne]

That's it working now for AllCertificateRecordsCSVFormatv4.

- Wayne

[Ben Wilson]

Hi Rob,

Thanks for flagging this.

The error was because the report now exceeds Salesforce’s 10,000-record limit for a single query.

As a temporary mitigation, we applied a filter, which trimmed the result set down to 9,991 records and restored functionality. However, we expect the issue to recur as the CCADB dataset continues to grow. To address this, we are looking at splitting the query into multiple result sets, and we’ll provide an update once we’ve confirmed whether this works. 

Separately, we are also tracking concerns around the ~12 MB file size limit for these reports. This is being addressed as part of a broader redesign (V6), which is currently in development. 

We appreciate your patience while we work through these constraints, and please let us know if you encounter any other access issues.

Thanks again,

Ben

[Ben Wilson]

Greetings again,

We’re aware that the CCADB “All Certificates” CSV report (V4) became unavailable again with a 401 “unauthorized” error due to the 10,000 record limit. We apologize for the disruption.

As an additional mitigation, we have split the dataset into two separate reports, which together can be used to reconstruct the full V4 output:

• V4a: https://ccadb.my.salesforce-sites.com/ccadb/AllCertificateRecordsCSVFormatV4a
  (Excludes records for OLD CA certificates that expired more than five years ago)
• V4b: https://ccadb.my.salesforce-sites.com/ccadb/AllCertificateRecordsCSVFormatV4b
  (Includes records for OLD CA certificates that expired more than five years ago)

We'll quickly make these URLs available on the CCADB resources page.

This is an interim solution. We are actively working on a more robust long-term fix for V4, which will also be applied to V5, and then with V6 we are migrating to an API-based solution. Our goal is to restore delivery of a complete, single report early next week. Then, the REST API of v6 will provide more reliable and flexible access to this dataset.

We appreciate your patience while we work through these constraints. Please let us know if you encounter any additional access issues.

Thanks,

Ben

[Ben Wilson]

Hi All,

We've refined and optimized the AllCertificateRecordsCSVFormatv4 report and can now offer it as a single file once again. We'll leave the workaround (i.e., 4a and 4b) posted on ccadb.org/resources for now.

We originally planned to host the new AllCertificateRecordsCSVFormatv5 report on Monday (as described here), but after reviewing the v4 issues, we decided to create v5 immediately and apply the same recent optimizations. v5 can be found here: https://ccadb.my.salesforce-sites.com/ccadb/AllCertificateRecordsCSVFormatV5, and it will soon appear on the ccadb.org/resources page. 

We're still open to feedback and are continuing to work on a REST API version of this information. 

Thank you
Ben