Subject: b.1 IMAP Tests 27–31: mailboxes on james.healthit.gov are empty, request a refresh before our live test on 10/14

[Luiz Abreu]

Hello ETT team,

We have our (b)(1) live test with Drummond on Wednesday, 10/14, at 2:00 PM ET, receiving over SMTP-IMAP.

The mailboxes for IMAP Tests 27 to 31 on james.healthit.gov are empty (INBOX and every other folder): xdmmimetypes, multipleattachments, brokenrefstylesheet, invalidstylesheet, xdmbadxhtml, b1-inpatient, b2-ambulatory, b2-inpatient, b5-ambulatory, b5-inpatient, b9-ambulatory, b9-inpatient, negativetestingccds and negativetestingcareplan. Running the test in SITE only logs "Awaiting confirmation from proctor" and does not place any message in the mailboxes. Our system connects (STARTTLS), authenticates and reads normally: imaptesting has 7 messages and we read all of them.

1. Could you refresh these mailboxes before the morning of 10/14? We won't fetch from them before the test, so we don't consume the messages.
2. If someone empties a mailbox during the session, can the proctor request a refresh on the spot?
3. b1-ambulatory has 5 S/MIME messages (from met...@ett.healthit.gov, 04/09/2026), encrypted to a certificate from EMR Direct's sandbox CA, which is not ours. Is that expected for Test 31, or should this mailbox be refreshed as well?

Thank you!

[Luiz Abreu]

Hello ETT team,

Following up on our post from 10/8: we will run our (b)(1) certification live test with Drummond on Wednesday, 10/14. The negativetestingccds and negativetestingcareplan mailboxes are still empty, and Drummond requires the 33 negative test cases to be received over IMAP. The xdmmimetypes, multipleattachments, brokenrefsstylesheet, invalidstylesheet, xdmbadxhtml and b9-ambulatory mailboxes are also empty.

1. Could you refill these mailboxes?
2. These mailboxes are shared, so if one is emptied during our session, can the proctor request a refresh on the spot?

We have also raised this with the SITE team. Thank you!

[Brenda Millet]

Hi ETT Dev Team,

Could you please take a look at the issue reported below and advise on a resolution or anticipated timeline for a fix? The developer is currently waiting on this issue to be resolved so they can proceed with certification testing.

As this is impacting testing progress, any assistance in reviewing and prioritizing the issue would be greatly appreciated.

Thank you, 

Brenda Millet

Drummond Test Lab

[Ted Sanders]

We are seeing the same problem, testing (b)(1) receive with SMTP-IMAP, with our Drummond live test set for 29 October.

On 20 October our system connected to james.healthit.gov over STARTTLS, logged in, and read each mailbox normally:

- imaptesting: 7 messages, all read, including the two "Testing STARTTLS & PLAIN SASL AUTHENTICATION" messages. Its folders are INBOX, Archive, Drafts, Junk Email, Outbox, Sent, Sent Items, Spam and Trash. The FOLDER and folder2 folders that IMAP Test 21 reads do not exist, even after pressing Run.
- xdmmimetypes, multipleattachments, brokenrefstylesheet, invalidstylesheet, xdmbadxhtml and negativetestingccds: empty in every folder. xdmmimetypes was still empty after pressing Run on IMAP Test 27.
- b1-ambulatory: the same five messages from XXXXXX...@ett.healthit.gov dated 9 April 2026, subject "null". Each is S/MIME encrypted (enveloped-data) to a certificate issued by EMR Direct Developer Sandbox SubCA3, so no edge system other than that certificate's holder can open them.

Could the ETT team please refill these mailboxes and create FOLDER and folder2 on imaptesting, before 29 October if possible? As Luiz asked, is there a way for a proctor to request a refresh during a session if a shared mailbox is emptied by another vendor's test?

Thank you.

Ted Sanders, AITRCM+

[Sai Valluripalli]

This is done. Please try now.

Thank you,

Sai Valluripalli

--
You received this message because you are subscribed to the Google Groups "Edge Test Tool (ETT)" group.
To unsubscribe from this group and stop receiving emails from it, send an email to edge-test-too...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/edge-test-tool/b2f52943-9f6f-4a14-aa20-0a5a9ea80c45n%40googlegroups.com.

[Luiz Abreu]

Hello, thank you for refilling the mailboxes on Oct 21.

We checked the mailboxes read-only, without flagging or deleting anything. Three points:

1. In most mailboxes, only the first message has the header "Content-Type: multipart/mixed; boundary=...". The other messages arrive without it, so a mail reader sees them as plain text, with the C-CDA inside the body. Example: in negativetestingccds, message 1 (NT_Bad_MedicationSectionCode_r11_v2.xml) is correct, and message 2 (NT_Bad_PatientLastName_r1_v2.xml) arrives without a Content-Type. We will adjust our reader to read these messages as they are. For future refills, please send them with the full MIME headers.
2. b1-ambulatory (Test 31): it has only the 5 messages from Apr 9, 2026, encrypted for the EMR Direct Developer Sandbox certificate, so no other vendor can open them. Could you please refill it with the b.1 ambulatory sample C-CDAs (170.315_b1_toc_amb samples), unencrypted, the same way as b1-inpatient?
3. brokenrefstylesheet and invalidstylesheet (Test 29): they are still empty. Could you please refill them too?

When they arrive, we will check again.

Thanks,
Luiz

[Ted Sanders]

Hi Sai and team,

Thank you for refilling the mailboxes. We checked each account on james.healthit.gov this afternoon (22 October) over IMAP with STARTTLS and the published test login, read-only. Several are now loaded, and a few still look empty.

Now loaded:

• negativetestingccds@: 33 messages (IMAP 31, negative tests)
• xdmmimetypes@: 2 messages (IMAP 27)
• multipleattachments@: 2 messages (IMAP 28)
• xdmbadxhtml@: 1 message (IMAP 30)

Still empty or missing:

• imaptesting@ (IMAP 21): there is still no "FOLDER" or "folder2". The account's folders are INBOX, Archive, Drafts, Junk Email, Outbox, Sent, Sent Items, Spam and Trash, and a STATUS on either name returns "NO STATUS failed". INBOX has 7 messages, the same as on 20 October.
• brokenrefstylesheet@ (IMAP 29a): 0 messages.
• invalidstylesheet@ (IMAP 29b): 0 messages.
• b1-ambulatory@ (IMAP 31, b.1 ambulatory payloads): 5 messages. On 20 October this account held five messages from XXXXX...@ett.healthit.gov dated 9 April 2026, subject "null", each S/MIME-encrypted to an "EMR Direct Developer Sandbox SubCA3" certificate. An edge system can't decrypt those, so they don't look like the intended test content. We haven't confirmed whether today's five are the same messages. Could you check, and load the b.1 ambulatory payloads if they are?

Could the IMAP 21 folders, the two stylesheet accounts and b1-ambulatory@ be loaded as well? Our Drummond live test is on 29 October, so anything you can do before then would help a great deal.

One more thing: because these accounts are shared by every vendor, a system that deletes mail after reading it could empty them again before our session. If there's a way to keep them filled through the 29th, or to give us our own copies, we'd be glad of it.

[Ted Sanders]

Sai,

Have you been an able to update this server?

[Sai Valluripalli]

Will update it today.

Thank you,

Sai Valluripalli

To view this discussion visit https://groups.google.com/d/msgid/edge-test-tool/edfe60dc-6100-4374-babf-47ad2a6ce317n%40googlegroups.com.

[Sai Valluripalli]

This is done. Please let us know if there is anything else missing.

Thank you,

Sai Valluripalli

[Luiz Fernando Abreu]

Hi Sai, thanks for today's refill. We still need 3 fixes:

1. Test 27: octect.zip (xdmmimetypes #2) arrives as raw binary with no Content-Transfer-Encoding, and it is corrupted (every \r and \n became \r\n), so it does not open. Cause: LoadEmptyInboxccda.java reuses the same MimeMessage/MimeBodyPart in the loop and sends with transport.sendMessage without saveChanges(), so from the 2nd message on they go out without Content-Type and Content-Transfer-Encoding. It should also be sent as application/octet-stream, not application/zip.

2. Test 28: multipleattachments has 2 messages with 1 attachment each. The test calls for one message with several attachments.

3. Test 31: b1-ambulatory and b1-inpatient received old versions of the samples (v10/v8). The current ones in the ONC repository are v13/v11/v9 (amb) and v12/v9 (inp), and the old ones raise validation errors in positive samples.

Could you refill with these fixes? We will test the same day. Thanks!