ETT Tool - Message Tracking - Not working

120 views
Skip to first unread message

Greg Gurr

unread,
Apr 22, 2021, 1:04:09 PM4/22/21
to Edge Test Tool (ETT)
I am trying to perform the test with the ETT tool on the "Message Tracking" tab, for my system "As the Receiver".  I enter the Direct email address of our system and click the "RUN" buttons on the tests to the left.  I never see an inbound email coming to our system from this "Message Tracking" test.  

How do I get this test to send me a Direct message?  What information on the left hand side does it need?  I entered our "Vender Direct Email Address" and that was all.  The other fields I am not sure what they are asking for or if they are needed.

If this test worked from anyone else, please tell me what you filled out in the "Default Profile" fields and what other tricks you did to get this to work.

Thanks

Sandeep Savarala

unread,
Apr 22, 2021, 1:43:11 PM4/22/21
to Greg Gurr, Edge Test Tool (ETT)
Can you please specify the test case number?

--
You received this message because you are subscribed to the Google Groups "Edge Test Tool (ETT)" group.
To unsubscribe from this group and stop receiving emails from it, send an email to edge-test-too...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/edge-test-tool/ba6f5396-d116-4909-b0c6-86e99c510762n%40googlegroups.com.

Greg Gurr

unread,
Apr 22, 2021, 3:50:31 PM4/22/21
to Edge Test Tool (ETT)
The Direct Certification case I am testing is: "6.9.4.1_a".   This is for the "receiving test".

Greg Gurr

unread,
Apr 22, 2021, 3:51:18 PM4/22/21
to Edge Test Tool (ETT)
Forgot to add the test text:
"- [Inbound] - Screenshots of each of the corresponding tests indicating success produced by sending from the 2015 Edition NIST Edge Testing Tool (https://ett.healthit.gov/ett/#/hisp/mu2) ("Your System as: Receiver") to the applicant HISP and performed within the past 60 days (required)."

Sandeep Savarala

unread,
Apr 22, 2021, 3:52:18 PM4/22/21
to Greg Gurr, Edge Test Tool (ETT)
What is the test case number you see in the tool?



On Apr 22, 2021, at 3:50 PM, Greg Gurr <ggu...@gmail.com> wrote:

The Direct Certification case I am testing is: "6.9.4.1_a".   This is for the "receiving test".

Greg Gurr

unread,
Apr 22, 2021, 3:54:11 PM4/22/21
to Edge Test Tool (ETT)
Sorry I misunderstood.  Here is the test case tool number:  "SMTP MT Test 41 (Unable to deliver)".

Sandeep Savarala

unread,
Apr 22, 2021, 3:59:59 PM4/22/21
to Greg Gurr, Edge Test Tool (ETT)

Did you pass 39 and 40? You would run 41 in the same way as 39 and 40. But for 41 you would enter a invalid address in Vendor Direct Email Address.

On Apr 22, 2021, at 3:54 PM, Greg Gurr <ggu...@gmail.com> wrote:

Sorry I misunderstood.  Here is the test case tool number:  "SMTP MT Test 41 (Unable to deliver)".

Greg Gurr

unread,
Apr 22, 2021, 4:13:46 PM4/22/21
to Edge Test Tool (ETT)
The text for this test is below.

"Verifies that when the system successfully validates security and trust, but cannot deliver the message to its final destination, the system generates an MDN failed or a failure DSN. ETT (as Sending HISP) sends a well-formed message to a destination address. The system decrypts and trust validates the message, returning a Processed MDN. The system is unable to deliver the message (mail box full, unavailable, mailbox does not exist) and returns either an MDN failed or a failure Delivery Status Notification. The selection of a file is optional, if the system requires clinical information with the message."

I believe what it wants is the Testing Tool sends the Direct email to our HISP "valid" email address.  In our receiving HISP,  we decrypt the message etc. and acknowledge we got the message and send back an MDN.  After that, our HISP system is unable to deliver the message to the final destination for whatever reason.  Our HISP then sends back a failed MDN or failed DSN message.
The problem is that the ETT Tool never sends a email to our HISP.

Greg Gurr

unread,
Apr 22, 2021, 4:26:08 PM4/22/21
to Edge Test Tool (ETT)
I even uploaded our HISP certificate, but I still don't see any emails from the ETT tool to our HISP.  The log in the ETT tool says the email was successfully delievered.  Can you tell me the "from" email address that the ETT Tool is using to send our HISP the message?  Maybe our company needs to white list it or something.

Sandeep Savarala

unread,
Apr 22, 2021, 4:31:37 PM4/22/21
to Greg Gurr, Edge Test Tool (ETT)
Asking again, did you pass 39 and 40? 

The email will be coming from hisp-t...@direct.ett.healthit.gov



On Apr 22, 2021, at 4:26 PM, Greg Gurr <ggu...@gmail.com> wrote:

I even uploaded our HISP certificate, but I still don't see any emails from the ETT tool to our HISP.  The log in the ETT tool says the email was successfully delievered.  Can you tell me the "from" email address that the ETT Tool is using to send our HISP the message?  Maybe our company needs to white list it or something.

Greg Gurr

unread,
Apr 22, 2021, 4:59:37 PM4/22/21
to Edge Test Tool (ETT)
Yes, I passed tests 39 and 40 three days ago, however they did not work the first time. I had to try multiple times before I saw the green check mark.
However I recently tried running tests 39 and 40 and they fail now too with not sending us any emails.  Our direct address is: "direc...@direct.intermountainhealthcare.org".  Can you see if you are blocking it somehow or not trusting it?

To unsubscribe from this group and stop receiving emails from it, send an email to edge-test-tool+unsubscribe@googlegroups.com.

Greg Gurr

unread,
Apr 23, 2021, 11:31:39 AM4/23/21
to Edge Test Tool (ETT)
Sandeep,

On the screen for SMTP Tests 39, 40 and 41 I have a question on the "input form" to the left.  When I perform the "Your System as a Receiver",  I have questions on these input fields:
     - Vendor Hostname/IP    (what do you expect here and why is it  needed?  You should only need our direct email address)
     - Vendor UserName  (user name for what?)
     - Vendor Password   (password for what?)

Are these fields "required" to have the SMTP test 39, 40 and 41 be successful?

Thanks


Sandeep Savarala

unread,
Apr 23, 2021, 11:35:10 AM4/23/21
to Greg Gurr, Edge Test Tool (ETT)
These are not required for these cases.



On Apr 23, 2021, at 11:31 AM, Greg Gurr <ggu...@gmail.com> wrote:

Sandeep,

Greg Gurr

unread,
Apr 23, 2021, 11:48:02 AM4/23/21
to Edge Test Tool (ETT)
Sandeep,

Thanks for your response.  I reran tests SMTP 39 and 40.  I see the messages come into our system and the tests pass.  However, when I run SMTP Test 41, I still do not see any Direct email coming into out system.  Our network guys verified that when I ran the test, nothing appears on our mail server logs.  Can  you please check on your side to see what is happening with SMTP test 41?  I am at a loss as to why this one test is not sending us a email message.  Our Direct email address is: direc...@direct.intermountainhealthcare.org

Sandeep Savarala

unread,
Apr 23, 2021, 11:50:27 AM4/23/21
to Greg Gurr, Edge Test Tool (ETT)
You need to enter a bad address for this case. 


This test expects a processed MDN and a Failure MDN (or) DSN.

Greg Gurr

unread,
Apr 23, 2021, 12:38:00 PM4/23/21
to Edge Test Tool (ETT)
Sandeep,

I tried your suggesition, entering a bad address (badad...@direct.intermountainhealthcare.org) and I still don't see any email  coming into our system.  Any other ideas on why the ETT tool is not sending us a email message for SMTP Test 41?

Greg Gurr

unread,
Apr 26, 2021, 7:21:37 PM4/26/21
to Edge Test Tool (ETT)
Sandeep,

Does test SMTP MT Test 41 use the same "from" address as tests SMTP 39 and 40?

Sandeep Savarala

unread,
Apr 26, 2021, 7:29:56 PM4/26/21
to Greg Gurr, Edge Test Tool (ETT)
Yes.


On Apr 26, 2021, at 7:22 PM, Greg Gurr <ggu...@gmail.com> wrote:

Sandeep,

Greg Gurr

unread,
Apr 26, 2021, 7:39:28 PM4/26/21
to Edge Test Tool (ETT)
Sandeep,

I am still not receiving any inbound email from the ETT tool for test SMTP 41.  Again, tests SMTP 39 and 40 pass.  Can you help me trouble shoot this? or look at your log file on your end to see if this test is blocking the email?

Sandeep Savarala

unread,
Apr 27, 2021, 9:54:03 AM4/27/21
to Greg Gurr, Edge Test Tool (ETT)
I don't see anything in the logs. Your system should generate a processed MDN as the direct system trusts the ETT tool. And your system should also generate a Failure MDN or DSN as the address supplied is non-existent/bad. 

You will pass this test if your system can generate both a processed MDN and a Failure MDN/DSN.

Greg Gurr

unread,
Apr 27, 2021, 5:19:44 PM4/27/21
to Edge Test Tool (ETT)
Sandeep,
Today I am running the SMTP 41 test.  I finally see the message coming from the ETT tool to our system.  I see our HISP processing the message, sending a DSN.  Then we simulate a delivery failure and I see our HSIP sending a Failed DSN.  However, when I go back to the ETT test tool and click on the "Check MDN' button, it does not show a green check mark.  The log on the ETT tool says it cannot find a DSN with a specific message id.  

Can you check your logs and see if there are any issues with DSN's coming from our Intermountain HISP direct address: "test-di...@direct-test.intermountainhealthcare.org" ?

Sandeep Savarala

unread,
Apr 27, 2021, 5:34:10 PM4/27/21
to Greg Gurr, Edge Test Tool (ETT)
Are you sending both Processed MDN and Failure DSN?

The test will not pass if it can’t find both.

Greg Gurr

unread,
Apr 27, 2021, 5:48:21 PM4/27/21
to Edge Test Tool (ETT)
Yes, my HISP logs show both are being sent successfully

Sandeep Savarala

unread,
Apr 28, 2021, 9:19:23 AM4/28/21
to Greg Gurr, Edge Test Tool (ETT)
I only see processed MDNs in the tools inbox. There are no failed MDN/DSNs. 

What did you do differently on your end to send back processed MDNs? There are no changes on the tool's end.

Greg Gurr

unread,
Apr 28, 2021, 12:48:58 PM4/28/21
to Edge Test Tool (ETT)
I did not do anything different, which is strange because the messages finally started coming into our HISP from the ETT test tool.  Our HISP logs show both the process MDN and the failed DSN being successfully sent to the ETT.
Reply all
Reply to author
Forward
0 new messages