Phon tier resolved with blind scoring

22 views
Skip to first unread message

Jonathan Preston

unread,
Feb 28, 2021, 1:34:42 PM2/28/21
to Phon

Hi Yvan,

 

I’m looking to create a tier that is blinded in Blind Transcription mode and that is resolved when the third transcriber goes to resolve the existing 2 transcribers' scores. Essentially, it would be another tier similar to the IPA Actual, except we want to add a numerical score (0, 1, 2). 

The process would be something like: Create a new tier call “3-way score”, Transcriber 1 transcribers the IPA Target and Actual and also enters her score of 0 in the 3-way score tier, then Transcriber 2 transcribes in Blind mode the IPA Target and Actual and enters his score of 1 in the “3-way score” tier, then Transcriber 3 resolves the IPA Target, IPA Actual, and the score in the 3-way score tier.

I know we can create tiers and hide them, but I don’t see a way to keep separate data in those tiers during blind transcription mode.  For example, the Notes tier will show any notes from Transcriber 1 when Transcriber 2 opens up the file, but I’d like to create another tier where the data are entered separately and then resolved. Is this possible?

 

Thanks,

Jon

 

ghedlund

unread,
Mar 1, 2021, 5:56:14 AM3/1/21
to Phon
Hello Jon,

I think this is a great idea, but not currently possible in Phon. The only tiers which are included in blind mode are the IPA Target/Actual tiers.  I have created a new ticket (https://github.com/phon-ca/phon/issues/146) for this improvement, but I honestly cannot give you any timeline for the implementation.

Regards,

Greg

Yvan Rose

unread,
Mar 1, 2021, 2:26:27 PM3/1/21
to ph...@googlegroups.com
Hi Jon,

Thank you for your useful suggestion, and Greg for ticketing it already. 

Key to this and our blind system in general, is to decide what information should be 
  • blind with validation - current IPA Target and Actual tiers
  • blind without validation - ??
  • not blind and accessible through the blind interface -- all tiers except IPAs
If I follow your request, you'd want an additional tier to be blind but then directly accessible to the remainder of the interface; else how do you want to access/process these data. Do you just want it visible as an additional prop during validation, or is there a use for it in the database afterwards?

Currently, validation merely maps the contents of the selected candidate transcription into our default IPA tiers within the Session Editor, which we can then adjust further (directly edit). I doubt you'd need this for the score tiers, but maybe I'm not getting something. Maybe you could tell us a bit more about these scores?


Thank you,
Yvan



--
You received this message because you are subscribed to the Google Groups "Phon" group.
To unsubscribe from this group and stop receiving emails from it, send an email to phon+uns...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/phon/417fdb3a-2844-4511-a41e-43182fcd0c80n%40googlegroups.com.

Jonathan Preston

unread,
Mar 3, 2021, 10:06:23 AM3/3/21
to ph...@googlegroups.com
HI Yvan, 

What I'm looking for is another "Blind with validation" that is not just the IPA Target and IPA Actual. I want each transcriber to be able to enter a number (in this case, 0, 1, 2), but not see the number that others have entered. (I was originally planning to use the "Notes" tier or to create a new tier, but I realized that those tiers aren't blinded).  When the third transcriber goes in to resolve and has visible the results from Transcriber 1 and 2, I was hoping that person could resolve three tiers (IPA Target, IPA Actual, and 3-way score). 
As I've thought through this, I do think I can find a workaround in the current system with some detailed instructions to my transcribers  (ie, give instructions to the first two transcribers to hide the scoring rows from the other transcribers, then the person who resolves these will unhide all transcribers' tiers to see what they entered, and resolve).  Therefore, I don't think this is a high priority for you - it would just be a helpful feature for my purposes (I'm not sure how many others would want additional tiers that are hidden in Blind transcription mode).

I hope you and your family are doing well!
Jon
Jon

You received this message because you are subscribed to a topic in the Google Groups "Phon" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/phon/pktxvFl8CIc/unsubscribe.
To unsubscribe from this group and all its topics, send an email to phon+uns...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/phon/C848831C-3880-430E-8DE9-BF0AFBDC9E18%40gmail.com.
Reply all
Reply to author
Forward
0 new messages