Follow the Crowd blog post draft
Yotam Gingold
Paul André
<image.png>
Kurt Luther
As much as I like the name "StoryOracle" it does suggest that our
approach is constrained to storytelling, and not other creative
domains like visual design. So I prefer a title which avoids the name
for now.
Regarding "As questioning proceeds, a consistent story is revealed."
Could this be rephrased to emphasize the creative effort/agency of the
guesser, e.g. "As questioning proceeds, the guesser works to generate
an internally consistent mental model of the creative artifact."
I agree that a few screenshots of examples would be most compelling. I
just uploaded our final presentation to the shared Google Drive, which
contains many good candidate images.
--
Kurt Luther
http://www.kurtluther.com/
Yotam Gingold
Kurt Luther
Yotam Gingold
CrowdCamp Report: DesignOracle: Exploring a Creative Design Space with a Crowd of Non-Experts
For an unconstrained design problem like writing a fiction story or designing a poster,
can a crowd of non-experts be shepherded to generate a diverse collection of high quality ideas? Can the crowd also generate the actual stories or posters? With the goal of building crowd-powered creativity support tools, a group of us, Paul André, Robin N. Brewer, Krzysztof Gajos, Yotam Gingold, Kurt Luther, Pao Siangliulue, and Kathleen Tuite, set out to answer these questions. We based our approach on a technique described by Keith Johnstone in his book Impro: Storytelling and the Theatre for extracting creativity from people who believe themselves to be uncreative. An uncreative person is told that a story is already prepared and he or she has merely to guess it via yes or no questions. Unbeknown to the guesser, there is no story; guesses are met with a yes or no response, essentially randomly. For example:
- Is it about CSCW? Yes
- Is it about CrowdCamp? No
- Is it about a bitter rivalry? Yes
- …
As questioning proceeds, a consistent story is revealed, entirely due to the guesser generating and then externalizing an internally consistent mental model of a story (or poster, etc.) that justifies the given answers.
To evaluate the potential of this “StoryOracle” approach, we ran a series of experiments on Amazon Mechanical Turk:
- We extracted dozens of surprising and creative stories and poster designs using the technique.
- We explored the design space in a directed manner by generating variations on well-liked stories. Every question and yes or no answer provides a possible branch-point. To branch, we selected an important “pivot” question and showed all questions and answers up to the pivot, followed by the pivot question and the opposite answer, to a set of new participants with instructions to continue guessing the story. For example:
- We converted question-based stories into “normal” stories. For example:
Jack is a scientist who has dedicated his life to discovering how to generate energy using fusion power because he believes it would benefit humanity. Eventually he discovers how to do it and tells his wife, Jane, the good news. Jane is not aware that this is a secret and talk about it with Carl (to whom she was in love before meeting Jack). Carl tries to steal the secret from Jack but Jane fought with him and is able to impede him.
However, Jack discovers that Jane told Carl about the secret and they have a fight because of it. Eventually, Carl, who is angry with both of them, decides to kill Jack and Jane. He manages to kill the couple but when he is about to steal Jack’s secret, the power fusion discovery is released to the public through the internet.
Thus, all the world is able to produce energy using Jack’s discovery and eventually his dream of providing a better quality of life to everyone comes true. - We evaluated stories’ quality.
- We devised domain-specific prompts for questioners, such as the setting, theme, and characters in a story.
Taken together, in the two days of CrowdCamp we managed to build the foundation for a crowd-powered tool to explore a creative design space, in an undirected or directed manner, and generate a variety of high quality artifacts.
Robin
Robin
___________________________________
ROBIN N. BREWER
Human-Centered Computing
University of Maryland, College Park
