Open-ended questions

2,075 views
Skip to first unread message

Anthony Schmidt

unread,
Aug 5, 2013, 8:11:50 PM8/5/13
to flubaroo-dis...@googlegroups.com
First, I'd like to say that this is an awesome App Script! I had been making quizzes and grading them using different excel/Google Sheets formulas, but this is much quicker. It works great for objective questions. I was wondering, however, how it could be used for more open ended questions, say short answer-type questions? Is it possible to carry student answers over to the Grades sheet and then hand-grade them, but still have them included in the Flubaroo email, scoring? I could add the cells and formula myself after initial grading, but would Flubaroo see them for emailing?

Thanks,

Anthony

Dave Abouav

unread,
Aug 8, 2013, 3:54:14 PM8/8/13
to flubaroo-dis...@googlegroups.com

This is coming in one of the next versions. :) Maybe 6 months out.

Thanks for your feedback!

Dave

--
You received this message because you are subscribed to the Google Groups "Flubaroo Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to flubaroo-discussio...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

Joe Schmidt

unread,
Aug 8, 2013, 5:15:37 PM8/8/13
to flubaroo-dis...@googlegroups.com
This intrigued me.  I'm not a teacher but if a pass / fail on an open ended question is good enough then I think this will work.  

Create a paragraph question to contain the open ended response.  Make the next question a space to hold the grade of the open ended question.  Tell the student to skip the grade question.  In your answer row put a code like "passed" as the correct answer.  Continue with as many questions as you would like.

Enter two questions for each open ended question.  

Before you use flubaroo to grade the responses edit the responses and type "passed" in the grade cell for each open ended question.

Tell Flubaroo that the open ended questions are to identify the person and give the grade column whatever score you want.



It has been fifty years since I got out of school and I seem to remember that teachers liked to vary the points given on open ended questions.  My example only works if you are willing to give an all or nothing to the open ended question.

Maybe some teachers can give Dave some feedback.  Do open ended questions require the ability to assign a varying point scale?

For the record, I'm a retired IT person.



Joe Schmidt

God Loves Us All

Trevor Beck

unread,
Aug 9, 2013, 1:06:37 PM8/9/13
to flubaroo-dis...@googlegroups.com
Brilliant suggestion!


On Thursday, August 8, 2013 3:15:37 PM UTC-6, glua wrote:
This intrigued me.  I'm not a teacher but if a pass / fail on an open ended question is good enough then I think this will work.  

Create a paragraph question to contain the open ended response.  Make the next question a space to hold the grade of the open ended question.  Tell the student to skip the grade question.  In your answer row put a code like "passed" as the correct answer.  Continue with as many questions as you would like.

Enter two questions for each open ended question.  

Before you use flubaroo to grade the responses edit the responses and type "passed" in the grade cell for each open ended question.

Tell Flubaroo that the open ended questions are to identify the person and give the grade column whatever score you want.



It has been fifty years since I got out of school and I seem to remember that teachers liked to vary the points given on open ended questions.  My example only works if you are willing to give an all or nothing to the open ended question.

Maybe some teachers can give Dave some feedback.  Do open ended questions require the ability to assign a varying point scale?

For the record, I'm a retired IT person.



Joe Schmidt

God Loves Us All


On Thu, Aug 8, 2013 at 3:54 PM, Dave Abouav <da...@edcode.org> wrote:

This is coming in one of the next versions. :) Maybe 6 months out.

Thanks for your feedback!

Dave

On Aug 5, 2013 5:11 PM, "Anthony Schmidt" <anthony...@yahoo.com> wrote:
First, I'd like to say that this is an awesome App Script! I had been making quizzes and grading them using different excel/Google Sheets formulas, but this is much quicker. It works great for objective questions. I was wondering, however, how it could be used for more open ended questions, say short answer-type questions? Is it possible to carry student answers over to the Grades sheet and then hand-grade them, but still have them included in the Flubaroo email, scoring? I could add the cells and formula myself after initial grading, but would Flubaroo see them for emailing?

Thanks,

Anthony

--
You received this message because you are subscribed to the Google Groups "Flubaroo Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to flubaroo-discussion-forum+unsub...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.
 
 

--
You received this message because you are subscribed to the Google Groups "Flubaroo Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to flubaroo-discussion-forum+unsub...@googlegroups.com.

Joe Schmidt

unread,
Aug 9, 2013, 5:23:28 PM8/9/13
to flubaroo-dis...@googlegroups.com
Trevor,

Thanks, but brilliant might be an over statement.  I just have fun finding creative ways to use other people's work.

http://www.edcode.org/kb/flubaroo if you want to see some of the history behind Flugaroo. 

Using a Google Hangout I gave a talk on Cloud computing to a 13 year old who is interested in programming.  I showed him the Flubaroo script that does the grading part of the work.  The wonderful thing is that Flubaroo is available for free.

Thanks to all that made Flubaroo happen and continue to improve it.

Joe Schmidt

God Loves Us All


GLUA

unread,
Aug 10, 2013, 10:38:11 AM8/10/13
to flubaroo-dis...@googlegroups.com
I did a little more testing on my idea for open ended questions and when grading in Flubaroo it is better to SKIP the question rather than call it an IDENTIFIER. It shows up better in the email to the student.  It shows as Not Graded but the grade question appears directly below.  Some creative person should be able to explain to the students what to expect.

This email contains your grade for Copy of test quiz (Responses). Do not reply to this email.

Your grade (points): 2 / 2  



Below is a message from your instructor, sent to the entire class:

This was with open ended skipped rather than identifier.

Summary of your submission:

Nametest person one
Email address
Submission TimeThu Aug 08 2013 16:32:58 GMT-0400 (EDT)

Not Graded

This is an open question.

Your Answer: This should get a good grade. I think Flubaroo is great and should be used by all teachers.



Correct
+1 point(s)

Grade for previous question

Your Answer: Passed



Correct
+1 point(s)

Will this work?

Your Answer: Yes



On Friday, August 9, 2013 5:23:28 PM UTC-4, glua wrote:
Trevor,

Thanks, but brilliant might be an over statement.  I just have fun finding creative ways to use other people's work.

http://www.edcode.org/kb/flubaroo if you want to see some of the history behind Flugaroo. 

Using a Google Hangout I gave a talk on Cloud computing to a 13 year old who is interested in programming.  I showed him the Flubaroo script that does the grading part of the work.  The wonderful thing is that Flubaroo is available for free.

Thanks to all that made Flubaroo happen and continue to improve it.

Joe Schmidt

God Loves Us All

Dave Abouav

unread,
Aug 10, 2013, 11:52:56 PM8/10/13
to flubaroo-dis...@googlegroups.com
Yes, skipping the question makes more sense than making it as Identifies Student.

Dave


--
You received this message because you are subscribed to the Google Groups "Flubaroo Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to flubaroo-discussio...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.
 
 



--
edCode.org: A community of teachers and developers creating free, open-source tools for education.

Questions about Flubaroo? Checkout the FAQs page: flubaroo.com/faqs.
Want to suggest a feature or improvement? Do so here.

GLUA

unread,
Aug 18, 2013, 7:25:12 AM8/18/13
to flubaroo-dis...@googlegroups.com
I think this is an improvement.  Make the question that will contain the answer a "multiple choice" question with only one choice of "Skip".

Use the "Get pre-filled URL" option available under Responses and select the Skip as the answer.  Use this URL to share the form.

The user will not be able to change this and you overwrite it when you grade the question.  Test form with Skip  .





KT

unread,
Aug 19, 2013, 11:26:07 AM8/19/13
to flubaroo-dis...@googlegroups.com
Hi Guys,
I've enjoyed watching the thread. I came up with a similar solution back in this thread:


I place my "placeholder" questions in front of the essay (my word for open-ended) question. Originally, I would just have the answer as "yes" or "no" and then would place the same word in the students field for whether their essay response was right or wrong. Now, after realizing how easy copy/paste is (one of those DUH moments), I instead put, "The following answer is correct." My "holding" question is: 
"Please skip this question, it will be used in grading the following essay/written question." As already mentioned, it's a multiple choice question with no selectable answers.

Then, I have an automated text replacement macro that I run when sending out the grades that says something about gray rows indicate an essay question, if the preceding row is green, your answer was correct, red, it was judged incorrect.

It works pretty well, but I'm excited to see what Dave has for this. 

Also, Dave, since I know you're keeping up on these... I would love for a way to have it memorize my "grading" settings. Right now, it takes a few minutes to go through and "Skip Grading" on 10 questions, and if I miss one, I have to go back through the whole thing again.

GLUA

unread,
Aug 19, 2013, 1:37:03 PM8/19/13
to flubaroo-dis...@googlegroups.com
KT,

Thanks for sharing that your solution works.  I wasn't following the forum back then but I'm happy that someone had a similar idea. And actually used it!

I really really wasn't trying to copy your idea.  You must be smart because I have heard that great minds think alike!

It will be interesting to see Dave's solution.  

KT

unread,
Aug 19, 2013, 10:00:22 PM8/19/13
to flubaroo-dis...@googlegroups.com
No worries Joe. I actually didn't chime in earlier as I wanted to see what ideas were presented and how, what I was doing, could be improved. Having another mind working on a creative solution is always a good thing. Sometimes when you're working through something, seeing how someone else is doing it can kill creativity. 

I posted now, since it's no longer just a theory and idea for me - but rather ingrained in my workflow, in hopes it's helpful to OP. 

I agree, I'm not sure how Dave will handle it but I'm looking forward to it. V3 had some great new features that I'm enjoying right now. 

Trevor Beck

unread,
Aug 20, 2013, 2:20:42 PM8/20/13
to flubaroo-dis...@googlegroups.com
How would you handle the question if for partial marks? Flubaroo lets me assign marks to the question and if they match my answer, assigns the full amount. But what if they are only partly right and I want to assign part marks? Changing it in the Grades sheet created by Flubaroo doesn't auto update.

Thoughts?

BTW, anyone interested in tackling this some evening in a Google Hangout for fun?
> --
> You received this message because you are subscribed to a topic in the Google Groups "Flubaroo Discussion Forum" group.
> To unsubscribe from this topic, visit https://groups.google.com/d/topic/flubaroo-discussion-forum/MlPJP7W0ZlI/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to flubaroo-discussio...@googlegroups.com.

> For more options, visit https://groups.google.com/groups/opt_out.
>

--
Trevor Beck

When life hands you lemons, ask for tequila and salt.

GLUA

unread,
Aug 20, 2013, 6:53:54 PM8/20/13
to flubaroo-dis...@googlegroups.com
Trevor,

You are proving that teachers have not changed in the 50 plus year since I was in school.  Open ended questions require the option for variable grading to make teachers completely happy.  An Apple won't due!

I don't know how to trick Flubaroo at this time.

What will be needed is:
  • Something to tell it this question needs to be treated differently than comparing to an answer row.
  • It seems that it needs to know what the maximum score is for the open ended question.
  • What the score is from 0 to the maximum score for each respondent.

It will be interesting to see how Dave will handle that.  He may already have a solution in mind.  It for sure adds a new level of complexity.

I wouldn't mind doing a Hangout but I don't know the best way to invite people or what time is best.  I know there are communities in G+ and I don't know if a community for Flubaroo would help the process.  For lack of anything better if you see me online, invite me and I will tell you if that is a good time or not.

Trevor Beck

unread,
Aug 21, 2013, 10:56:18 AM8/21/13
to flubaroo-dis...@googlegroups.com
If you have a lot of questions that you need to mark as Skip Grading, you could put an underscore before the question - it's subtle, but makes it easier to spot:

_Where did John go to school?



On Monday, August 19, 2013, KT <maxw...@gmail.com> wrote:
Fubaroo-3.png

GLUA

unread,
Aug 23, 2013, 6:42:14 PM8/23/13
to flubaroo-dis...@googlegroups.com
OK,  This works but some might not like the extra questions. This allows variable scores for an open ended question.  The grades can be 0 ,25%,50%,75% or 100% depending on how many of the result questions you give the correct answer.  I gave each open ended grade one point for a total of four and the last question four so each question is worth 50% of the total grade.  I were grading this I would copy into all the students four 'Y's and then remove what was needed to lower the score as needed.  That assumes that I was a great teacher and expected everyone to get a 100 on the open ended question.

If someone wants to take the quiz I will grade your answer.  Maybe you should include in the open ended question the grade you think you should get and I will assign that grade. It has to be zero or a multiple of 25%.   I'll check on Monday and regrade / email any responses.

See the forms and results below.

This idea might be a little soggy as I thought of it in the shower this morning.  LOL


On Tuesday, August 20, 2013 2:20:42 PM UTC-4, Trevor Beck wrote:

Trevor Beck

unread,
Aug 25, 2013, 8:21:40 PM8/25/13
to flubaroo-dis...@googlegroups.com
Yes, I thought of doing that as well. Unfortunately, if you have a number of open ended questions, it becomes a bit long on scrolling. However, you could put the open ended questions on a separate page so it doesn't look so unwieldy. 

Sent from my iPad

GLUA

unread,
Aug 25, 2013, 9:22:45 PM8/25/13
to flubaroo-dis...@googlegroups.com
Trevor,

I think the trick is to make the column with the open ended question wider so that it is easier to read.  You can also make the grade columns narrower so that they fit on one screen.  You can freeze the columns to the right of the students name so the name and the question are both visible.  I don't know if a teacher grades differently depending on the student.  See the example results in the previous message.  I know this isn't the best solution but I think it will work until Dave can do his magic.  

I also remember that Open-ended questions can have multiple qualities.  A student could get  a grade for the correct answer, grammar, spelling and penmanship.  I'm kidding on the penmanship but I think I always lost points because of penmanship.  You should see my checks but they always get cashed.  

I'm not sure I understand what you mean by a separate page. Could you create an example?  I'm hoping that our experimentation will help Dave know what folks want.  I have never been on the teacher side of the fence. 
To unsubscribe from this group and all its topics, send an email to flubaroo-discussion-forum+unsub...@googlegroups.com.

Dave Abouav

unread,
Aug 27, 2013, 4:58:38 PM8/27/13
to flubaroo-dis...@googlegroups.com
Hey All - 

Sorry for all the workarounds you have to do to accommodate this. I hope to have something working for you in a few months.

Dave


--
You received this message because you are subscribed to the Google Groups "Flubaroo Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to flubaroo-discussio...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

Trevor Beck

unread,
Aug 27, 2013, 5:28:41 PM8/27/13
to flubaroo-dis...@googlegroups.com
I was actually referring to the form itself. With a lot of open ended questions, I found it kind of confusing. However, I think by splitting up the open ended questions onto pages, this helps reduce that. Here's a sample:

http://goo.gl/TGuid8

Dave, thanks for the work you've done on your product. Please understand we're not trying to poo-poo it. I think we just enjoy the challenge of making it do what we want.  ;-)


On Sunday, August 25, 2013, GLUA <glua...@gmail.com> wrote:
> Trevor,
> I think the trick is to make the column with the open ended question wider so that it is easier to read.  You can also make the grade columns narrower so that they fit on one screen.  You can freeze the columns to the right of the students name so the name and the question are both visible.  I don't know if a teacher grades differently depending on the student.  See the example results in the previous message.  I know this isn't the best solution but I think it will work until Dave can do his magic.  
> I also remember that Open-ended questions can have multiple qualities.  A student could get  a grade for the correct answer, grammar, spelling and penmanship.  I'm kidding on the penmanship but I think I always lost points because of penmanship.  You should see my checks but they always get cashed.  
> I'm not sure I understand what you mean by a separate page. Could you create an example?  I'm hoping that our experimentation will help Dave know what folks want.  I have never been on the teacher side of the fence. 
>
> On Sunday, August 25, 2013 8:21:40 PM UTC-4, Trevor Beck wrote:
>>
>> Yes, I thought of doing that as well. Unfortunately, if you have a number of open ended questions, it becomes a bit long on scrolling. However, you could put the open ended questions on a separate page so it doesn't look so unwieldy. 
>>
>> Sent from my iPad
>> On 2013-08-23, at 4:42 PM, GLUA <glua...@gmail.com> wrote:
>>
>> See the forms and results below.
>> Form   results  
>> This idea might be a little soggy as I thought of it in the shower this morning.  LOL
>>
>> On Tuesday, August 20, 2013 2:20:42 PM UTC-4, Trevor Beck wrote:
>>
>> How would you handle

Joe Schmidt

unread,
Aug 27, 2013, 6:48:35 PM8/27/13
to flubaroo-dis...@googlegroups.com
Thanks Trevor.  The example helped.  I was tunnel vision on the results and thinking of ways to make it easier on the teacher and not the form.

I couldn't agree more that we are not saying anything negative about Flubaroo.  It is wonderful that Flubaroo is powerful enough that its use can be stretched with a little creative thinking.  

Joe Schmidt

God Loves Us All


Jorge Trujillo

unread,
Oct 9, 2013, 10:57:43 AM10/9/13
to flubaroo-dis...@googlegroups.com
Wonderful Joe. Thanks so much! This will help me a lot. 


On Thursday, August 8, 2013 5:15:37 PM UTC-4, Joe wrote:
This intrigued me.  I'm not a teacher but if a pass / fail on an open ended question is good enough then I think this will work.  

Create a paragraph question to contain the open ended response.  Make the next question a space to hold the grade of the open ended question.  Tell the student to skip the grade question.  In your answer row put a code like "passed" as the correct answer.  Continue with as many questions as you would like.

Enter two questions for each open ended question.  

Before you use flubaroo to grade the responses edit the responses and type "passed" in the grade cell for each open ended question.

Tell Flubaroo that the open ended questions are to identify the person and give the grade column whatever score you want.



It has been fifty years since I got out of school and I seem to remember that teachers liked to vary the points given on open ended questions.  My example only works if you are willing to give an all or nothing to the open ended question.

Maybe some teachers can give Dave some feedback.  Do open ended questions require the ability to assign a varying point scale?

For the record, I'm a retired IT person.



Joe Schmidt

God Loves Us All


On Thu, Aug 8, 2013 at 3:54 PM, Dave Abouav <da...@edcode.org> wrote:

This is coming in one of the next versions. :) Maybe 6 months out.

Thanks for your feedback!

Dave

On Aug 5, 2013 5:11 PM, "Anthony Schmidt" <anthony...@yahoo.com> wrote:
First, I'd like to say that this is an awesome App Script! I had been making quizzes and grading them using different excel/Google Sheets formulas, but this is much quicker. It works great for objective questions. I was wondering, however, how it could be used for more open ended questions, say short answer-type questions? Is it possible to carry student answers over to the Grades sheet and then hand-grade them, but still have them included in the Flubaroo email, scoring? I could add the cells and formula myself after initial grading, but would Flubaroo see them for emailing?

Thanks,

Anthony

--
You received this message because you are subscribed to the Google Groups "Flubaroo Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to flubaroo-discussion-forum+unsub...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.
 
 

--
You received this message because you are subscribed to the Google Groups "Flubaroo Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to flubaroo-discussion-forum+unsub...@googlegroups.com.

mcj...@gmail.com

unread,
Dec 22, 2013, 10:16:48 AM12/22/13
to flubaroo-dis...@googlegroups.com
What happens if a question is skipped (or graded with some mock grade), but I would like to overwrite the Flubaroo grading on the Grades sheet by hand?  Would those edited grades be emailed to student's? Included in the grade summary for each student? all class?

Cheers!


Joe

unread,
Dec 22, 2013, 11:17:31 AM12/22/13
to flubaroo-dis...@googlegroups.com
I don't think it is possible to edit the grades or grade summary.  With the method being discussed here you are editing the answer in the response sheet to either match or not match the answer you provide in the answer key row.  Flubaroo will then grade the answer just like the other questions.  The question to hold the answer to the open ended question is treated like any other question.

mcj...@gmail.com

unread,
Dec 22, 2013, 9:56:56 PM12/22/13
to flubaroo-dis...@googlegroups.com
Many thanks!  So one can edit the response sheet before the Flubaroo graded it, but can't edit grades by hand between the grading and emailing the grades?

I somewhat similar vein, I take it that a boolean OR can be used in the answer key (as in %or between the words) so that flubaroo looks for either one of those in the answer.  In an open-ended text questions, it could look for one of a few keywords and grade the question as correct if it finds one of them.  Is it (or would it be) possible to also implement %and, (or even %not - with those three, most anything could be done) so that some set of keywords in the text is required to answer the question?

Also, is it possible to assign a grade to a cell with any content (or the text content which has certain length in characters, maybe), but assign 0 for cells that are empty (if the question on the form is not required for instance), or have e.g. less than X characters?

Cheers!

Joe

unread,
Dec 23, 2013, 12:47:16 AM12/23/13
to flubaroo-dis...@googlegroups.com
That's correct.  Edit responses before grading, Never edit grades. 

When using the %or Flubaroo is looking for either phrase only so that other words will cause Flubaroo to not grade as correct.  If the answer key has 'cat %0r dog' and the response is 'big cat' then the answer would be graded incorrect because 'big cat' isn't the same as 'cat'.

Dave will have to answer about the other options.  I am having a problem figuring out how Flubaroo could grade with %and or %not.  The answer could make no sense and still contain the word or not contain the words connected by these operators.  I may be wrong but I don't think Flubaroo will ever eliminate manual grading for open ended questions.  I've been wrong before but I can see problems trying to provide that much power.

Happy Holidays to all!

mcj...@gmail.com

unread,
Dec 23, 2013, 4:57:42 AM12/23/13
to flubaroo-dis...@googlegroups.com
Many thanks!

I think I understand now how the %or works, thanks.

The idea with %or %and and %not, was that if there is an open-ended text question, I thought that I could persuade Flubaroo to scan the words that and see how they compare with the words given in the key.  So for example, if I'm looking for some keywords that I believe an answer should contain, Flubaroo could find them and, if either some of the words (%or) or all of the words (%and) are included (or not included, which would require %not operator) in the answer, Flubaroo could mark them as correct.

I'm not 100% sure, but I thought that it would add quite a flexibility in designing quizzes with open-ended answers.  Would that be technically or operationally problematic, I'm not sure.  I was hoping it would be useful to extend Flubaroo grading to, somewhat, automatically grading open-ended questions.

In a somewhat related vein, do you think that being able override the automated grading would be useful as well.  The situation I envision would be 1) to override the grade for common reason (e.g. student didn't understand the question or my question wasn't clear enough or perhaps there were more correct answers then I thought were possible) and 2) the open ended questions mixed with multiple choice, that I could grade by hand after Flubaroo did its bit on the multiple choice ones).

And this is totally unrelated, but I figured that I can ask this in the same post: what's the best way of transferring grades to a master roster.  In other words, I have a few quizzes graded in Flubaroo, each containing a unique student number, and I would like to automatically copy them to another sheet which contains the roster with the same unique student numbers.  Would VLOOKUP, for instance, work?  Or is there a better way?

Cheers and thanks!

mcj...@gmail.com

unread,
Dec 23, 2013, 6:33:20 AM12/23/13
to flubaroo-dis...@googlegroups.com
Just another question re.: the original technique described in this thread: i.e. inserting double questions, one with actual text, the other with failed/passed grade for it that is later edited manually.

I take it that it should work even if the extra failed/pass question is not part of the form, but it is inserted into the response sheet manual as in insert column.  Is that correct?  I'm reluctant to include extra questions to be skipped in the entry form not to confuse students, but I could insert columns into the Response sheet that I will then assign pass/fail grade before asking Flubaroo to grade the whole thing.

Cheers!

Joe

unread,
Dec 23, 2013, 9:12:04 AM12/23/13
to flubaroo-dis...@googlegroups.com
The question to hold the grade is on the Form.  Look at the Aug 18th post above for a link to an example.

Joe

unread,
Dec 23, 2013, 9:33:53 AM12/23/13
to flubaroo-dis...@googlegroups.com
Somewhere in this forum I admitted that I'm not a teacher.  I started my IT career back in the days of IBM cards.  I understand where you are going with your questions but in my opinion it would be wrong or likely impossible to give Flubaroo enough intelligence to grade open ended questions as I understand them.  Think of the power of a Google search and Google still displays the possible answers and lets us choose which one to open.  Artificial intelligence can only go so far.

We could have a long chat where either I would understand it was possible or you would see the possible problems.  We would both learn something.

Dave is the writer of Flubaroo and he may have different ideas.  I may have been retired more years than he has worked.  LOL I suspect Dave is very busy during this holiday season.

Maybe if you could create a form or spreadsheet with examples of what the student might reply and if Flubaroo should grade the answer as correct or not.  

It seems to me that if a teacher asks an open ended question they are wanting to gain a deeper understanding of what the student knows and reading the responses might be the only way to go.

As for moving the grades I have no experience in with that.  I did post something on sorting within Flubaroo which might make it easier.

I think we are all in this together to learn.  Maybe others will share how they enter the grades.



  

On Monday, December 23, 2013 4:57:42 AM UTC-5, mcj...@gmail.com wrote:
Many thanks!

Dave Abouav

unread,
Dec 24, 2013, 5:55:38 PM12/24/13
to flubaroo-dis...@googlegroups.com
Sorry for chiming in late here.

In short, I might add some logic to Flubaroo in the future to expand its pattern matching abilities, but this is low on the priority list for new features.

As for manually graded questions, I'll be working on that feature in a few months (hopefully). With this feature, you'll be able to change the number of points after Flubaroo grades the assignment, but before emailing out grades.

Dave


--
You received this message because you are subscribed to the Google Groups "Flubaroo Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to flubaroo-discussio...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.



--

mcj...@gmail.com

unread,
Dec 31, 2013, 1:30:57 AM12/31/13
to flubaroo-dis...@googlegroups.com
Maybe instead of 'Grade for previous question' entry in the form, which may confuse students, name is as 'Are you sure?' or 'Is that your final answer?' with a single option (or perhaps two options - yes and no, with no meaning that there is no answer.  In the email to students it will appear as an graded question that follows the actual question being graded (which shows 'skipped' in the email'}.  Then we need to only edit same 'yes' answers on the Response sheet to no if the answer is wrong, and then use 'yes' in the key as being the correct answer. 

On Friday, August 9, 2013 4:15:37 AM UTC+7, Joe wrote:
This intrigued me.  I'm not a teacher but if a pass / fail on an open ended question is good enough then I think this will work.  

Create a paragraph question to contain the open ended response.  Make the next question a space to hold the grade of the open ended question.  Tell the student to skip the grade question.  In your answer row put a code like "passed" as the correct answer.  Continue with as many questions as you would like.

Enter two questions for each open ended question.  

Before you use flubaroo to grade the responses edit the responses and type "passed" in the grade cell for each open ended question.

Tell Flubaroo that the open ended questions are to identify the person and give the grade column whatever score you want.



It has been fifty years since I got out of school and I seem to remember that teachers liked to vary the points given on open ended questions.  My example only works if you are willing to give an all or nothing to the open ended question.

Maybe some teachers can give Dave some feedback.  Do open ended questions require the ability to assign a varying point scale?

For the record, I'm a retired IT person.



Joe Schmidt

God Loves Us All


On Thu, Aug 8, 2013 at 3:54 PM, Dave Abouav <da...@edcode.org> wrote:

This is coming in one of the next versions. :) Maybe 6 months out.

Thanks for your feedback!

Dave

On Aug 5, 2013 5:11 PM, "Anthony Schmidt" <anthony...@yahoo.com> wrote:
First, I'd like to say that this is an awesome App Script! I had been making quizzes and grading them using different excel/Google Sheets formulas, but this is much quicker. It works great for objective questions. I was wondering, however, how it could be used for more open ended questions, say short answer-type questions? Is it possible to carry student answers over to the Grades sheet and then hand-grade them, but still have them included in the Flubaroo email, scoring? I could add the cells and formula myself after initial grading, but would Flubaroo see them for emailing?

Thanks,

Anthony

--
You received this message because you are subscribed to the Google Groups "Flubaroo Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to flubaroo-discussion-forum+unsub...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.
 
 

--
You received this message because you are subscribed to the Google Groups "Flubaroo Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to flubaroo-discussion-forum+unsub...@googlegroups.com.

je...@happygrader.com

unread,
Mar 2, 2014, 4:05:37 PM3/2/14
to flubaroo-dis...@googlegroups.com
Anthony,
You might want to try Happy Grader for grading open-ended responses.

Trevor Beck

unread,
Mar 2, 2014, 4:19:20 PM3/2/14
to flubaroo-dis...@googlegroups.com
Happygrader.com doesn't show anything useful. 
--
You received this message because you are subscribed to a topic in the Google Groups "Flubaroo Discussion Forum" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/flubaroo-discussion-forum/MlPJP7W0ZlI/unsubscribe.
To unsubscribe from this group and all its topics, send an email to flubaroo-discussio...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.


--

je...@happygrader.com

unread,
Mar 2, 2014, 4:40:06 PM3/2/14
to flubaroo-dis...@googlegroups.com
Sorry about that... website was momentarily down.  It's up now, and a demo version is available for you to have a look at its capabilities.  Only challenge may be that it requires a PC with MS Excel.
Cheers,
Jeff

On Sunday, March 2, 2014 1:19:20 PM UTC-8, Trevor Beck wrote:
Happygrader.com doesn't show anything useful. 

On Sunday, March 2, 2014, <je...@happygrader.com> wrote:
Anthony,
You might want to try Happy Grader for grading open-ended responses.

On Monday, August 5, 2013 5:11:50 PM UTC-7, Anthony Schmidt wrote:
First, I'd like to say that this is an awesome App Script! I had been making quizzes and grading them using different excel/Google Sheets formulas, but this is much quicker. It works great for objective questions. I was wondering, however, how it could be used for more open ended questions, say short answer-type questions? Is it possible to carry student answers over to the Grades sheet and then hand-grade them, but still have them included in the Flubaroo email, scoring? I could add the cells and formula myself after initial grading, but would Flubaroo see them for emailing?

Thanks,

Anthony

--
You received this message because you are subscribed to a topic in the Google Groups "Flubaroo Discussion Forum" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/flubaroo-discussion-forum/MlPJP7W0ZlI/unsubscribe.
To unsubscribe from this group and all its topics, send an email to flubaroo-discussion-forum+unsub...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

lawrenc...@cusd200.org

unread,
Feb 12, 2015, 2:55:43 PM2/12/15
to flubaroo-dis...@googlegroups.com
Dave,

I'm hoping that adding more logical operators as mcj suggested will get a higher priority. This thread is now over a year old -- any progress? Pretty please?

Having the %or operator is great, but as Joe pointed out, it is still unforgiving. Using "cat %or dog" will cause answers like "a cat" or "my dog" to be counted as incorrect. But if I could have some kind of %contains operator, then I could use something like "%contains cat %or dog" to give credit to any answer that contained the word "cat" or "dog". Perhaps I would have to use "%contains cat %or %contains dog" or some other syntax, but you get the idea. I just need to check for answers that CONTAIN multiple keywords, not just answers that ARE multiple keywords.

Is there any place I can find a list of all the available % operators, or are there only the two (%or and %cs)?

Thanks,
Larry
To unsubscribe from this group and stop receiving emails from it, send an email to flubaroo-discussion-forum+unsub...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

Joe Schmidt

unread,
Feb 12, 2015, 3:21:31 PM2/12/15
to flubaroo discussions
Larry,

I was in a contact with Dave recently and we touched lightly on open ended questions.  I don't think there will be an operator that will replace the teacher looking at the open ended questions.  You can test your suggestions by doing your own grading via a formula.  At the bottom of the Frequently asked questions is a link to a comparison of other methods of grading a quiz.  Or you can click http://goo.gl/GXccxm  I need to update my comparison as I do further helping of teachers and learning about other methods.  I have not seen any method for dealing with open ended questions in my Internet travels.  The %contains shouldn't be too difficult to put in a formula.  

http://www.flubaroo.com/hc has all of the current operators.

I'm not Dave but I am a retired IT person who helps the group with answers the best I can.  I have a lot of knowledge of Flubaroo, Autocrat and FormMule.  

Have you tried putting in the instructions that you only want the noun?  In dealing with my grandchildren they are pretty quick to understand the rules.  They may not agree but they understand.


Joe Schmidt


To unsubscribe from this group and stop receiving emails from it, send an email to flubaroo-discussio...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

mszcz...@ga.hiltoncsd.net

unread,
Apr 19, 2015, 8:18:10 PM4/19/15
to flubaroo-dis...@googlegroups.com
I figured out a way to mix MC and open ended questions and have flubaroo count both in a graded score: Watch video here: https://www.youtube.com/watch?v=aVguPLGNLvc 

rede...@gmail.com

unread,
Feb 6, 2016, 5:06:43 PM2/6/16
to Flubaroo Discussion Forum
I've been trying to figure out how to automatically grade open ended questions with partial credit. I've figured out one method that suits me. It's for a psychology test for finding a certain quality in a person's response. I'm going to set it up so that they get a point for every descriptive word used, such as "tall", "lamp", "red", "green", etc.

The first step is to make a column that substitutes these special words into the scores you want to give them. I turn them all into "1". Apparently, any number of words can be substituted by nesting this formula. I couldn't find a neater way to do it, unfortunately.
=SUBSTITUTE(SUBSTITUTE(A2, "green","1"), "red", "1")
If cell A2 reads "red opened the green door", then this new column will show "1 opened the 1 door".

The next step is to add the numbers together to get your score.
=SUM(SPLIT(D2," "))
With column D being the substitution column we made earlier.
This cell will read "2".

In the case that the letters "red" appear inside another word like "redding", it will be substituted into "1ding", but this will not be added to the score.

One problem is that any numerals that the participant enters will be added to their score.
So the remedy for that is to tell them to spell out numbers, and/or go through their answers and check if they did that. You can always just fix them manually.

I haven't tried this with flubaroo yet, but I think it will work in conjunction with the "grade manually" option.

Flubaroo Joe

unread,
Feb 6, 2016, 7:16:13 PM2/6/16
to flubaroo discussions
I have a problem with grading based on the presence of a word but that is your call.

I'm interested in how you get this to work in Flubaroo.

Please share the file with flubar...@edcode.org.  There is an additional trick or two that will put the grade on the Grade sheet that I will share them.


--
Reply all
Reply to author
Forward
Message has been deleted
Message has been deleted
0 new messages