Content Validity Index (CVI)

298 views
Skip to first unread message

Neeraj Kaushik

unread,
Jul 4, 2022, 8:50:40 AM7/4/22
to dataanalysistraining
Dear Friends

While developing a new scale, we often mention the Content Validity and we mention two methods for the same:
1, Review of Literature
2. Expert Opinion

Though there are no statistical measures for the same but in Nursing Education Studies, Content Validity Index (CVI) is often reported. Some of the excellent papers on this subject are as under:

ABC of Content Validation and Content Validity Index Calculation
https://eduimed.usm.my/EIMJ20191102/EIMJ20191102_06.pdf
https://www.researchgate.net/publication/334134963_ABC_of_Content_Validation_and_Content_Validity_Index_Calculation

The Content Validity Index: Are You Sure You Know What’s Being Reported? Critique and Recommendations
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.684.1303&rep=rep1&type=pdf

Is the CVI an Acceptable Indicator of Content Validity? Appraisal and Recommendations
https://www.researchgate.net/publication/6185294_Is_the_CVI_an_acceptable_indicator_of_content_validity_Appraisal_and_recommendations

Evaluation of the Content Validity Index of the Australian/Canadian Osteoarthritis Hand Index, the Patient-Rated Wrist/Hand Evaluation and the Thumb Disability Exam in People with Hand Arthritis
https://www.researchgate.net/publication/343972949_Evaluation_of_the_Content_Validity_Index_of_the_AustralianCanadian_Osteoarthritis_Hand_Index_the_Patient-Rated_WristHand_Evaluation_and_the_Thumb_Disability_Exam_in_People_with_Hand_Arthritis

I've explained the concept and calculations of the Content Validity Index (CVI) in this video:

Content Validity Index: Concept and Calculations: https://youtu.be/ThVSvFf05ps

Happy Learning

Anil Kumar Singh

unread,
Jul 4, 2022, 11:42:26 AM7/4/22
to dataanalys...@googlegroups.com
Dear Neeraj Sir,

As usual, you leave no stones unturned to amaze and enlighten us with novel research ideas and concepts. This one is no different either. Enjoyed learning CVI, and eagerly waiting for your next video on the topic.

I want to confirm if we can (and should) use CVI in social sciences and business management researches as well.

Kindly enlighten.

Regards.

Anil Kumar Singh.

--
Protocols of this Group:
 
1. Plz search previous post in group before posing the question.
2. Don't write query in someone's post. Always use the option of New topic for the new question. You can do this by writing to dataanalys...@googlegroups.com
3. Its better to give a proper subject to your post/query. It'll help others while searching.
4. Never write Open ended queries. This group intend to help research scholars NOT FOR WORK THEM.
5. Never write words like URGENT in ur posts. People will help them when they are free.
6. Never upload any info about National Seminars/Conferences. Send such info on personal emails. And feel free to share any RESEARCH related info.
7. No Happy New Year, Happy Diwali, Happy Holi, Happy B'day, Happy Anniversary etc. allowed on this group.
8. Few months back there was a facility for asking & sharing the Research Papers. Now there is no provision of asking for the research paper here.
 
Let’s make a better research environment.
---
You received this message because you are subscribed to the Google Groups "DataAnalysis" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataanalysistrai...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dataanalysistraining/CAAd%3Dc8Ntk0fQ-DffZFwB13kBpfX%2BpjrE5B923nv6G%3DMknAg1PA%40mail.gmail.com.

Neeraj Kaushik

unread,
Jul 4, 2022, 11:50:11 PM7/4/22
to dataanalysistraining
Dear Friends

Modified Cohen's Kappa (k*) is developed as an improvement over the Content Validity Index (CVI)

The details of this concept is provided in this paper: 
Practical use of Modified Cohen's Kappa is illustrated in this paper:

Evaluation of the Content Validity Index of the Australian/Canadian Osteoarthritis Hand Index, the Patient-Rated Wrist/Hand Evaluation and the Thumb Disability Exam in People with Hand Arthritis
https://www.researchgate.net/publication/343972949_Evaluation_of_the_Content_Validity_Index_of_the_AustralianCanadian_Osteoarthritis_Hand_Index_the_Patient-Rated_WristHand_Evaluation_and_the_Thumb_Disability_Exam_in_People_with_Hand_Arthritis

I've explained this concept in this video:

Modified Kappa: Concept and Calculations: https://youtu.be/MrLZSHddYg4

Happy Learning
Neeraj

Neeraj Kaushik

unread,
Jul 5, 2022, 12:29:15 AM7/5/22
to dataanalysistraining
Dear Anil

Thanks for the kind words.

As is the famous proverb None of us is stronger than all of us.  We learn from each other.

The credit for my learning of the Content Validity Index goes to Ms Venisha Jenifer Dmello, Research Scholar, Department of Commerce, MAHE, Manipal who made me aware of this topic. 

I sincerely feel that we can and shd use Modified Kappa (K*) as an Index of Content Validity in the new scale construction.

Regards
Neeraj

Vipin Singh

unread,
Jul 5, 2022, 1:47:09 AM7/5/22
to dataanalys...@googlegroups.com, Neeraj Kaushik
Dear Sir,

In my thesis, I used "Lawshe". Content Validity Ratios "for the content validity of the questionnaire. As one of my panel asked for the same in a research meeting at that time I was clueless after lots of research on youtube, got this link.

I hope it is the right method.


Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28, 563–575.



Warm Regards,
Vipin Singh 
Assistant Professor  







Mailtrack Sender notified by
Mailtrack
07/05/22, 10:35:47 AM

Anil Kumar Singh

unread,
Jul 5, 2022, 2:38:23 AM7/5/22
to dataanalys...@googlegroups.com
Thank you, Sir. I am now looking forward to using the concept in my future research endeavours whenever applicable. 

Thank you once again 🙏

Anil Kumar Singh

unread,
Jul 5, 2022, 3:05:30 AM7/5/22
to dataanalys...@googlegroups.com
Thank you Vipin Sir for this valuable information 🙏



--
Dr. Anil Kumar Singh,
Call: (91) 9863088187

Vidushi Sharma

unread,
Jul 5, 2022, 9:41:49 AM7/5/22
to dataanalys...@googlegroups.com
Good Evening Sir,
This was an amazing playlist like the other one and many doubts have been cleared because of you in a very simplistic way. 
Sir, I have gone through the papers you mentioned in the playlist and also gone through some more papers on scale development, where got certain confusion, questions are as follows:

  1. Since content validity is popular for nursing education, is it possible to apply it in other fields of study for scale or questionnaire development?
  2. Are there any criteria for defining eligibility for experts or it is solely dependent on the logic and relevance of the researcher?
  3. While going for expert opinion for content validity, Experts should be domain-wise or area of study/concept-wise?
  4. In the context of the translation of any scale, experts should have only knowledge of other (in which scale need to translate) language or they should also have knowledge of the domain for the purpose of validation?
  5. As I have witnessed in one of the videos of discriminant analysis, content validity is for formative scale, and convergent and discriminant validity is for reflective scale. But after visiting the papers and realizing that content validity is also used for reflective scale, Am I getting right sir?
Regards
Vidushi


Neeraj Kaushik

unread,
Jul 6, 2022, 12:48:12 AM7/6/22
to dataanalysistraining
Dear Vidushi
Here are my observations:
1. Yes, CVI and Modified Kapppa shd be reported in the scale development in Mgmt, commerce, Social Sci too
2. You have to decide on the eligibility of the experts in your area
3. Domain expert
4. Experts in the language in which the scale is prepared
5. Content validity is mentioned basically in the Formative constructs as in Reflective constructs we work on the principle of unidimensionality ie we are measuring only one construct at one time.
But here using CVI and Modified Kappa we are ascertaining whether the content coverage and relevance of statement in that construct is correct or not.
Best wishes

Maria Pramila D Costa

unread,
Nov 16, 2024, 7:40:47 AM11/16/24
to DataAnalysis
Thank you, Mr.Neeraj Kaushik
Can I get some references for the nursing studies reporting Modified Kappa score for the content validity?
Thank You in Advance
Dr. Maria D'Costa

Reply all
Reply to author
Forward
0 new messages