0.01 or 0.001 level of significance?

229 views
Skip to first unread message

Sukhmani Singh

unread,
Mar 17, 2021, 10:08:01 AM3/17/21
to DataAnalysis

Respected Sir and group members,

Greetings of the day!

I have a small query. If my statistical analysis result (for e.g., One-way ANOVA) comes out to be significant as p-value is 0.000.  So, we write it as F(df)= Value of F, p<.001.

But while writing the interpretation, Should we write it as…. “The result is significant at 0.01 level of significance OR significant at 0.001 level of significance.” 

I am asking because generally we compare the p-value with either 0.05 or 0.01 level of significance, and write that result is significant at 0.05 or 0.01 level of significance. But what if, p-value is 0.000 …then what level of significance should we specify – 0.01 or 0.001?

Means, Can we write – Significant at 0.001 level of significance?

Kindly guide.

Regards,

Sukhmani.

 

 

 

Manoj Diwakar

unread,
Mar 17, 2021, 11:13:41 AM3/17/21
to dataanalys...@googlegroups.com
P- value 
Level of significant 
These are two think p value interpretation start with < .05 I.e p value is significant or > .05 not significant at 95 % or 99 % level of significant..


Sent from my iPhone

On 17-Mar-2021, at 7:37 PM, Sukhmani Singh <sukhm...@gmail.com> wrote:


--
Protocols of this Group:
 
1. Plz search previous post in group before posing the question.
2. Don't write query in someone's post. Always use the option of New topic for the new question. You can do this by writing to dataanalys...@googlegroups.com
3. Its better to give a proper subject to your post/query. It'll help others while searching.
4. Never write Open ended queries. This group intend to help research scholars NOT FOR WORK THEM.
5. Never write words like URGENT in ur posts. People will help them when they are free.
6. Never upload any info about National Seminars/Conferences. Send such info on personal emails. And feel free to share any RESEARCH related info.
7. No Happy New Year, Happy Diwali, Happy Holi, Happy B'day, Happy Anniversary etc. allowed on this group.
8. Few months back there was a facility for asking & sharing the Research Papers. Now there is no provision of asking for the research paper here.
 
Let’s make a better research environment.
---
You received this message because you are subscribed to the Google Groups "DataAnalysis" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataanalysistrai...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dataanalysistraining/ef551421-8e4e-48e4-a171-47786a069a76n%40googlegroups.com.

Sukhmani Singh

unread,
Mar 17, 2021, 11:28:06 AM3/17/21
to dataanalys...@googlegroups.com
Thankyou Manoj sir for your valuable input.
I guess, we say it like this - 0.01 or 0.05 level of significance OR 99% or 95% level of confidence. May be Neeraj sir can guide us on this.

My query is that - Can we write - "The result is significant at 0.001 level of significance?"

Regards.



Dr. Nisha Arora

unread,
Mar 17, 2021, 11:33:58 AM3/17/21
to dataanalys...@googlegroups.com
Hi Sukhmani,
Ideally, p-values are chosen beforehand depending upon how sure you want to be before rejecting a claim (null). It is not always 1/5 or 10 %, it is subjective and domain-specific or even sometimes problem-specific. [Read more about the trade-off between type I error & type 2 error. I find it very similar to sensitivity & specificity in a classifier, both discusses confusion matrix]
Usually, scholars go with a 5 % level of significance, you should report your results based on your chosen p-value no matter what results you are getting from your analysis.



--

Sukhmani Singh

unread,
Mar 17, 2021, 12:54:16 PM3/17/21
to dataanalys...@googlegroups.com
Dear Nisha mam, thanks for your immediate and valuable feedback. 
Regards.

Shuvendu Chakraborty

unread,
Mar 17, 2021, 12:54:16 PM3/17/21
to dataanalys...@googlegroups.com
I think level of significance should be defined by user. generally for social studies we take it as 0.05. if your p value is 0.000 then it very very less than your defined tolerance level. ie. prob that your hypo. is true is very very small. or you can say your calculated value falls within the highly rejected region. 

Shuvendu Chakraborty

unread,
Mar 17, 2021, 12:54:16 PM3/17/21
to dataanalys...@googlegroups.com
you can say result is highly sqtatistically significant. but what hypothesis you have taken that is also important to write the conclusion.

Manoj Diwakar

unread,
Mar 17, 2021, 8:44:11 PM3/17/21
to dataanalys...@googlegroups.com
You can nt do for .001 

Sent from my iPhone

On 17-Mar-2021, at 10:24 PM, Shuvendu Chakraborty <shuvendu.c...@gmail.com> wrote:


Reply all
Reply to author
Forward
0 new messages