Learn Experimental Research Design

[Neeraj Kaushik]

Dear Friends

I started taking sessions on Research Methodology from 2008 and started making videos for YouTube from 2013.

I remember there was a time when applying Regression and EFA in research was considered great. Then came CFA & SEM (using AMOS) followed by CFA & SEM (using SmartPLS) which provided the ability to handle numerous complex models.

A new paradigm of Qualitative Analysis also got popular during COVID time with the emergence of NVivo, Atlas.ti, MaxQDA  and later R & Python. The scholars of management also borrowed numerous tools from other fields like MCDM, Content Analysis, Text Analysis etc.

However, in 2024, I was told by many professors (who have numerous A & A* category publications) that even their papers were desk rejected for the methodological design. Papers written using Survey methods only are not appreciated anymore and are desk rejected now. This witnessed another paradigm shift and upsurge towards experimental studies. So, let's start a new journey on learning How to design and analyze Experimental Studies.

Whenever we talk of experiments in the management domain, we get back to Prof RA Fisher who wrote the famous book The design of experiments in 1935. Prof RA Fisher has given the basic building block of Experimental Design (explained beautifully in the another book Research Methodology by Prof CR Kothari)

Let's take an example of Bournvita claiming that it can increase a kid's height beyond normal growth. For checking its claim, we will have to use the following terms:

Terminology:

1. Variables- Predictors and Outcome (Bournvita and Height)

2. Groups- Experimental and Control (Bournvita given, Bournvita not given)

3. Intervention / Treatment (Dose of Bournvita)

4. Measurement of variables (Measurement of Height)

5. Experimental Unit - Respondent (Kids)

6. Between group design (Comparing Boys and Girls)

7. Within group design (Comparing Pre and Post)

8. Manipulation Check (Checking how much dose of Bournvita should be given and for how long?) 

Principles of Experimental Research:

1. Principle of Replication (Study-1, Study-2, ....)

2. Principle of Randomization (Divide the population randomly (lottery) in 2 parts)

3. Principle of Local Control (Acknowledge and manipulate a variable )

Various types of Experimental Design:

Informal Designs:

1. Before and After without Control Group e.g. Political Advertisement

2. After Only with Control Group e.g. Virtual Influencer 

3. Before and After with Control Group e.g. Effect of Yoga on Health

Here the terms 'Before' and 'After' refers Measurement taken in Pre and Post scenario

With and without Control Group refers to the presence or absence of Control group

Formal Designs:

1. Completely Randomized Design (CR)

2. Randomized Block Design (RB)

3. Latin Square Design

4. Factorial Design

I've explained these concepts in this video:

Experimental Research Design: https://youtu.be/PmiTr03oThI

All the videos related to Experimental Design will be available in this playlist: Experimental Designs

In addition, I shall strongly recommend all to watch the first 3 videos of playlist Research Methodology and all the videos of the playlist Multivariate Analysis (Beyond ANOVA)

These will serve as the basic building block for understanding the nuances of Experimental Research.

Happy Learning

Neeraj

[Dr. R S P SINGH]

Thank you so very much.

Regards,

Dr. R S P Singh 

FMP, MBA, M Sc.(Ag), CAIIB, MCSE, CFP, MCCP

--
The members of this group are expected to follow the following Protocols:
1. Please search previous posts in the group before posting the question.
2. Don't write the query in someone's post. Always use the option of New topic for the new question. You can do this by writing to dataanaly...@googlegroups.com
3. It’s better to give a proper subject to your post/query. It'll help others while searching.
4. Never write Open-ended queries. This group intends to help research scholars, NOT TO WORK FOR THEM.
5. Never write words like URGENT in your posts. People will help when they are free.
6. Never upload any information about National Seminars/Conferences. Send such information
in personal emails and feel free to share any RESEARCH-related information.
7. No Happy New Year, Happy Diwali, Happy Holi, Happy Birthday, Happy Anniversary, etc. allowed in this group.
8. Asking or sharing Research Papers is NOT ALLOWED.
9. You can share your questionnaire only once.
---
You received this message because you are subscribed to the Google Groups "DataAnalysis" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataanalysistrai...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/dataanalysistraining/CAAd%3Dc8NxNULBdeqKZYLjr2EynpuU4Mbseer-FCFi%3DF%3DhkFvSPg%40mail.gmail.com.

[Ali Raza]

This is great Neeraj sir, Thank you

To view this discussion visit https://groups.google.com/d/msgid/dataanalysistraining/CAERES7YoJ3XgvJe9%3DspD8RdrtQxYTOG8BBAJxWUSDPSdOhKzcw%40mail.gmail.com.

[Neeraj Kaushik]

Dear Friends

Whenever you read paper on Experimental Research Design next time, just remember the acronym MMMA

Focus on the following:

1. Model

2. Measurement of variables

3. Manipulation of IDVs or Mod

4. Analysis (Statistical Analysis)

Example: Paper Effects of voice assistant recommendations on consumer behavior - Flavián - 2023 - Psychology & Marketing - Wiley Online Library

1. Model:

2. Measurement:

Credibility (Med), Usefulness (Med) and Behavior Intention (DV consisting of (a) Follow recommendation (b) Intention to purchase (c) Intention to recommend to others)- all measured on 7-point scale

3. Manipulation

1. Recommendation (IDV): Text vs Voice 

2. Product Type (Mod): Search (Ex: suitcase) vs Experience (Ex: Restaurant reservation)

4. Analysis

Study-1:

N=130 from Prolific

All manipulation check and run SEM (Reported Convergent and Discriminant Validity) and structural model consisting of Mediation Analysis.

Study-2

N=401 from Prolific

Along with all variable, added Gender of Voice Assistant - Male and Female

Now it has become 2 (Voice vs Text) x 2 (Search vs Exp) x 2 (Male vs Female) Design

Changed DV from Intrion to Buy to Actual Buy (!-Buy, 0-No buy) and applied Logistics Regression.

Happy Learning

Neeraj

[Ali Raza]

Sir highly appreciated. Now when i read experimental papers they make sense to me. It is because of you sir. stay blessed always

--
The members of this group are expected to follow the following Protocols:
1. Please search previous posts in the group before posting the question.
2. Don't write the query in someone's post. Always use the option of New topic for the new question. You can do this by writing to dataanaly...@googlegroups.com
3. It’s better to give a proper subject to your post/query. It'll help others while searching.
4. Never write Open-ended queries. This group intends to help research scholars, NOT TO WORK FOR THEM.
5. Never write words like URGENT in your posts. People will help when they are free.
6. Never upload any information about National Seminars/Conferences. Send such information
in personal emails and feel free to share any RESEARCH-related information.
7. No Happy New Year, Happy Diwali, Happy Holi, Happy Birthday, Happy Anniversary, etc. allowed in this group.
8. Asking or sharing Research Papers is NOT ALLOWED.
9. You can share your questionnaire only once.
---
You received this message because you are subscribed to the Google Groups "DataAnalysis" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataanalysistrai...@googlegroups.com.

To view this discussion visit https://groups.google.com/d/msgid/dataanalysistraining/CAAd%3Dc8NKAp8J_Ds2pPqub1yKsg7USMunMzwJ3wBba3CocxM4TA%40mail.gmail.com.

[MJ]

Thank you for bringing this on for discussion. A new age of research begins.

On Thu, 13 Feb, 2025, 18:28 MJ, <sessiona...@gmail.com> wrote:

Dear Sir
In addition to CR and others there's one more procedure Randomized control trials, where in more no.  Of control groups are used. Although it's applied in life sciences but best known procedure implemented was by Prof Abhijit Banerjee and Esther Duflo in their book " poor economics".
Best regards
Mihir Joshi PhD

To view this discussion visit https://groups.google.com/d/msgid/dataanalysistraining/CAKX05qSktFV67qhqrGiLhQwXgC6NsMJx43KnMFsvses%3Dmq1X6A%40mail.gmail.com.

[MJ]

Dear Sir
In addition to CR and others there's one more procedure Randomized control trials, where in more no.  Of control groups are used. Although it's applied in life sciences but best known procedure implemented was by Prof Abhijit Banerjee and Esther Duflo in their book " poor economics".
Best regards
Mihir Joshi PhD

On Wed, 29 Jan, 2025, 20:42 Ali Raza, <ali.kha...@gmail.com> wrote:

To view this discussion visit https://groups.google.com/d/msgid/dataanalysistraining/CAKX05qSktFV67qhqrGiLhQwXgC6NsMJx43KnMFsvses%3Dmq1X6A%40mail.gmail.com.

[Shivangi Dhawan]

Dear Neeraj Sir,

Can you please share a paper where the "Before and After with Control Group" experimental research design is followed?

Regards, 

To view this discussion visit https://groups.google.com/d/msgid/dataanalysistraining/CAMHT0CKiDW_jM_r5tq5gqZxDzRnwipZTCWjrkA%2BCPJzzadvK8g%40mail.gmail.com.

[Kuntal Dutta]

sir, Can Experimental Research Design be applied in finance? Are there any finance research papers where Experimental Research Design has been applied using secondary data?

[Neeraj Kaushik]

Dear Shivani

Before and After with control group are often conducted in the domain of medical studies

May refer Effect of cognitive behavioral therapy in mental health and hardiness of infertile women receiving assisted reproductive therapy (ART)

Best wishes

To view this discussion visit https://groups.google.com/d/msgid/dataanalysistraining/CAJMRRyPN5g_i-VeAk5BfJy3HV%3DfrXQemAV89hF1tYoCXVS3y5w%40mail.gmail.com.

[Neeraj Kaushik]

Dear Kuntal

Yes, Experimental studies are also conducted in the domain of Finance.

There it is known as Quasi Experimental Design

Plz refer 

• Experiments in finance: A survey of historical trends - ScienceDirect
• Brand equity and company performance: evidence from a quasi-experiment in an emerging market 
• Financial Goal Setting, Financial Anxiety, and Solution-Focused Financial Therapy (SFFT): A Quasi-experimental Outcome Study | Contemporary Family Therapy (springer.com)
• IMPACT OF MICROFINANCE ON HOUSEHOLD INCOME AND CONSUMPTION IN BANGLADESH: EMPIRICAL EVIDENCE FROM A QUASI-EXPERIMENTAL SURVEY (jstor.org)

Best wishes

Neeraj

To view this discussion visit https://groups.google.com/d/msgid/dataanalysistraining/5d1c2b94-ff2c-4907-a1d2-e1346faaa1aan%40googlegroups.com.