Request for SEM Vignette Analysis Resources

[salman mahmood]

Dear all,

I hope this email finds you well. My name is Salman Mahmood, and I am currently a postdoctoral researcher. I am in the process of learning scenario-based questionnaire (vignette) analysis using Structural Equation Modeling (SEM).

I was wondering if any of you could kindly recommend a YouTube playlist or tutorial series on this topic. I have already checked Sir Neeraj Kaushik's channel, but unfortunately, he does not have a playlist specifically covering this subject.

If you know of any helpful resources or colleagues who have created content on this, I would greatly appreciate your suggestions.

Thank you for your time and assistance!

Best regards,
Salman Mahmood

[Neeraj Kaushik]

Source: Google

Analyzing scenario-based questionnaires—also known as vignette studies—with Structural Equation Modeling (SEM) is a highly effective way to measure how specific, situational variables trigger psychological, behavioral, or decision-making responses, while simultaneously accounting for measurement error and unobserved latent traits. 

The recommended analytical process follows a step-by-step approach tailored to the unique structure of vignette designs. 

1. Structure of Vignette Data

In a vignette study, respondents are exposed to hypothetical scenarios where specific attributes (cues) are experimentally manipulated. 

Within-Subjects Design: Each respondent evaluates multiple scenarios.
Level 1 Data: The vignette-level variables (e.g., specific scenarios, manipulated cues).
Level 2 Data: The respondent-level variables (e.g., demographics, baseline attitudes). 

2. The Two-Step SEM Approach

To analyze this type of survey data, the analysis follows the standard two-step SEM process: the measurement model and the structural model. 

Step A: Validate the Measurement Model (CFA)

Before testing structural paths, you must confirm that the questionnaire items accurately measure the unobserved constructs (latent variables) related to the scenarios (e.g., Perceived Risk, Empathy, Intent to Purchase). 

Confirmatory Factor Analysis (CFA): Load the scenario responses into your latent constructs.
Validity & Reliability: Check the Composite Reliability (CR) (should be >0.7) and Average Variance Extracted (AVE) (should be >0.5).
Discriminant Validity: Ensure that the constructs are distinct from one another, usually by confirming that the square root of the AVE for each construct is greater than its correlations with other constructs. 

Step B: Estimate the Structural Model

Once the measurement model fits properly, you connect the latent variables with directional pathways to test your theoretical hypotheses. 

Direct Effects: How specific scenario conditions influence a participant's reaction.
Mediation/Moderation: Assessing whether the effect of a scenario cue on behavior is transmitted through an emotional or cognitive variable. 

3. Key Considerations for Vignette-SEM

Handling scenario data requires specialized statistical considerations to avoid violating assumptions of independence:

Multilevel SEM (MLSEM): Because respondents evaluate multiple vignettes, observations within the same person are correlated. Multilevel SEM accounts for both within-person (Level 1) and between-person (Level 2) variance. 
SEM for Within-Subject Experiments: Often used in factorial surveys, this isolates the effects of specific manipulated vignette attributes from individual baseline traits by treating the vignette situations as experimental conditions.

4. Model Fit Indices

You must evaluate how well your hypothesized model reproduces the observed covariance matrix. Standard thresholds for good model fit include: 

Chi-Square (chi ^2): Should ideally be non-significant, though it is heavily impacted by large sample sizes.
RMSEA (Root Mean Square Error of Approximation): Values should be <0.05 (acceptable up to 0.08).
CFI (Comparative Fit Index): Values should be (> 0.95).
SRMR (Standardized Root Mean Residual): Values should be <0.08. 

5. Recommended Software

Depending on your exact modeling needs (e.g., Covariance-based vs. Variance-based SEM), you can utilize several tools:

Mplus: The gold standard for handling complex multilevel SEM and categorical outcomes typical of scenario-based choices.
lavaan: A robust, free, and open-source R package explicitly designed for latent variable analysis.
SmartPLS: Ideal if your vignette data is non-normal, highly complex, or you are using formative (rather than reflective) indicators for your scenario constructs. 

I've explained the working of 

Mplus on  Mplus - YouTube

Multilevel Modeling using R on Multilevel Modeling using R - YouTube

Lavaan on R-Studio Part-25.2 CFA Revisited- lavaan package

SmartPLS on PLS-SEM (using SmartPLS) 

Best wishes

--
The members of this group are expected to follow the following Protocols:
1. Please search previous posts in the group before posting the question.
2. Don't write the query in someone's post. Always use the option of New topic for the new question. You can do this by writing to dataanaly...@googlegroups.com
3. It’s better to give a proper subject to your post/query. It'll help others while searching.
4. Never write Open-ended queries. This group intends to help research scholars, NOT TO WORK FOR THEM.
5. Never write words like URGENT in your posts. People will help when they are free.
6. Never upload any information about National Seminars/Conferences. Send such information
in personal emails and feel free to share any RESEARCH-related information.
7. No Happy New Year, Happy Diwali, Happy Holi, Happy Birthday, Happy Anniversary, etc. allowed in this group.
8. Asking or sharing Research Papers is NOT ALLOWED.
9. You can share your questionnaire only once.
---
You received this message because you are subscribed to the Google Groups "DataAnalysis" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataanalysistrai...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/dataanalysistraining/CAHEuVDsJCtaGqKVPC2pLOqNeL-B%3DCZZVGGw%3DmBGd%3D0P_U77iVQ%40mail.gmail.com.