Session 05 - Finalize Study & Prereg

We do the last finetuning of the study; intro to preregistration

Overview

Topic Duration Notes
Last finetuning of study 45
Form 4 groups for homework 10 A to D, with funny names
Homework Instructions 5

Last finetuning of study

(1) Create Video of Procedure

See CREP Step 9: Procedure Video.

(2) Participant management:

  • Create shared email address (e.g. at web.de; use a European provider) as primary contact point for study participants. The group will monitor and administer this email address in a rotating way.
  • Add this email address to the formr study.

(3) OSF upload of files:

  • “Please make sure to clearly identify and document any deviations from the original study (e.g., new measures, different setting, a different category of participants).” –> Create a document DEVIATIONS.md that summarizes all known deviations from the original study in tabular form.
  • Move the final formr Google sheet into our joint Google Drive folder; upload the sheet (exported as ods or xlsx file) into our OSF project
  • See See CREP 10-13 for additional steps
  • Check replicability: Would an external researcher be able to run a direct replication (i.e., with the same procedures and materials) just by looking into this OSF repository?

Homework

This is the homework for the next three weeks - distribute it yourself!

Homework 1 (individually): Test the study

Go through the study as a participant (see study link in GDrive README). Fill in the items properly (we want to have an estimate of the time it needs to fill in all items). In the open text field, write which video you have seen. In the group some should use smartphones, others tablets, other different browsers on desktop/laptop.

Homework 2 (in groups): Fill in the preregistration

Fill in the PRP-QUANT preregistration template. For that purpose, create a copy of the template file “PRP_QUANT_Awe_template” in our Google drive (into the same folder), and name it after your group ID (i.e., PRP_QUANT_Awe_A, PRP_QUANT_Awe_B, etc.).

Some notes:

  • Remember: We only focus on Study 3 of the original paper.
  • As we do a direct replication, we aim for the same procedure as in the original study (unless there are good reasons to deviate). Explicitly mention where we have (a) planned deviations and (b) where the original instructions were so unclear that we had to fill in the gaps with reasonable assumptions.
  • In some places you will be unsure what to fill in. Try to come up with reasonable guesses; we will create an improved consensus version in the next step.
  • If you absolutely have no clue, write that into the field; we will discuss it in the next session.
  • Be concise, no need to write a novel.
  • You do not need to fill in:
    • T1 to T8
    • The entire section on “Abstract” (A1 to A4)
    • I1
    • “M3 Sample size, power and precision”: We do this together later
    • “AP4 Reliability analysis (if applicable)”: You have not learned how to do this yet.
  • In section I3 Hypothesis (H1, H2, …), …
    • … fill in the hypotheses on the conceptual/theoretical level. The operationalization is then specified in section M12 Measured variables, manipulated variables, covariates.
    • … specify the control group (e.g., “X increases compared to what?”)

The learning goal is that engage with the template and understand its components. You do no need to provide perfect answers to each field.

Homework 3 (individually): Do the Quarto tutorial

Do the LMU OSC Quarto Tutorial. Work through sections 1 (“Welcome to Quarto”) and 2 (“Quarto Tutorials”, up to and including the last section “Tutorial: Authoring”). It certainly makes sense to read the short “3. Tips and Comments” section.

(Note: If you are interested, you can go on with the Advanced Exercises. But we will do the “APA 7 Manuscripts” chapter later together.)

Deliverable: Now we combine our git skills and the new Quarto skills.

  1. Create a new Github project, clone it to your local computer.
  2. Within the local project, create a Quarto document (with .qmd extension and format: html) that has at least one R chunk with a computation.
  3. Render it to PDF.
  4. Commit and push your changes to the remote repository.
  5. Verify online: Go to the project website on Github and see if the new files appeared.

This is a challenging combination of tasks. If you don’t manage to do all steps, don’t panic. After reasonable efforts to solve the problems yourself, you can write an email to the instructor (with a specific explanation of the issues you encountered; e.g. the exact error messages), or we solve remaining issues together in the next session.