15. Experiment Procedure / Protocol
15.1. Describe the procedure of the experiment. Select first if the procedure refers to the MultiplEYE core data collection or to the collection of additional data.
For the collection of core dataset, please check the box describing the standard MultiplEYE procedure below:
The experiment starts with the experimenter entering the participant ID into the experiment software. Subsequently, the participant is greeted by a welcome screen and prompted to electronically sign the consent form. Following this, the experiment instructions are displayed on the screen. Next, the camera setup is initiated, which includes calibration and validation processes. A practice phase commences, involving two short texts followed by two comprehension questions each. These practice trials serve to familiarize participants with the experimental setup and keyboard usage, as well as to provide practice with comprehension questions. The main phase of the reading experiment starts thereafter. Ten texts are presented in a (pseudo-)randomized order, with the randomization implemented in the experimental presentation software to ensure that each participant encounters a different sequence. Constraints are applied to balance text type, length, and the placement of the mandatory mid-session break. A fixation trigger precedes the turn to each new page, requiring participants to fixate on a dot on the screen to validate calibration accuracy and allow for a smooth and fast transition to the next page, if the calibration is still sufficiently precise. Re-calibration procedures follow if warranted to regain precision of the eye-tracking measurements. Three rating scales follow the presentation of each text: two inquiring about the participant’s familiarity with the text (rating the familiarity of the text and whether participants have read or listened to the text previously), and the last one inquiring about the perceived difficulty. Following the rating scales, participants are prompted to respond to six comprehension questions after having completely read each text. Re-visitations of the texts are disabled during the presentation of the comprehension questions. After the completion of the experiment phase, participants are asked to fill out a participant questionnaire on a screen.
Is there anything you would like to add:
If your are filling out this form for your additional data collection, please describe your procedure below.
Note: Refer to how it differed from the experiment procedure for the core data collection. What aspects have changed compared to the standardized MultiplEYE procedure?
15.2. Please specify here, if your data collection followed the MultiplEYE experiment protocol, but the reading task of 10 texts was not conducted in a single session and was instead split into several sessions.
Please select:
Other, namely:
15.3. Please specify here, and if applicable, when you conducted psychometric tests during the experiment.
Note: Conducting psychometric tests are always considered as a separate session in addition to the eye-tracking session with the reading task (even if there is only be a small break in between sessions).
Please select:
Other, namely:
Were the psychometric tests conducted in a single session or split into several sessions?
Please select:
Other, namely:
Did any psychometric test session include more than one participant? In other words, were psychometric tests conducted simultaneously with multiple participants in a single session?
Please select:
16. Participants
16.1. Please describe how you recruited the participants for the MultiplEYE experiment (core data collection and / or additional dataset).
16.2. The invitation letter was send via (multiple answers can be selected):
Postal mailEmail (no distributor)Social media (please specify further below)Email distributor (please specify further below)Other method (please specify further below)
16.3. Describe your participants:
Please select first whether you are describing your participants for the core data collection or for the collection of additional data.
For the collection of core dataset, please check the box describing the participants’ inclusion criteria below:
Participants for the MultiplEYE core data collection are native speakers of the language being tested in the experiment. They are adults (aged 18 or older) and literate, meaning they have received reading instruction through standard formal education and have no suspected or attested reading difficulties. They must have corrected-to-normal vision. They report having no attested reading or language disorders, whether developmental or acquired. They also report no intellectual disability or any psychiatric diagnoses.
For the collection of additional dataset(s), please choose from the following selection to further specify how the inclusion criteria of the participants for your additional data collection might have differed from the ones of the core data collection (i.e.: Participants for the MultiplEYE core data collection are native speakers of the language being tested in the experiment. They are adults (aged 18 or older) and literate, meaning they have received reading instruction through standard formal education and have no suspected or attested reading difficulties. They must have corrected-to-normal vision. They report having no attested reading or language disorders, whether developmental or acquired. They also report no intellectual disability or any psychiatric diagnoses.):
Same criteria as for core data collection, no other inclusion criteria added
Same criteria as for core data collection, but with the following inclusion criteria added
Different inclusion criteria as for core data collection
For the collection of additional dataset(s), additionally describe your participants in your own words (include information about age, gender, native language, any impairments and other relevant details):
16.4. Exclusion criteria:
For the collection of core dataset, we use the following exclusion criteria for participants (please check the following box, if applicable):
Participants must NOT be: 1) minors (i.e., younger than 18 years of age), 2) second language learners of the language of the experiment, 3) of low literacy (as indicated by absence of formal reading instruction, suspected or attested reading difficulty), 4) report language or reading disorders (neither developmental, e.g., dyslexia, reading or writing impairment, learning disorder, developmental language disorder, auditory processing disorder, expressive or receptive language disorder, language disorder associated with another medical condition; nor acquired such as cerebral palsy, childhood aphasia, aphasia, acquired dyslexia), 5) report any psychiatric disorders, 6) report any intellectual disability, 7) report sensory disability (e.g., be hard of hearing, deafness or blindness)
Add additional lab-specific exclusion criteria, if applicable, for example if you are completing this form for the collection of additional dataset(s):
Participants wearing glasses with more than one power: bifocals, trifocals, and progressives (e.g., varilux)Participants wearing glasses in general (participants were not allowed to wear any glasses)Participants wearing soft lensesParticipants wearing hard lensesParticipants had eye surgery: corneal (e.g., LASIK, RK), cataract, intraocular implantsParticipants with eye movement or alignment abnormalities: lazy eye, strabismus, nystagmusParticipants with eyelid ptosisParticipants with epiphora (wet eyes)
Is there anything you would like to add?
16.5. Participants are (please select the following options):
Native speakersWith corrected-to-normal visionOther population as a part of an add-on data collection
If participants belong to another population as a part of an add-on data collection, please specify below:
Non-native speakersParticipants with dyslexiaParticipants with aphasiaParticipants with other cognitive impairment
16.6. State your sampling method:
Note: MultiplEYE allow all kinds of sampling methods.
Sampling consists of every person who applied for the experiment participation and met the inclusion criteriaConvenience sampling(Simple) random samplingSystematic samplingOther (please specify further below)
Find here some information about convenience sampling, random sampling, and systematic sampling.
16.7. Provide the achieved sample size as total number of cases N:
Note: Include only samples which have completed at least one full trial (i.e., one experiment text plus comprehension questions; practice texts not included). Successful pilot sessions, previded they were reviewed and approved by the MultiplEYE team, can count toward the total sample as well.
Provide the total number of participants who have completed at least ONE trial (i.e., one reading task and its associated comprehension questions):
Provide the total number of participants who have completed at least ONE trial and each of the six psychometric tests mentioned in section 10.2. of this form:
Provide the total number of participants who have completed ALL trials (i.e., all reading tasks and their associated comprehension questions):
Provide the total number of participants who have completed ALL trials and ALL six psychometric tests:
17. Additional information about your dataset
17.1. Does your dataset include data of the 2 practice trials:
17.2. Is there any information about your data collection or dataset that you would like to add or comment on which has not been addressed yet?