source("./keytime-setup.R")
The data may be downloaded from the project’s page: http://ns.inria.fr/loki/WordSuggestions/.
This table contains one row per participant. The different columns are as described below:
Participant Identifier.
The word suggestion accuracy condition.
The keytime accuracy condition, i.e. how long keys have to be pressed before they take effect.
The type of word suggestions used : inline or bar.
The start date and time of the run in ISO 8601 format.
The end date and time of the run in ISO 8601 format.
The duration of the run in seconds.
The self-reported age of the participant.
The self-reported gender of the participant.
Answer for “In the last 24 hours, how many word suggestions have you used when typing on a desktop computer?”.
Answer for “In the last 24 hours, how many word suggestions have you used when typing on a mobile device?”.
Agreement for “The controls (keyboard and word suggestions) are satisfactory for the completion of the task.” This was provided for each condition.
Agreement for “The word suggestions are accurate.” This was provided for each condition.
Agreement for “The use of the keyboard is efficient in this task.” This was provided for each condition.
Agreement for “The word suggestions are distracting.” This was provided for each condition.
NASA-TLX mental demand scale. This was provided for each condition.
NASA-TLX physical demand scale. This was provided for each condition.
NASA-TLX temporal demand scale. This was provided for each condition.
NASA-TLX performance scale. This was provided for each condition.
NASA-TLX performance scale. This was provided for each condition.
NASA-TLX effort scale. This was provided for each condition.
The number of suggestions showed to the participant. This is always 1.
Register the number of trials during which the page was unfocused, which is an indication that the participant may be distracted.
Register the number of typing trials during which the page was unfocused, which is an indication that the participant may be distracted.
TRUE if the experiment was completed.
One participant was removed because they misunderstood they though they had to use all suggestions. Another participant was removed because they participated more than once.
TRUE if the participant passed the attention test. If not, the participant is excluded from subjective and demographic analysis.
The reason why the participant was fully removed from the analysis.
This is only set if is_run_measured
is FALSE.
runs <- read_keytime_runs(measured_only = FALSE)
measured_runs <- runs |> filter(is_run_measured)
runs
This table contains data logs from all participant trials.
Participant Identifier.
The word suggestion accuracy condition.
The device used for the run.
The type of word suggestions used: inline or bar.
The number of the trial.
The identifier of the trial.
If the trial was part of a practice block.
The phrase participant had to type during the trial.
The number of character in the phrase to type.
The maximum number of keystrokes that could be saved using word suggestions during the trial.
The start date and time of the trial in ISO 8601 format.
The end date and time of the trial in ISO 8601 format.
The duration of the trial in seconds.
The number of keystrokes that were saved using word suggestions. This may be negative if incorrect suggestions were used.
The number of key that were pressed to complete the trial.
The number of suggestions that were used during the trial.
The number of incorrect suggestions that were used during the trial.
The number of characters that were manually entered then deleted by participant during the trial.
The number of characters that were inserted from a suggestion then deleted by participant during the trial.
The number of characters from the final participant input that were manually inserted.
The number of characters that were inserted during the trial either from suggestion or manual input (some may have been removed later).
TRUE if incorrect characters were inserted at some point during the trial (they had to be removed later to validate the trial).
The date and time where the first character was inserted during the trial (ISO 8601 format).
The date and time where the phrase was fully completed and correct for the first time (ISO 8601 format). Note that this is before the trial was validated.
The time it took for the participant to complete the phrase in seconds.
The number of times the experiment web page was unfocused during the trial.
TRUE if total_blur_events > 0
The maximum key stroke saving of the trial. This should be close from
accuracy.
The key stroke saving excluding errors.
The key stroke saving.
Entry speed in characters per second
(i.e. (total_chars - 1) / trial_duration
).
If the run including this trial was included in our statistical analysis.
If this trial was included in our statistical analysis. See below for reasons to exclude a trials from our analysis.
The reason for excluding the trial from the analysis. This is only provided for trials that were excluded.
trials <- read_keytime_trials(measured_only = FALSE)
measured_trials <- trials |> filter(is_trial_measured)
trials
This large table contains all event logs recorded during our experiment. It includes the following columns:
The participant identifier.
The accuracy condition.
The keytime condition.
The type of word suggestions used: inline or bar.
The trial identifier.
The number of the event in the trial.
The type of the event. INIT: trial initialization, UPDATE_SUGGESTIONS: update of the suggestions, INPUT_CHAR: manual insertion of a character by the participant at the end of their input, DELETE_CHAR: removal of the last input character by the participant, INPUT_SUGGESTION: insertion of a suggestion.
The content of participant’s input after the event.
If there is no errors in the input after the event.
If the event results from an error, such as choosing an incorrect suggestion or entering an incorrect character.
The characters added to the input as a result of the event.
The characters removed from the input as a result of the event.
The number of characters added as result of the event (may be negative).
The number of character left to complete the phrase.
If the phrase is completed.
The date and time of the event (ISO 8601 format).
Duration between this event and the previous one.
The action that was scheduled for this event due to the keytime condition.
If the run including this event was included in our statistical analysis.
If the trial including this event was included in our statistical analysis.
If this event was included in our statistical analysis.
The reason for excluding the event from the analysis. This is only provided for events that were excluded.
The suggestion that was inserted as a result of the event.
The next word to type or the word currently being typed.
The number of the target word in the phrase.
measured_runs |> count(suggestions_type)
measured_trials |> count(suggestions_type)
The following trials were removed because the participant was interrupted (the page was unfocused).
trials |> filter(is_run_measured & !is_practice) |>
count(suggestions_type, was_trial_blurred) |>
add_count(suggestions_type, wt = n, name="total")
In addition, the following participant were fully removed from our analysis because they unfocused the page for more than 2 trials.
runs |>
filter(is_run_completed) |>
count(suggestions_type, run_rejection_reason)
Finally, the following participants were removed from the demographics and subjective analysis because they did not pass the attention test during the questionnaire (however their objective data was kept).
runs |> filter(is_run_measured) |> count(suggestions_type, is_participant_trusted) |>
add_count(suggestions_type, wt = n, name="total")