A team of scientists from
Researchers are increasingly keen on carrying out psychological research remotely, so they can study cognition and behaviour when and where they naturally occur.
Remote methods also improve accessibility as participants are not required to travel to testing locations or meet face-to-face, an especially important consideration during the SARS-CoV-2 pandemic. However, it is still unclear how best to validate digital tools for remote clinical research.
Experts have been looking at various approaches to developing digital assessments for remote clinical research, which they discuss in a paper published in the
When creating any new psychological assessment, it is important that scientists ensure that the assessment accurately measures the concept, behaviour, or symptom that it intends to gauge. Part of this validation process is ruling out the possibility that changes to the outcome of interest are the result of external influences. Traditionally, when assessments are delivered in the laboratory, researchers ensure that an assessment is reliable by administering the assessment to the same person, in the same environment, at the same time of day on two different days produced two similar scores. Researchers decide that an assessment is valid if administering the assessment alongside a gold-standard assessment to the same person under controlled conditions produces scores that are consistent with each another.
'If an individual does not score similarly on an assessment taken at different time points, it does not necessarily mean that the assessment is unreliable,' said Dr
To increase the ecological validity such as generalizability to real life situations of research findings, web-based data collection has increased in popularity over the years. As long as participants can access a computer and internet connection and can spare at least five minutes, they are able to complete many types of cognitive tasks or questionnaires outside of the laboratory. Because researchers have less control over the environment in which participants complete web-based assessments, researchers have compared performance on the same assessments administered on the web and in the laboratory to validate web-based assessments.
To capture more granular changes in behavior over time and across settings, brief assessments (those that take a couple of minutes or seconds to complete) can be delivered on devices that individuals carry on their person including smartphones and smartwatches. However, it is more challenging to systematically evaluate web-based assessments that are administered in this way, as the research environment (ie time and space) is uncontrolled. Although it is possible to compare outcomes from a high-frequency field assessment to outcomes from a low-frequency laboratory assessment, scientists must consider that the contexts in which the data are being collected are very distinct from one another.
Therefore, the authors propose that a controlled environment may not be necessary, nor appropriate, to validate such flexible data collection tools. An alternative is to compare outcomes from a high-frequency field assessment to outcomes from another high-frequency field assessment, both administered in the same temporal and spatial context. Dr
'Using brief assessments allows researchers to collect data frequently, perhaps a couple of times per week or per day, without causing too much burden to participants,' said study author and Senior Research Associate at the
Paper
'Developing Digital Tools for
Further information
About
For further information, visit www.cambridgecognition.com.
(C) 2021 Electronic News Publishing, source