Chapter 8 IRB
When you are considering doing research involving children, you will need the approval of the Institutional Review Board (IRB) of your institution. If this sounds unfamiliar to you, you can start by looking over the Wikipedia entry for IRB. We will not be covering the basics of IRB requests here, but instead, we’ll focus on information directly relevant to collecting long-form recordings.
8.1 Basic information for all IRB submissions
When you specify the methods, you can state that recordings are gathered using a device that is attached to the child’s clothes, followed by automated annotations with speech technology tools. Include in your request information about how data will be transferred from the device to a storage unit, and from their to at least one back-up not in the same site. See the Storage video for more information 11. We strongly discourage you from saying that you’ll collect the audiorecordings, analyze them, and then destroy them. This is because some of the risks that long-form recordings entail (security, discomfort at thinking about being recorded) have already happened, whereas several benefits can ensue from continuing to store and analyze the recordings (provided storage is safe and analysis is respectful, of course).
Consider also whether recordings will take place exclusively in the child’s home, or whether participants will also leave the home with the recorder on. In the latter case, your IRB may require you to provide evidence that you have checked that incidental recording is not against the law where the family lives. If it is legal, consider also how these data are going to be handled. Some researchers ask their participants to tell these others to get in touch with the researchers if they have questions. Others ask anyone who comes into contact with the device to read and sign a consent form.
You may be asked to specify why you are collecting the long-form recordings (e.g., collecting infant speech, investigating parental behavior, etc.) When doing so, please consider the fact that, when properly handled, these data can be incredibly rich and inform a variety of questions, all the while protecting the rights and well-being of participants. So unless there are strong reasons for you to specify a very narrow objective, then it is ideal to mention that recordings will be used for your research project as well as archived in scientific repositories for potential re-use for other research projects.
It is customary to include in an annex the actual consent form, or the consent speech used to explain the procedure to participants.
8.2 Additional considerations
In some cases, it is desirable to have humans annotate part of the data, to check accuracy of the algorithms and/or to help develop additional algorithms and/or to complement with more qualitative small-scale approaches (see Annotations video 15). If you are planning on doing this, remember to mention this in your IRB request. Consider the training of annotators (including on the ethics of recordings) as well as how you may deal with unexpected discoveries (of illegal acts, child abuse, etc.)
In addition to in-lab annotations, you can also opt for citizen-science annotations. You can see an examples of this technique here. In that study, we preserved anonymity of participants by extracting clips that were 500 ms long, and presenting listeners with clips extracted from many different children. This was possible because the decision we were asking for was very simple and could be taken with local information (e.g., who is talking: a baby, a child, or an adult?) An alternative that other researchers have selected is to have someone in the lab listen to sections of the audio and determine that there was no compromising information shared, and then these clips were annotated by citizen scientists for higher level content, based on listening to a whole sentence or even a whole conversation. If the latter seems interesting to you, then just make sure that your participants agree to this, since clips thus shared on Zooniverse become public.
8.3 Text you can use in your IRB requests:
8.3.1 Basic description
Participants will be asked to wear a <INSERT HERE NAME OF DEVICE (e.g., LENA, USB)> in
Recordings will be stored in a safe location, only accessible to individuals with appropriate training for such sensitive data.
8.3.2 Automated analyses
Given the length of these audios, they will not be studied in their entirety by a human researcher. Instead, they are processed with an automated system that assigns sections of the recordings to the child wearing the device, other children, male adults, or female adults. Additional automated processing classifies vocalizations as child-directed or overheard by the child (i.e. spoken to someone else); estimates the number of sounds, syllables and words in a turn; and/or decides whether a given vocalization is crying, laughing, or other vocal types. Thus, the content of what is said is not inspected.
8.3.3 Manual annotations for validation
To check that automated analyses are valid, sections of the audio will be extracted and human-annotated. Annotators will have training allowing them to treat these confidential and sensitive data appropriately. They will use a computer program to indicate who spoke when and to whom, transcribe what has been said to estimate the number of sounds, syllables, and words, and/or decide where whether a given vocalization is crying, laughing, or other vocal types – that is, the same levels that are used in the automated analyses. <DESCRIBE ANY ADDITIONAL PROCEDURES YOU FORESEE, LIKE REPORTING OF ILLEGAL ACTIVITIES, VETTING SECTIONS WITH SENSITIVE INFORMATION, ETC>
8.3.4 Manual annotations to augment dataset
To complement automated analyses, sections of the audio will be extracted and human-annotated. Annotators will have training allowing them to treat these confidential and sensitive data appropriately. They will use a computer program to
8.3.5 Manual annotations using Zooniverse – general
Zooniverse is a citizen science platform with hundreds of thousands of users in the world. It has led to significant discoveries, as individuals can contribute their time and expertise by annotating data in their free time. We created a project on Zooniverse that was approved by the Zooniverse board and released in February 2020. This project asks citizen scientists to help us classify children’s vocalizations in different types (crying, laughing, and two types of speech-like sounds differing in their maturity level). To this end, daylong audiorecordings are algorithmically processed to detect sections that contain speech. These sections contain identifying information (people’s voices) and may contain sensitive information (e.g., people’s names, intimate moments).
8.3.5.1 Section to add if using short clips
Therefore, we don’t have whole sections annotated, but instead cut these sections up into smaller clips with a procedure we explain next. Once the clips themselves are uploaded onto zooniverse they cannot be protected - they are on the web so they can be scraped. What we do is we render scraping uninteresting in several ways. First, we make the clips very short. In fact, we now extract .5s clips, so a 1.3s section attributed to the child will be represented by 3 x 500ms clips (adding some extra audio on the edges). So now, even if someone ill-intentioned gets some clips, they cannot guess that a 300ms one was probably part of a bigger one — all the clips are the same length. Second, we ramp intensity in and out of each clip throughout the first and last 5 milliseconds of the audio, which is enough to destroy the amplitude of the signal, a cue ill-intentioned people could use to “glue” clips together. Third, we upload many clips, from children of different ages, and different languages, all mixed together. So if anyone goes through the trouble of scraping them, they would face an incalculable problem of trying to determine which bits belong to the same section, the same recording, the same child.
8.3.5.2 Section to add if using vetting
Therefore, before uploading these audio sections, trained personnel will listen through and make sure that there is no sensitive information. Parents will have been informed about the fact that their voice may be recognizable and that clips enter the public domain, and will be able to opt in or out from this part of the research in the consent form.
8.4 Closing thoughts
This is a very short introduction to this important topic because there are already excellent resources available on this. Check out the resource section for links to consent forms examples, an example of a Data Protection Impact Assessment, and more information.
8.5 Resources
You will find sample consent forms from several labs on https://osf.io/d4tcu/
- In particular, if the reuse for ExELang would be after you archive the data in a scientific archive, you can simply have a section where you ask whether they want to opt out of data donation - https://osf.io/5e3vz/ has an example of an opt-out check-box under point 2
- If you’re uncertain about archiving, you can instead use the language under point 11 of the same consent form, the option is “Checking this box indicates my permission to store, use, and share my information from this study in research databases or registries for future research conducted by the current investigators and their research partners.”
Data Protection Impact Assessment (DPIA) for ExELang Project link
For more in-depth information on this topic, see:
- Cychosz, M., Romeo, R., Soderstrom, M., Scaff, C., Ganek, H., Cristia, A., … & Weisleder, A. (2020). Longform recordings of everyday life: Ethics for best practices. Behavior research methods, 52(5), 1951-1969. pdf
- Casillas, M. & Cristia, A. (2019). A step-by-step guide to collecting and analyzing long-format speech environment (LFSE) recordings, Collabra. See Appendix A “Further considerations for ethics and permissions in sensitive contexts”