Research context

Citizen science (CS) has been rapidly gaining popularity over the past several decades (), as public participation can increase both the scale of environmental research and public engagement in environmental issues. Benefits also have been demonstrated for CS participants themselves, including increased understanding of science, awareness of the local environment, and confidence to participate in scientific activities (Bonney et al. 2009; ; ; ; ; ).

As CS participants also have demonstrated increased knowledge and self-efficacy to address local environmental problems, CS may serve as an advocacy tool for disenfranchised communities burdened by environmental health risks, henceforth “environmental justice (EJ) communities,” to strategically address local environmental health risks (; ; ; ; ; ; ; ). However, as members of EJ communities are more likely to have disproportionate demands placed on their time and resources, those most likely to be affected by environmental health stressors may be the least likely to participate in research to address it (; ; ). Additionally, potential economic, cultural, and racial barriers to relationship building between academic researchers and EJ community members increase the possibility of unsuccessful community engagement, or even exacerbating harms to community members (; ; ).

Parallel to the recent rise of CS, other community-driven approaches are being increasingly employed in environmental health research. These approaches, such as community-based participatory research (CBPR) and participatory action research (PAR), emphasize close partnership between the research institution and EJ community to address community-identified interests and issues (; ; ; ). In some cases, EJ communities have self-organized to conduct research and take action against environmental health risks without the backing of a research institution (; ; ; ). These examples overlap with CS approaches that emphasize participant involvement, such as collaborative/co-created CS (Bonney et al. 2009; ) and extreme CS (), and offer important guidance on successful engagement between research institutions and EJ communities (; ; ).

While CBPR or PAR for environmental health is often conducted with communities of color, volunteers CS projects initiated by research institutions are predominantly college-educated and white (; ; ; Pandya 2012a; ). Prior studies on CS participant engagement and motivation have recognized this demographic homogeneity in their participant population (; ; ; ; ). This has limited understanding of how non-white or non-college educated individuals might be better engaged in CS projects. As practitioners across the CS spectrum aim for increased participant diversity and equity (Pandya 2012b; ; ), considering the influence of “dispositional variables” such as education level and income () and learning from the experiences of current diverse CS participants could facilitate this understanding.

Prior research provides recommendations for conducting environmental health CS projects, but these recommendations lack direct program participant input (; ; ). In the study herein, 120 demographically diverse participants and 7 promotoras (community health workers) in Project Harvest, an ongoing co-created CS project, contribute their perspectives toward the following research questions: 1) What are participant motivations, support structures, and barriers to participation in an environmental health CS project? 2) Are there demographic or community-specific differences in how Project Harvest participants are motivated to participate, receive support, or experience barriers to participation?

For the purpose of this study, motivation is defined as what influences an individual’s decision to sign up and engage in the initial stages of the project (; ; ). Support distinctly refers to influences that sustain participation in the project. Self-efficacy (SE), defined as one’s perception of their own capability, was considered a related measure of support, as SE beliefs “determine how people feel, think, motivate themselves and behave” (). Findings of this research build on existing literature related to CS participant experience, motivations, and engagement (; ; ; ; ; ; ; ; ) to inform a “deliberate design” () for engaging diverse CS participants.

About Project Harvest

Project Harvest ( was launched in 2017 as a collaborative effort by researchers at the University of Arizona (UA) and the community-based organization Sonora Environmental Research Institute, Inc. (SERI), to facilitate community-led environmental monitoring in four geographic areas of Arizona, USA, with known sources of environmental contamination. Primary project goals are to produce local data on contaminants present in harvested rainwater and in rainwater-irrigated soil and food plants; increase community involvement in environmental decision-making; and increase environmental health literacy in underserved rural and urban communities.

Project Harvest is a co-created CS project (), for the following reasons: 1) The central research question, to determine the degree of health risk or safety in harvested rainwater and rainwater-irrigated soil and food plants, originated from the voiced concerns of community members in Dewey-Humboldt, AZ, during participation in a previous CS project (); 2) Research design and project proposal were collaboratively crafted by UA researchers and SERI; 3) Throughout the project, feedback from SERI staff, promotoras, and participants continues to inform responsive modifications in project methods. Project Harvest is in its 2nd year of participatory data collection at the time of this writing.

Project Harvest promotoras

The promotora model of health promotion is a strategy that has been successfully used in disempowered communities to increase community-level knowledge of health impacts and health behavior (; ; ). The Spanish term promotora, commonly defined in English as community health worker, refers to community members who share information with peers in culturally appropriate settings using culturally appropriate communication methods.

Applying experience from prior applications of this model in environmental health contexts (; ), Project Harvest employs promotoras as the designated educators and support persons for participants. As SERI staff promotoras have previous in-depth experience with residents in the urban participant communities, four SERI promotoras were designated to support these participants through an inter-organizational agreement. For the three rural communities, promotoras were recruited through public community training events, described further below, and through local organizational partners.

Two Project Harvest promotoras are predominantly Spanish-speaking, one is fluent in English and Spanish, and four are predominantly English-speaking. With the exception of one promotora who has lived in her rural community for only three years, the promotoras have lived in their communities for at least a decade, with one being a 4th generation resident. Professional backgrounds are diverse, including teaching, government program administration, and community organizing. Level of education in the group spans from high school diploma to graduate degrees. Each promotora supports 15–25 participant households throughout the three years of the project.

Project Harvest communities and participants

The geographic locations of partnering communities in Arizona, USA are illustrated in Figure 1. Three locations–Dewey-Humboldt, Globe/Miami, and Hayden/Winkelman are considered rural, while Tucson is considered urban. Following established recommendations for community-based participatory research (CBPR) (), communities were defined as a unit of identity, rather than by municipal boundaries. For this reason, in two of the rural geographic areas, neighboring municipalities that share histories, sources of environmental health risk, and cultural attributes were defined as one community. In the urban area of Tucson, however, two distinct communities were defined by how they were recruited to the project. As SERI’s organizational focus is low-income households, participants recruited directly by SERI are predominantly low-income and Spanish speaking. Other Tucson participants were recruited through the water utility (Tucson Water) as former recipients of a rainwater harvesting rebate program, and are predominantly non-low-income, college educated, and English speaking.

Figure 1 

Geographic locations of Project Harvest communities in Arizona, USA.

Initial community outreach and participant recruitment took place through public trainings facilitated by project staff in the four selected areas, which incorporated participants’ knowledge and lived experiences to co-create training content on rainwater harvesting and environmental contamination (). Of the workshop participants who were interested to sign up with Project Harvest, however, many were ineligible due to the requirements that participants live in specific geographic areas and harvest rainwater at home. The majority of the Project Harvest participants were recruited through their promotora or a local community organization. Participants in Project Harvest overall are economically and racially diverse, with just over 50% 1) self-identifying as low-income or below based on HUD guidelines; 2) self-identifying as a non-white race/ethnicity (predominantly Latino/Hispanic); and 3) not having a college degree. Additionally, 25% speak Spanish as their primary language. As each partnering community is unique, however, characteristics and demographics of each defined community are illustrated in Table 1.

Table 1

Project Harvest communities and participants.

Community; # Active ParticipantsCity/Town, County, Population1 Participant Recruitment MethodsParticipant Race/Ethnicity; Language4 Participant Low-Income (LI) Status4 Participant Education Level Range and Median4 Local Environ-mental Health Risk Sources

Tucson SERI (TS)
N = 55
Tucson, Pima, 520,116Recruited through community-based partner organization SERI, who works with low-income Tucsonans on environmental health issues.80% Latino/Hispanic
7% White
4% Multiple Races
78% Spanish
16% English
73% LI
9% Non-LI
Range: Elementary to bachelor’s degree
Median: High school
Multiple Toxic Release Inventory (TRI) sites including Tucson Interna-tional Airport Area Superfund Site and an unlined landfill. Aircraft and electronics manufacturing have largely contributed to trichloroethylene (TCE) and other contaminants observed in soil, groundwater, and municipal water (; ).
Tucson Water (TW)
N = 38
Tucson Water recruited via email to past recipients of a rainwater harvesting system rebate. Interested respondents were screened via phone by SERI staff.69% White
8% Latino/Hispanic 5% Asian
5% Multiple Races
84% English
3% Spanish
16% LI 68% Non-LIRange: High school to graduate degree
Median: Graduate degree
Dewey-Humboldt (DH)
N = 12
Dewey-Humboldt, Yavapai, 3,894Participants recruited at community training and by promotora.
UA researchers had prior community relationships through other participatory research projects (; ).
58% White
8% Multiple Races
8% Other
83% English
33% LI
33% Non-LI
Range: Some college, degree not completed, to bachelor’s degree
Median: Trade or technical school
Iron King Mine – Humboldt Smelter Superfund Site includes approximately four million cubic meters of mine tailings from legacy mine and smelter.
Documented dioxin spraying in Pinal Mountains in the 1960s ().
Arsenic level in home drinking water observed above.
EPA drinking water standard in 2013 ().
Globe/Miami (GM)
N = 25
Globe and Miami2, Gila
6 participants recruited through community training, others through outreach by promotora and Gila County Cooperative Extension.72% White
16% Latino/Hispanic
8% Asian
96% English
44% LI
36% Non-LI
Range: High school to bachelor’s degree
Median: Trade or technical school
Two active open pit mines, active smelter and rod mill, and legacy mine in Miami. Additional active open pit mine 15 mi outside of study area in Superior, AZ.
Mountain View Mobile Home Estates site in Globe was on the Superfund Program’s National Priorities List (NPL) for asbestos contamination of soil and groundwater until clean-up activities completed in 1988.
Hayden/Winkelman (HW)
N = 21
Hayden and Winkelman3, Gila, 1,015Prior relationship between community and university through National Institute of Environmental Health Sciences Superfund Research Program partnership.
School superintendent promoted teacher involvement. Most participants recruited directly through promotora.
76% Latino/Hispanic
10% White
86% English
33% LI
48% Non-LI
Range: Middle school to bachelor’s degree
Median: Some college, degree not completed
ASARCO Hayden Plant Alternative Superfund Site, includes the ASARCO smelter, concentrator, former Kennecott smelter and all associated tailings facilities.
In 2016, ASARCO was involved in a $150 million settlement with the US Department of Justice and US Environmental Protection Agency for violations of the Clean Air Act. ()

1 Data obtained from 2010 US Census.

2 These neighboring municipalities are considered as one community in this study, though they are separate municipalities (City of Globe and Town of Miami).

3 These neighboring municipalities are considered as one community in this study, though they are separate municipalities (Town of Hayden and Town of Winkelman).

4 Participant data may be missing (percentages do not sum to 100%) due to participants choosing not to answer a survey question or choosing not to consent for human research.


To understand motivation, support, and barriers to CS participation, data were collected directly from 120 Project Harvest participants via telephone interviews, open-ended surveys, rank scale questionnaires, focus groups, and email/phone communications from participants. Data from these four data sources were aggregated, controlling for repeated participants, and analyzed using mixed methods including thematic coding and descriptive statistics. Additionally, feedback was solicited from the seven promotoras via telephone or in-person interviews, to triangulate participant data. Participants and promotoras were consented under the University of Arizona IRB as an approved project. All interview, survey, and focus group questions were developed by a subgroup of the Project Harvest team, defined as a “complex team” () dedicated to participant learning research (learning research team), which includes the project PI, external project evaluator, lab manager, and three graduate student research assistants. Semi-structured interview questions were scripted based on established guidelines (; ), and qualitative coding performed based on established literature (; ; ; ).

Participants also completed a rank scale item survey related to self-efficacy (SE) at their initial training in the project, and again after one year of participation, to measure self-efficacy as a related indicator to support in participation. Finally, cited reasons for participant resignation were documented and analyzed as a related indicator for barriers to participation. Statistical analyses were conducted to determine any significant differences between communities and demographic groups, related to SE, resignation from the project, or within participants expressing common themes identified from qualitative data.

A timeline of data collection activities is illustrated in Figure 2. Table 2 summarizes the sources of data by research questions they addressed and analysis methods used. Data collection and analysis methods are described by each data source in greater detail below.

Figure 2 

Timeline of Project Harvest data collection activities.

Table 2

Summary of data sources and analysis methods.

Data Sources

Research questionParticipant phone interviewsParticipant Year One surveyParticipant focus groupsOther participant communication Promotora interviewsParticipant Self-efficacy (SE) surveyReasons cited for participant resignation

What motivates Project Harvest participants to join the project?xxxxx
What supports participants in their continued participation?xxxxxx
What participant barriers deter participation?xxxxxx
What are the differences in motivation, support, and barriers between community or demographic groups?xxxxxxx
Analysis Methods– Data aggregated across multiple sources, controlled for repeat participants
– Qualitative coding for themes
– Chi square tests conducted to determine significant different between community or demographic groups
– Cramér’s V calculated for every Chi square analysis to measure effect size
– Qualitative coding for participant themes; compared to participant data
– Qualitative coding for promotora themes
– Paired samples t-test used to measure change in SE over first year of participation
– Kruskal-Wallis test used to determine significant difference in SE (PRE, Y1, and PRE-Y1 change) between communities. – Mann-Whitney U tests used to determine significant differences in SE (PRE, Y1, and PRE-Y1 change) between demographic groups.
– Data compiled by reason for resigning
– Chi square tests conducted to determine significant difference between community or demographic group representation within the group of resigned participants

Phone interviews with participants (N = 73)

Four members of the learning research team attempted to contact all active participants (N = 144) by phone in August 2018, after most participants had completed at least one sampling season and before data-sharing events were held. The semi-structured interview script (Appendix A, supplemental files) aimed to solicit participant feedback on training, project materials, sampling methods, data reporting methods, and overall experience. Fifty three English-speaking and 20 Spanish-speaking participants were reached and willing to participate in an interview. Interviews were conducted by phone in the participant’s dominant language and lasted between 8 and 45 minutes. To increase response rate and maintain an informal atmosphere, the interviewer took detailed notes rather than recording interviews.

Participant “Year One” surveys (N = 87 Y1 surveys)

Project Harvest participants complete written surveys annually, designed to measure an array of participant outcomes, including science literacy, environmental literacy, numeracy, environmental action, and community building, which relate to research questions of the project not addressed in this study. Promotoras were trained in survey administration during onboarding, and surveys were administered by promotoras as part of a home visit in the participant’s dominant language.

Responses to one open-ended question, included in the survey administered after one year of participation, were included as data for this study. This open-ended question reads: “Since starting with Project Harvest, have you learned anything new? Please write any new ideas, observations or questions you have about …,” followed by the headings 1) Rainwater Harvesting, 2) Rainwater Contamination, 3) Human Health and the Environment, 4) Doing Experiment or Taking Samples, and 5) Other. Although this question was designed to assess participant perceptions of their own learning, responses were included in the data set as many responses addressed elements of the study which supported or frustrated participants.

Data sharing event focus groups (14 groups, total N = 50)

Two data sharing events have been conducted in each of the four communities at the time of this writing. These serve as social events for participants to meet, receive results from their own rainwater samples and community aggregate data, and discuss data with Project Harvest staff and each other. Following time to view personalized data reports and a staff presentation on data interpretation, participants met in focus groups of 2–5 with two staff facilitators per group. Facilitators followed a semi-structured interview script (Appendix B, supplemental files) to guide the group in interpreting results related to rainwater risk or safety, as well as solicit participant feedback on their experience of receiving and interpreting their data, and any changes they plan to make based on data received. In almost every group, participant discussion and questions also emerged related to project methods and rationale, as well as participant experience in other aspects of the project. Focus group discussions were recorded and professionally transcribed, and transcriptions were reviewed by the interviewer/facilitator and corrected for accuracy.

Other participant communication (N = 12)

Unsolicited participant feedback about project experience via phone, email, or in person communication to the principal investigator or lab manager was documented by the staff member involved in the communication and compiled by the learning research team as part of the participant data set.

Data from sources 1–4 above were aggregated and analyzed using established mixed methods (). Some deductive codes were created based on collaborative discussion and observations from learning research team members. From emergent themes in the data, a coding team of three members created a codebook to capture main concepts and coded all data for themes using NVivo qualitative analysis software (QSR International Pty Ltd. Version 11, 2017). Early in the process, the coding team compared individual coding on a subset of 25 responses to a survey question, and on two focus group transcripts, and observed 88% agreement, suggesting acceptable inter-rater reliability (; ). The team met throughout the coding process to revisit codebooks, sometimes choosing to create or merge code categories based on inductive themes in the data. The first author supervised coding activities for consistency and met regularly with the learning research team to discuss coding themes, trends, and examples, to collaboratively discuss results and interpret findings. Under each of the three parent codes, “Participant motivation to sign up/start participating,” “Participant support in participating,” and “Participant barriers to participating,” a set of child codes was developed for each that reflected what was observed in the data. Quantity of participant communications, as well as non-emergence of new themes towards the end of the coding process, suggests data saturation to adequately address the research questions (; ; ).

Following the coding process, all data were migrated into SPSS quantitative analysis software () with thematic codes by data source coded to specific participants. From this, we were able to calculate frequencies of participants who expressed each theme, by data source and as a combined frequency over all four participant data sources.

To understand if participants from different demographic or geographic groups may be motivated, supported, or discouraged differently in the project, Chi square tests were performed to assess correlation within participant groups expressing each child code theme to different demographic groups. For each child code category, we tested for correlation to participant groups by defined community (TS, TW, DH, GM, HW), self-identified race/ethnicity (White/Caucasian, Latino/Hispanic, Asian/Asian-American, Multiple, and Other were represented), income level (“low-income” or “non-low-income” according to 2015 HUD guidelines), and education level (4-year college graduates or higher compared to non-college graduates). All demographic data were self-reported by participants and collected via a survey administered by the promotora at the first home visit. Participants who did not report a certain demographic characteristic were removed from the data pool prior to demographic analyses. Of 120 total contributing participants, 19 did not report race/ethnicity, 21 did not report household income, and 41 did not report highest level of education achieved. To determine correlation in binary demographic categories (income and education level), Chi square tests were sufficient to produce a p value to indicate if one of the two demographic groups were either under- or overrepresented in the theme group beyond what would be expected by the null hypothesis. For demographic categories with more than two groups (community and race/ethnicity), if the Chi square test produced a statistically significant result, post hoc testing was performed to determine which demographic group(s) were either under- or overrepresented in the theme group beyond what would be expected by the null hypothesis using adjusted residuals to reduce the chance of Type 1 error (; ). In an effort to not rely solely on statistical significance in making meaning of the data (), Cramér’s V also was calculated for every Chi square analysis to measure effect size (). All statistical analyses were performed using SPSS quantitative analysis software ().

Individual interviews with promotoras (N = 7)

As each promotora is herself a member of her participant community and has frequent communication with participants, promotoras were interviewed to solicit motivations, support, and barriers experienced personally, as well as what they observed in their participants (Appendix C, supplemental files). These interviews were conducted in January 2019, two years into promotoras’ participation in the project, after rapport and trust had developed with research staff. Interviews lasted from 35 to 75 minutes and were conducted in the promotora’s preferred language by a research assistant. Promotora interviews were recorded and professionally transcribed, and transcriptions were reviewed by the interviewer/facilitator and corrected for accuracy prior to analysis.

As promotora data served to triangulate participant data, the same team coded these transcripts themes following the codebook developed from participant data, as well as independently coded for themes related to the promotora herself, using NVivo qualitative analysis software (QSR International Pty Ltd. Version 11, 2017). Frequency of participant themes expressed was compared to frequency of themes in participant data.

Participant surveys, administered annually by promotoras as part of a home visit in the participant’s dominant language, include rank scale items modified from a validated survey instrument developed by Cornell Lab of Ornithology () to measure self-efficacy (SE) in adult citizen science participants. Survey items for learning science (four items) and SE for doing science (four items) were modified per instructions given by the instrument creators to relate directly to environmental quality monitoring and included in both pre-participation (PRE) and year one (Y1) surveys (Appendix D, supplemental files). These data allowed for assessment of participant baseline and mid-participation SE, as a related measure to participant support. Paired samples t-test was used to assess change in self-efficacy over the first year of participation.

A Kruskal-Wallis test was used to determine significant difference in SE (PRE, Y1, and PRE-Y1 change) between communities. Mann-Whitney U tests were used to determine significant differences in correlation of SE (PRE, Y1, and PRE-Y1 change) to race/ethnicity (White/Caucasian or Latino/Hispanic), income level (“low-income” or “non-low-income” according to 2015 HUD guidelines), and education level (4-year college graduates or higher compared to non-college graduates).

Reasons cited for participant resignation (N = 23)

Reasons cited by participants choosing to resign from the project (N = 23), communicated directly by the participant to project staff or their promotora, were tracked as additional data to inform study design aspects that may create barriers to participation. Primary reasons cited for resigning were aggregated by number of participants citing. A Chi square test was used to assess any correlations between resigning from the project and any community or demographic groups.


Motivation, support, and barriers for promotoras

Frequency of themes expressed by more than one promotora related to their own motivation, support, and barriers to success in their role is illustrated in Table 3. Project Harvest promotoras are paid staff, and 4 of the 7 promotoras were contracted through their employing organization, so different motivations and experiences from volunteer participants were expected. However, 5 of the 7 promotoras talked about the relationships with their community members as the most rewarding part of the job, and the connection to project personnel was the second most frequently described motivation. Similarly, the most frequently cited support to promotoras was activities where project team collaboration occurred, highlighting personal relationships and team membership as critically important. As an example, one rural promotora described having initially seen the job listing but not considering applying due to her non-science background. However, after personally meeting and talking with the project PI in Spanish during a public training event in her town, she applied.

Table 3

Theme frequency in promotora motivation, support, and barriers.

Parent Code: Promotora motivation

Child CodeExample of Child Code# Promotoras Citing (N = 7)

Connection to community“The rewarding part is all the connections that I have got with my participants, the relationship. …So all these connections with people in the community- I have been privileged to be let into their homes.” – Promotora 55
Connection to project purpose and personnel“Being able to come onsite to Tucson and see the lab and see the people and, like, how I think our data-sharing was good for the participants to see us and you know what happened, was good for me to see you know what happens once I give you stuff or who are people, and names on the phone or faces, voices on the phone seeing names and people in person. Definitely make, I think, any project better. I liked the external board meeting, how that whole day went and again learning a lot about that here were people who felt our work was a value.” – Promotora 64
Facilitating participant learning“For me the best part that I like is actually making the- Going over and watching them perform the experiment. For them to do the experiment for them to put on the gloves and for them to actually look at the results, because a lot of these people have lived in the community for a while. So for them to be interested in their environment and what’s going on has been really motivating to me. For them to be more become more aware of their surroundings.” – Promotora 73
Interest to learn about CS“Interested in how you design something like this.” – Promotora 33
Project is interesting/want to learn“It’s interesting for me …because I am also learning much more than just the course we took at the beginning of the training we took.” – Promotora 1 (Translated from Spanish)2
Parent Code: Promotora support

Child CodeExample of Child Code# Promotoras Citing (N = 7)

Group membership“I’ve wanted to stay involved because of your team- [Project Harvest staff] is amazing and everyone in your team is great.” -Promotora 3 “Then I was surprised when they gave us the certificate, even I, who was a promotora, said, ‘Wow, so cool I’m a scientist!’ That also motivates us.” – Promotora 24
Adequate training and preparation“I mean… l never felt like I was doing something and didn’t have the right tools. Because you gave them to us. Making sure we were very well trained and you know because I had participants that say, how come you [can] do [the experiments]? You know I said I well we had a lot of training and a lot of practice!” – Promotora 72
Parent Code: Promotora barriers

Child CodeExample of Child Code# Promotoras Citing (N = 7)

Challenges recruiting/engaging local community“I’ve put up flyers have gotten no response. Businesses- No response. One is the librarian because we hold our events there.” – Promotora 65
Computer use barrier“And that’s the frustrating part for me because … computers didn’t come to [the community] til the maybe the last five years I want to say. We weren’t accountable to be using the computer all the time. We had to have a hard copy of everything and so I’m still kind of like old school I guess… On the computer I can spend 20–30 minutes trying to figure out what I did wrong and never get to do what I wanted to do.” – Promotora 73
Parent Code: Promotora barriers

Child CodeExample of Child Code# Promotoras Citing (N = 7)

Project feedback not considered“I was there because when I attended the training in Tucson, in two different opportunities, we were invited to make comments. But those comments that we made didn’t translate to the [participant instruction] books before they were printed. So it was… I think they were kind of behind in their deadlines. But that was, for me, was something frustrating.” – Promotora 53
Project methods changed after training“The instructions- to me it’s not a problem- but maybe because of the, well that in the training it was all completely differently set up.” – Promotora 63
Misconceptions about roles within project team“They stopped having one group meeting and they divided it. And so I am fine with the English speaking meetings which is nice. But I always wonder why … If we would say we [are] all treated equally, the promotoras. So that is something that has been hard for me to deal with internally.” – Promotora 52
Participant protocol more complicated than expected“And I read the book I read all the protocols and I went to [the Project Harvest] half day training and I still…I know that you just fill the bottles but I still don’t feel comfortable.” – Promotora 42

The majority of promotoras cited unforeseen difficulty in recruiting participants as their main frustration. Additionally, three of the seven promotoras experienced difficulty using project-provided ipads and web-based project survey and reporting tools, even after one-on-one training. As discussed further below, participants of these three promotoras were also more likely to experience difficulty with web-based project resources themselves. Despite the collaborative nature of the team and frequent communications, distance communication relied heavily on conference calls, often in English and Spanish. This presented challenges in maintaining consistent transparency between university-based staff and promotoras, which may have contributed to themes cited about frustration and confusion with internal processes.

Motivation to participate in Project Harvest

Frequency of themes observed in participant motivation, with noted significant differences observed for any demographic group (community, race/ethnicity, household income level, education level), is illustrated in Table 4. The most frequently observed motivations were 1) a positive attitude about rainwater harvesting and/or home gardening (38%), and 2) the desire to know about contaminants in the local environment (24%), both of which relate to the specific study content. Motivation from interest to learn about the topic, environmental/health concerns, and wanting to contribute (to science, the environment, or the community) were other motivations cited by 9–25% of participants.

Table 4

Participant motivation theme frequency and difference by group.

Parent Code: Participant Motivation

Child CodeExamples of Child CodeTotal Contributing Participants (N = 120)Significant Difference by Group1 Omnibus Significance and Effect Size2 # Promotoras citing theme (N = 7)

Positive attitude about rainwater harvesting or gardening“Rainwater is good for my plants, it has a lot of nutrients and it helps them grow more quickly.” -T104 (Translated from Spanish)
“People like the idea of saving water and they’re very enthusiastic about participating.” – Promotora 4
(N = 46)
*TS (+) (50%)(N = 23)
*TW (+) (24%)(N = 11)
*Community φc = .3322
Want to know contaminants in local environment“Looking forward to results- I expect most contaminants will be onsite rather than environmental/airborne. I look forward to getting my hypotheses tested.” -G41324%
(N = 29)
*Non-low-income (+) (59%)(N = 17)*Income level φc = .215
Project is interesting/want to learn“Well, it’s been very interesting for me and the program you present is what we’re going to be seeing in the lab, too. It’s something, well, we keep learning.” -T161 (Translated from Spanish)21%
(N = 25)
*College grads (+) (40%)(N = 10)*College grad φc = .240
Health risk concerns“I live … below the Pinal Mountains, where it was sprayed with Agent Orange and lots of people here have cancer. I am curious and concerned about what might be in our soil.” -G42416%
(N = 19)
*GM (+) (42%)(N = 8)*Community φc = .3631
Contribute to scientific research“Collecting data for the UA and public to be informed about our environment is my main motivation.” -G41213%
(N = 17)
*Non-college grads (–) (6%)(N = 1)
*White (+) (82%)(N = 14)
*Latino (–)
(12%)(N = 2)
*College grad φc = .426
*Race/ethnicity φc = .350
Contribute to the environment“It is important we better understand rainwater harvesting because we will be needing more of it when there is less water in the Colorado River” -T128 (Translated from Spanish)12%
(N = 15)
None observed1
Connection to project purpose“I think one of the most important things is the participants feel like they’re something- the need to feel like you’re something, you’re part of something bigger. You feel like you’re contributing.” – Promotora 49%
(N = 12)
None observed4
Connection to the community“Air and water quality impacts everyone in our community. These studies are very important.” -H2039%
(N = 11)
None observed3

1 Groups indicated are significantly different (p < 0.05) in their representation in the theme compared to other group(s). Directionality of difference is represented by (+) for greater representation than expected by the null hypothesis or (–) lesser representation than expected by the null hypothesis.

2 Effect size represented using Cramer’s V (φc). Effect sizes included for significant results (p < 0.05) indicated with *, and for non-significant medium or large (>0.3) effect sizes.

Significant differences in participant motivation were observed between communities. Participants motivated by rainwater harvesting or gardening enthusiasm were predominantly Tucson residents (50% from the TS community and 24% from the TW community), which relate to cultural popularity of these activities in Tucson. GM participants were more likely to cite health concerns as a primary motivation, and the GM promotora was the only one to express health concerns as a personal motivation to get involved. This motivation aligns with the local history of environmental contamination (see Table 1) and a recent local awareness of environmental health risk prompted by recent EPA actions ().

Within the participant group motivated by contribution to science, White participants were overrepresented, while both Latino/Hispanic participants and participants without a college degree were underrepresented. Similarly, only a promotora working with the predominantly White and college-educated TW community cited contribution to scientific research as an observed participant motivation. Additionally, participants with college degrees were overrepresented within the group motivated by personal learning, and non-low-income participants were overrepresented within the group motivated to find out about contaminants in the environment. These results suggest that the motivation of gaining knowledge (unrelated to a perceived risk) may resonate more with higher socioeconomic status participants, while low-income individuals may be more motivated to address a potential risk.

TS community participants are also recipients of a low-cost rain barrel through community-based organization SERI’s low-income rainwater harvesting program. Both TS promotoras expressed their participants may have signed up for Project Harvest because of previous relationship with, and perceived sense of obligation to, the community-based organization, rather than any motivation related to the project itself. This may have affected demographic distribution in motivation theme groups, as TS community members (majority Latino/Hispanic) predominantly cited motivations related to rainwater harvesting rather than those related to environmental contamination or receiving data. Notably, social allegiance could also serve as a barrier to participation. Rumors that Project Harvest aimed to damage the local mining corporation, a major employer, was described by one rural promotora as a significant challenge to recruitment: “I wasn’t able to recruit people that speak Spanish in my area … because of this perception that we--the program--was going to find things that were damaging to the mine and then that will be the issue later. I think that had a lot to do with not getting more people into the program.”

Participant support

Figure 3 illustrates mean scores for self-efficacy (SE) for science for participants pre-participation (PRE) and after one year of participation (Y1), by demographic and geographic groups. Pre-participation SE was high (average 4.0 on a 1–5 scale) and did not change after one year. There was no significant difference in pre-participation SE, or change in SE after one year, observed by community, race/ethnicity group, household income group, or education level group, respectively.

Figure 3 

Project Harvest participant mean self-efficacy for science by community and demographic group.

Frequency of themes observed in participant support, with noted significant differences observed for any community or demographic group, is illustrated in Table 5. Direct communication to interpret results was most frequently cited as important participant support, with no significant differences between communities or demographic groups. This direct communication, as well as Receiving/Understanding results, also commonly cited as an important participant support, predominantly occurred at data sharing events. Comments coded for these two themes describe in-person discussion of results as both increasing participants’ sense of connection to the project and serving as a powerful incentive to follow sampling procedures carefully and correctly.

Table 5

Participant support theme frequency and difference by group.

Parent Code: Participant Support

Child CodeExample of Child CodeTotal Contributing Participants (N = 120)Significant Difference by Group1 Omnibus Significance and Effect Size2 # Promotoras citing theme
(N = 7)

Direct communication with project staff to interpret dataPH staff: You spray the house with what?
T158: With something for the bugs.
PH staff: …maybe you could also tell us the type of [pesticide] you use and in the lab we can check if that spray–
T158: If it’s contaminating… I will send you a picture.
(N = 49)
None observed
Initial home visit training with promotora“[Promotora] was very good at showing us what to do.” -H21840%
(N = 48)
*Non-college grad (+) (56%) (N = 27)*College grad φc = .235
Promotora support“Insecure while we’re doing it…but I call my promotora and she helps me.” -T169 (Translated from Spanish)28%
(N = 33)
*GM (+) (36%)(N = 12)
*TW (–)
(6%)(N = 2)
*Community φc = .3484
Direct communication with project staff to clarify methods“Asked questions about when to upload results, whether to wash experimental vials, and if there is anything to get back to [her promotora].” -Staff notes on conversation with D30823%
(N = 27)
*DH (+) (26%)(N = 7)
*TS (–) (7%)(N = 2)
*Community φc = .457
Receiving/understanding results“Every time I did a sample this year, I was so nervous that I wasn’t doing it right… Having attended tonight’s [data sharing event], and gotten the data, I realize that maybe I did okay. I think I have a lot more confidence to do it by myself next year.” -T19419%
(N = 24)
None observed
Instructional booklet“Instruction book is useful.” -T13715%
(N = 19)
*TW (+) (58%)(N = 11)
*College grad (+) (42%)(N = 8)
*Community φc = .316
*College grad φc = .238
Gain confidence with practice“It reminds me of chemistry lab but I am getting the hang of it.” -G415
“The beginning of the first year I would go to their homes. And usually when it would rain they would call me and I would be going through the experiment and I was like wow are these people ever going to learn to just do it on their own? …But as I was doing the last sampling they were actually putting their gloves on and they were ready to do the whole thing themselves, collecting the dirt, doing the experiment. They were motivated to do it themselves.” – Promotora 7
(N = 12)
None observed4
Household members working together“nice to have Dad help.” -T004, Y1S6%
(N = 8)
None observed
Talks with other participants about project“We just live two trailers down from each other… [the other participant lives] two trailers closer to the mine than I am… And I was remembering my [DIY experiment] results, and seeing her results, and then thinking, oh my goodness, there is a difference, even within the proximity there.” -H212, Y1FG6%
(N = 8)
None observed
Familiarity with past experiences“I took [water] samples working for mines.” -G425, Y1S
“No problem- just like school!” -H214, Y1S
(N = 7)
None observed

Other Participant Support themes cited by promotoras but not participants: receiving recognition or rewards (3), using online instructional videos (2).

1 Groups indicated are significantly different (p < 0.05) in their representation in the theme compared to other group(s). Directionality of difference is represented by (+) for greater representation than expected by the null hypothesis or (–) lesser representation than expected by the null hypothesis.

2 Effect size represented using Cramer’s V (φc). Effect sizes included for significant results (p < 0.05) indicated with *, and for non-significant medium or large (>0.3) effect sizes.

Some differences were observed between community and demographic groups in what methods of support were most meaningful. Participants without a college degree were more likely to cite the initial home training with the promotora as an important support, which may suggest the promotora model as especially relevant for participants with less formal education. Within the group who specifically cited promotora support as helpful, GM community members were represented more than the expected distribution and TW community members were represented less. The latter may relate to a local issue with one of the initial promotoras in the TW community, who faced personal challenges early in the project and did not continue after the first round of home visits (another promotora, included in this study, was subsequently hired). This personnel turnover in TW limited relationship building in the early stages of the project.

Conversely, college graduates and TW community members were significantly more likely to cite the instruction booklet as especially helpful. Participant instruction booklets were produced in both Spanish and English and went through several rounds of revisions based on promotora feedback, in an effort to be as clear and accessible as possible. Despite these efforts, these results suggest that written materials may provide disproportionate support to college-educated and urban participants. Project Harvest staff also created short instructional videos as an alternate communication method, which two promotoras and a small subset (5%) of participants reported as helpful. However, we observed that the promotora’s own comfort level with technology, which is highly variable within the group, correlated with their participants’ exposure to online project resources and tools. The three promotoras who cited technology challenges for themselves personally in the project also cited their perception of this challenge for their participants.

Participants in the DH community, as well as non-low-income participants, were overrepresented within those who contacted project staff directly. As DH participants are predominantly White, English-speaking, and college educated, as well as many being transplants from urban areas, it is possible that their identities increase their comfort level in directly contacting professional scientists. Conversely, TS participants, who are predominantly Latino/Hispanic, Spanish speaking, and not college educated, were underrepresented in those who engaged directly with research staff. This may be due to the effectiveness of promotoras in the TS community. However, this may also relate to sociocultural barriers for those who are not represented in dominant representations of “scientist,” similar to sociocultural barriers for people of color for participation in STEM generally (; ). As one TS promotora said, “They waited for me to help … maybe because they were doing it themselves and they do not feel like chemists or biologists or doctors or whatever,” suggesting that participant identity may have acted as a barrier to participation in her community.

Barriers to participation

Frequency of themes observed in participant barriers to participation, with noted significant differences observed for any community or demographic group, is illustrated in Table 6. Participant reasons for resigning from the project, communicated directly by the participant or via their promotora, are illustrated in Table 7, and provide additional insight on what study design aspects may deter participation. There was no statistically significant correlations observed between resigning and any community, race/ethnicity, household income level, or education level group.

Table 6

Participant barriers theme frequency and difference by group.

Parent Code: Participant Barriers

Child CodeExamples of Child CodeTotal Contributing Participants (N = 120)Significant Difference by Group1 Omnibus Significance and Effect Size2 # Promotoras citing theme (N = 7)

Tasks more time-consuming or complicated than expected“People not having a good understanding of the time commitment. For DIY, some people were overwhelmed by the amount of time it would take- sometimes people had questions, but generally felt supported by booklet, was more unwilling to take the time.” – Promotora 3
“The one problem I had was the arsenic test…Because we had this much liquid, this much space, and then a test strip that we couldn’t get wet and had to agitate it for 45 seconds…I mean, this is a lot of failure built into this process, I thought.” -D307
(N = 26)
*Latino (–)
(19%)(N = 5)
*Race/ethnicity φc = .3047
Not confident in sampling or doing experiments“I had to constantly review steps of collection and testing as didn’t trust my memory and didn’t want to mess up results for that reason.” -T12218%
(N = 21)
None observed4
No computer/internet access“Does not have internet access” – Staff notes on interview with T116
“[Participant] doesn’t have a smartphone and she doesn’t have a computer.” – Promotora 5
(N = 21)
*TS (+)
(52%)(N = 11)
*HW (+) (33%)(N = 7)
*TW (–)
(5%)(N = 1)
*DH (–)
(0%)(N = 0)
*Non college grad (+)(70%) (N = 13)
*Latino (+) (76%)(N = 16)
*White (–)
(10%)(N = 2)
*Community φc = .376
*College grad φc = .257
*Race/ethnicity φc = .417
Technical issues with rainwater harvesting“Not going well because gutter system not collecting.” -T13313%
(N = 15)
None observed
Difficulty with instructions“I’m pretty sure there’s instructional booklet, but I’d rather just have her explain it to me.” I’m doing an apprenticeship program [as part of employment at the mine] and have to do so much reading, it’s hard for me to read stuff, I would rather just do it with someone.” – H21311%
(N = 13)
None observed3
Computer/tech use barriers“Has a smart phone but does not know how to use internet on smart phone.” -Staff notes on interview with T15310%
(N = 12)
*College grad (+) (67%)(N = 8)*College grad φc = .3653
Logistical barriers to sample drop-off“Only thing difficult is the limited window and location for sample drop-off. Makes it difficult for working people.” – T1428%
(N = 10)
None observed1
Unexpected life events“It’s been a tough month with losses in the family so we’ve been away.” -G4258%
(N = 10)
*Non low income (+) (80%)(N = 8)*Income φc = .365
Unclear on how to submit samples or results“Did both the winter and monsoon experiments for water, have the results and photos and pages of journal notes. Have been meaning to upload them, not sure if I remember how.” -T1228%
(N = 9)
None observed1

Other Participant Barrier themes cited by promotoras but not participants: local economic/political concerns about the project (2).

1 Groups indicated are significantly different (p < 0.05) in their representation in the theme compared to other group(s). Directionality of difference is represented by (+) for greater representation than expected by the null hypothesis or (–) lesser representation than expected by the null hypothesis.

2 Effect size represented using Cramer’s V (φc). Effect sizes included for significant results (p < 0.05) indicated with *, and for non-significant medium or large (>0.3) effect sizes.

Table 7

Participant reasons for resigning from project.

Reason Cited*# Participants (N = 23)% Participants Resigned

No reason given/Not able to contact1670%
Did not have enough time to participate522%
Unexpected life event522%
Technical challenges with rainwater harvesting522%
Confused or frustrated with procedures417%
Computer access challenges14%

* Participants may cite more than one reason.

Of participants who dropped out of the project, 22% cited not having enough time. Similarly, the most frequently cited barrier to participation both by participants and promotoras was that participant protocols were too time-consuming or complicated. Latino/Hispanic participants were underrepresented in the group that reported this barrier. However, this underrepresentation may be related to previously discussed findings that TS participants were less likely to directly contact project staff, and may have felt a sense of obligation to the promotora organization, as well as to the documented “simpatía” cultural norm in Latino/Hispanic communities, which emphasizes conflict avoidance and harmony in interpersonal relations ().

The largest number of differences between community and demographic group representation were observed in the participant group reporting lack of computer or Internet access. Latino/Hispanic participants and non-college graduates were overrepresented in this group, whereas White participants were underrepresented. Similarly, two predominantly Latino/Hispanic communities (TS, HW) were overrepresented in this group, and two predominantly White communities (TW, DH) were underrepresented in this group, with only one community (GM) represented within an expected range. One participant cited “lack of computer access” as their reason for resigning from the project. This barrier was unanticipated, as Project Harvest participants were not required to have computer access, promotoras were equipped and trained to upload participant results, and paper versions of surveys and results submission forms are available. However, the extra step of contacting the promotora to help complete the results submission may have increased the burden of participation for some.

College graduates were statistically overrepresented in the group that has computer access but some barriers to use, which is likely related to the fact that more non-college graduates had no computer/internet access, and were thus ineligible for the “computer/tech use barriers” category. Technology use barriers cited were varied, for example, the participant website requires a login ID, which caused confusion for some. Another participant said, “I don’t know why the upload step seems like a burden, it’s just the part that’s not as exciting and you want to put off for later.”


Findings discussed inform suggested strategies for increasing diverse participants in CS, as outlined in Table 8, and discussed further below.

Table 8

Findings from Project Harvest and responsive strategies for increasing diverse CS participants.

Project Harvest Participant FindingsResponsive CS Project Design Strategies

MotivationMotivation to participate varies by community.
  • Participants inform the research question(s)
  • Project methods and communications match culture and context of participant community
Non-traditional participants1 are more likely to be motivated by existing relationships with individuals or an organization, or by addressing a perceived risk.
  • Recruitment strategies build on existing personal/organizational relationships
  • Project does not pose perceived risk to existing relationships
  • Recruitment strategies and project design leverage participant motivation to connect with each other
  • Participant liaisons share key identity traits with participants (e.g. promotora model)
  • Researchers clearly connect research question(s) to identified community issue(s)
Non-traditional participants1 are less likely to be motivated by learning for the sake of learning or by contributing to science.
  • Recruitment strategies do not assume participant motivation to contribute to scientific research or to increase personal knowledge
SupportNon-traditional participants1 are more likely to be supported by personal interactions than by written materials.
  • Participant liaisons are highly accessible
  • Project design builds in opportunities for relationship building and open communication between participants and staff, and participants with each other
  • Data sharing via social events for peer-to-peer data interpretation, with staff support
BarriersNon-traditional participants1 are less likely to have reliable computer or internet access.
  • Provide alternatives to digital participant tools
  • Provide access to necessary technology and personal user support (e.g. hosting “hack-a-thon” style events at a community computer lab for participants to submit data)
Lack of time was the most frequently reported barrier for participants generally.
  • Participant methods allow for flexibility (e.g. participant can skip a data collection date without dropping out of the project)
  • Tiered participation structure allows for participants to engage based on their available time

1 “Non-traditional participants” defined here as non-White participants, low-income participants, and/or participants without a four-year college degree.

Design for diverse identities

No significant differences between community or demographic groups were observed related to self-efficacy (SE) for science, resigning from the project, reporting lack of confidence, or reporting difficulty understanding instructions. These results importantly suggest that although socioeconomic factors affect countless life outcomes, from educational attainment to physical health and mortality (; ; ; ), they do not predict success of a citizen scientist. Consequently, the high proportion of White and college educated participants in CS may be due in part to culturally biased project design. As Max Liboiron of CLEAR Laboratories stated in the 2019 keynote address to the Citizen Science Association, “The inclusion model often is a model of equality, where it brings people into a space that’s already not designed for them. It treats everyone the same, bringing them into contact with accredited science. We already know this doesn’t work– you can bring many women and people of color into science and they still ‘fall out of the STEM pipeline’ because that pipeline is built for someone else” (). Conversely, the success of CBPR and other participant-driven approaches for environmental health research has been attributed to community members themselves generating the research question, designing the study, and leading the process, allowing for the entire project to evolve within the cultural context of the participant community (; ; ; ).

Although motivation to contribute to scientific research has been widely cited in participants of other environmental CS projects (; ; ; ), findings here suggest contribution to science, as well as learning for sake of learning, may be motivations that apply disproportionately to White, college educated, and non-low-income participants. Participants from communities of color were more likely to be motivated by addressing a relevant problem, or prior relationship with a community organization and its staff. This suggests relevancy of the study content and personnel involved may be important motivation factors for engaging diverse CS participants.

Additionally, participants from predominately White communities were more likely to communicate with university-based staff, while Latino/Hispanic participants were more likely to communicate only with their promotora. As participants of color in other environmental health studies have expressed distrust of formal study authorities (), participant liaisons that share participant identity traits may be critical for increasing diverse CS participation. In the experience of this study and others (e.g., ), hiring on-the-ground project staff from within partnering communities presents some working challenges (e.g., cultural/linguistic differences, distance communication) but are far outweighed by the benefits of local knowledge and relationships to improve participant engagement.

Several promotoras described the value to participants of study elements that recognized them as “part of the team” (e.g., receiving a newsletter, postcard, or certificate; community events; direct communication; data sharing events). The importance of participant recognition for sustained participation has been cited elsewhere (; ), and may hold even greater importance where participants question whether they “belong” in science based on identity. Informal community events where participants and community members can talk to scientists and university-based staff may similarly promote a sense of group membership and identity as a “scientist.”

Design for relationship building

Woven throughout the data is the theme of personal relationships as both the glue that holds Project Harvest together and the oil that allows it to run smoothly. Participants expressing appreciation for their promotora often used words more personal (“I just love her!”) than professional. The most widely cited motivation by promotoras was connection to their own community members. Participants described taking water samples with their kids, parents, grandparents, school classrooms, and each other. This aligns with related CS participant research findings: Environmental stewardship project participants in an urban community of color reported being more motivated by their commitment to community than to the natural environment (), and both “connection to common humanity” and “connection to community organizations” were found to be significant motivations for participants in community-centered environmental health research (). One study of participants across six environmental CS projects found social motivation factors to be especially important for co-created CS projects (). Although these social connections remain difficult to track, they may be immensely important to the motivation and engagement of underrepresented citizen scientists.

In Project Harvest, social data sharing events served as the best venues for relationship building among participants. At these events, neighboring participants were observed comparing results and discussing potential causes for the difference in their contaminant levels (“She is maybe 40 ft closer [to the smelter]”), as well as exchanging phone numbers for reasons unrelated to the project. Although Project Harvest was carefully designed to protect participant privacy, participants at data sharing events were observed sharing openly about their community’s history, household practices, and personal health issues. This observed open data sharing act among participants served as an additional mechanism for relationship building and social participation in learning. Ample literature documents the importance of data report back in environmental health research (; ; ; ). The benefits from data sharing events observed here suggest that designing for relationship building and social negotiation of knowledge can deepen participants’ sense of connection to the project, the study purpose, and each other.

Social participation learning theory () asserts there is no separation between participating and learning, as the act of participation is embedded with cultural and contextual knowledge. In a community of practice, a group of practitioners share an interest and continuously deepen their knowledge of this interest area through practice and sharing information (). Through frequent participation, participants can move closer to the center of the community, where they immersed in the group knowledge and culture. Scholars have conceptualized online crowdsource CS groups as communities of practice (; ; ; ), though this model of social learning and co-creation of culture is arguably even more relevant for an in-person CS community. Conceptualizing CS communities as communities of practice has been previously proposed as a strategy for maximizing learning and engagement ().

It may benefit CS projects to deliberately design, and adequately allocate resources, for relationship building at every level of the project, ensuring that research staff, community-based staff, and participants have regular opportunities for dialogue. In Project Harvest, this design includes: 1) In-person community environmental health trainings as participant recruitment events, 2) Weekly conference calls with project staff and promotoras, 3) Annual promotora professional development events with project staff, 4) Regular opportunities for open, friendly engagement between project staff, promotoras, and participants at community trainings, data sharing events, and informal “open house” events throughout each year.

Design for time and technology constraints

Data sharing events previously discussed were held at familiar local venues, food was provided, and all participants received postcard invitations and text message reminders prior to the event. Despite these efforts, less than one third of total participants actually attended an event. Participants and promotoras both cited the time required to do project tasks as the greatest barrier to participation. Designing for relationship building, which inherently requires participant time, while also honoring participant time constraints may be a challenge in participatory research “that won’t go away” (). Strategies from other CS projects include using tiered levels of participation (e.g., ) to simultaneously make participation accessible for those with limited time and resources, and provide those with more time the option to get more deeply involved. As Project Harvest staff and promotoras look forward to planning the coming year’s participant events, we are challenged with how to facilitate social participation and co-learning, while acknowledging the many competing priorities that participants have on their time.

The technology access divisions observed between communities, race/ethnicity, and education level groups were unanticipated as a barrier, as the Project Harvest participant website does not require technical skills beyond those used on Facebook, which many participants reported using, and promotoras were equipped with ipads and training to assist with web-based tools. Challenges have been addressed to date by creating paper versions of all participant forms, including a results worksheet, accompanied by self-addressed stamped envelopes in participant kits as an option to mail results. Still, these challenges provide important lessons for CS project design: 1) Web-based project tools may bias participation by White and/or college-educated participants, 2) Cultural relevance of technology varies widely by community and within communities, and 3) Access to an Internet device may not preclude other barriers to using project-related technology.

Multiple iterative changes have been made in Project Harvest to improve accessibility based on participant and promotora feedback, including: 1) Promotoras scheduling home training visits to fit participants’ schedules, including the option of scheduling multiple shorter visits, 2) Offering 3-5 rainwater sample drop off days per season for more flexibility, 3) Allowing participants to submit results forms online or via mail anytime, 4) Giving participants the choice of methodology (collect samples and drop off for lab testing, or complete their own experiments and report results only) in the third year of the project, and 5) Adding “Project Harvest Open House” social/educational events as additional opportunities for participants to meet staff and each other. Continuing to develop and share strategies to minimize CS participant burdens while maximizing relationship building emerges from this study as a priority as the environmental health CS field continues to evolve.

Limitations of this study

As the research questions relate to CS participant experience, the decision to solicit participant voice directly was a conscious one. However, the reliance on self-reported data introduces the possibility of bias. Multiple forms of participant data, as well as promotoras’ understanding of their participants, were used to triangulate data and lend validity to findings.

Although the study design differentiates between participant “motivation” to sign up for and participate in an environmental health CS project, and participant “support” to continue participating and staying engaged, some interaction exists between these two categories (; ). Motivation and engagement are malleable, and may shift throughout participation in the project based on participant experience and contextual factors (; ; ). Project Harvest participant data will continue to be collected over the next two to three years in an effort to better understand these dynamics.


Environmental health CS offers an opportunity for historically disenfranchised community members to participate in the creation and interpretation of knowledge related to contaminants in their local environments. CS studies can make participation more accessible and meaningful for demographically underrepresented participants by designing study methods that align with the partnering community’s local political dynamics, culture, context, communication style, and relevant technology. Findings of this study importantly reflect a lack of association between participant self-efficacy and race, income, or education level. Feedback from participants and promotoras in Project Harvest emphasize the importance of the following in environmental health CS project design for diverse participants: 1) Considering existing relationships and community-identified problems as participant motivation, 2) Designing participant methods to include personal support structures and relationship-building, and 3) Designing for participant time and technology access as significant limitations to participation. These findings serve to inform best practices in environmental health CS research design as well as equitable CS project design generally.

Supplementary Files

The supplementary files for this article can be found as follows:

Appendix A

Participant Interview Script August 2018. DOI:

Appendix B

Focus Group Script December 2018. DOI:

Appendix C

Promotora Interview Script January 2018. DOI:

Appendix D

Participant Self-Efficacy Survey. DOI: