Members of the public are the foundation and the backbone of citizen science, but much remains unknown about how the public views citizen science. We conducted a survey of public familiarity with, and perceptions of, citizen science. We found that less than half of respondents were familiar with the term “citizen science,” but over 70% were familiar with the concept by another name. Most respondents were more confident in hypothetical citizen science findings when professional scientists were involved to some degree, compared to situations in which only citizen scientists were involved. Confidence in citizen science findings tended to increase with age, despite the fact that self-confidence in respondents’ own abilities to perform citizen science tasks decreased with age. Fewer than half of respondents (31–47%), and more men than women, were confident in their own ability to perform science process tasks, with the exception of collecting data (53% confident), and only slightly more predicted they would enjoy such activities. Based on our findings, we suggest ways in which leaders of citizen science projects can better promote recruitment, retention, and engagement on the part of volunteers and the public as a whole.
Citizen science plays an increasingly large role in many fields, including astronomy, meteorology, and medicine. It has become especially prevalent and powerful in the fields of ecology and conservation (Follett and Strezov 2015). The ability of a multitude of volunteers to collect large quantities of data across space and time far outstrips the capacity of one or a few professional scientists. Because much of conservation research focuses on geographically widespread issues, such as climate change or the spread of invasive species, such research can particularly benefit from the use of citizen science to increase data collection capacity (Dickinson et al. 2010). Additionally, when volunteers contribute to other aspects of research, such as identifying a research topic or disseminating results, the research can benefit from their many unique perspectives, skill sets, and knowledge. Volunteers can bring many improvements to research, and they have the potential to benefit as well. Participation in citizen science has the potential to increase volunteers’ knowledge of the field of study, such as ecology and conservation (e.g., Brossard et al. 2005; Jordan et al. 2011); to increase science literacy (Crall et al. 2013) and engagement in conservation actions (Lewandowski and Oberhauser 2017); and to promote positive attitudes toward nature (Evans et al. 2005).
These benefits of citizen science, to both the research and the volunteers, can be realized only when volunteers choose to participate in citizen science projects. Gauging the public’s knowledge and perceptions of citizen science can inform strategies for attracting and recruiting potential citizen science participants. The recruitment of volunteers is a crucial component of creating and maintaining a citizen science project in any field, and recruitment strategies have been linked to changes in data quality within citizen science projects by expanding data collection areas and more closely matching volunteer motivations to project experiences (Lewandowski and Specht 2015). We have some understanding of the experiences and outcomes of existing citizen science volunteers (e.g., Crall et al. 2013; Jordan et al. 2011) and professional scientists’ opinions of citizen science (Riesch and Potter 2014), but only one study has examined the public’s interest in participating in citizen science (Martin et al. 2016), and that research focused on marine citizen science and only on a subset of the public that already was involved in the marine environment in some way. No other studies of attitudes and knowledge about citizen science on the part of the general public have been conducted.
In addition to influencing recruitment and retention, public perceptions of citizen science can influence confidence in the findings of citizen science projects. Citizen science findings in any field can be used to inform policy, and conservation or ecological findings can be used as the basis for conservation management decisions (Cooper et al. 2007; McKinley et al. 2015). Additionally, the source of scientific knowledge can influence how members of the public trust and interpret that knowledge (Jenkins 1999). A multifaceted effort is under way to increase the public’s participation in science policy in general (Rayner 2003; Stocklmayer et al. 2010) and conservation policy in specific (Shanley and Lopez 2009); furthermore, conservation often can be undertaken by individual members of the public in addition to governmental or non-governmental organizations. As a result, public buy-in is often important to conservation, and public confidence in the findings of citizen science could play a crucial role in conservation.
We studied public perceptions of citizen science to address gaps in our understanding of this topic. Here, we present the results of a public opinion survey designed to provide baseline data for the following research questions:
We conducted public opinion research at the 2015 Minnesota State Fair, a 12-day, annual event held on the 320 acre State Fairgrounds in Falcon Heights, MN. In 2015, the fair was attended by more than 1.7 million people (Minnesota State Fair 2015). We conducted our research in the University of Minnesota Driven to Discover Research Building, which throughout the fair housed a daily contingent of up to ten university research projects requiring public participation. We collected data during four, six-hour shifts between August 27 and September 3. Visitors to the building were asked to voluntarily complete an “opinion survey on science.” To participate in the study, respondents were required to be sufficiently fluent in English to complete the questionnaire and at least 18 years of age. Respondents were given the opportunity to enter a prize drawing for one of four Monarch Larva Monitoring Project Kits (containing supplies for participating in a citizen science project) after completing the questionnaire. Program rules prohibited researchers from leaving the building to recruit fairgoers, so all study respondents entered the property of their own volition.
We created the questionnaire using Qualtrics software, and the majority of respondents completed it on Apple iPads; paper copies were available upon request to individuals who were unwilling or unable to use iPads. While there was no time constraint for completing the questionnaire, we intentionally designed it to take approximately five minutes to finish, in recognition of the recreational nature of the State Fair and the voluntary participation of the respondents.
The questionnaire was designed according to Dillman et al. (2008). It included questions on demographics, participation in citizen science by study respondents, and familiarity with citizen science, which was divided into three separate questions. First, respondents were asked if they were familiar with the term “citizen science.” Second we provided a definition of citizen science, to determine if the added context spurred respondents’ memories of the term. Third, to determine if respondents were familiar with the concept of citizen science under another name, we asked if they were familiar with other terms for citizen science, such as community-based monitoring or crowd science. We also asked respondents about their confidence in citizen science findings compared to the findings of research conducted solely by professionals in three situations: When citizen scientists only collected data, when they collaborated with professionals in all aspects of the research, and when they alone (with no professional involvement) were completely responsible for all aspects of the research. Additionally, we asked about their predicted self-confidence and enjoyment in performing possible citizen science tasks, including general science process tasks (identifying a research question, designing a study, collecting data, analyzing data, writing reports, and describing projects to others) and specific data collection actions (monitoring rainfall, identifying invasive plants, observing plant phenology, making one-time observations about animals, and regularly monitoring animals). We provided very brief descriptions of each task (see supplementary information) in order to duplicate the initial stages of recruitment or introduction to a project. This first exposure often occurs in the form of a social media post, profile on a volunteering database, flier, or public talk, and can be fairly minimal.
To maintain the brevity of the questionnaire, we limited our questions on specific data collection tasks to those that might be performed with an outdoor nature-based project. Two other exhibits at the State Fair contained in-depth, interactive information on citizen science (projects in the Driven to Discover Building did not use the term citizen science), so we asked respondents if they had visited those areas to control for any effect of proximate exposure to citizen science outreach. Respondents were required only to confirm their age; all other questions were optional. The University of Minnesota IRB Human Subjects Committee approved our research (Study number 1504E69663). (The complete questionnaire is available in the supplementary information.)
We conducted statistical analyses in R version 3.0.1. We used the glm function to perform separate binomial logistic regressions on the two dependent variables, predicted enjoyment of citizen science tasks (yes/no), and predicted self-confidence in performing citizen science tasks (yes/no). We used the polr function in the MASS package to perform ordinal logistic regression on the dependent variable confidence in citizen science findings (less confident, equally confident, or more confident when compared to purely professional findings). Our independent variables in regressions consisted of experience with one or more citizen science projects (binary), education (ordinal), age (continuous), gender, and visiting other citizen science exhibits at the fair (binary). Because fewer than one percent of our respondents reported their gender as something other than male or female, we removed responses that did not fit those categories for our regression analyses and treated gender as a binary variable. We used the pR2 function in the psl package to calculate McFadden’s pseudo R-squared values for our regression analyses. We used pairwise chi-square tests with Bonferroni corrections to examine differences between confidence in different types of citizen science projects, predicted enjoyment of different citizen science tasks, and predicted self-confidence in performing different citizen science tasks.
485 individuals completed the questionnaire, but not all respondents answered each question. As a result, sample sizes varied slightly from question to question. Of the respondents, 91% lived in Minnesota, with the rest spread throughout the United States (n = 481). Sixty-three percent of study respondents were female and 37% were male; of the 485 respondents, one person reported their gender as “other” and one person did not select a gender. When asked about race, 90% identified as white and 3% or less identified as American Indian or Alaska native, Asian, Black, Hawaiian or other Pacific Islander, Multiracial, or other. Four percent identified their ethnicity as Hispanic (n = 482). The mean age of study respondents was 42.4, but the age distribution was bimodal, with 23% in their 20s and 23% in their 50s (n = 361, Figure 1). Twenty-one percent of respondents had a high school degree or less, 14% had an associate’s degree, 37% had a bachelor’s degree, and 28% had a graduate degree (n = 481). Seven percent of respondents were actively involved in citizen science at the time of the survey, 12% had been involved in the past, and 81% had never participated in citizen science (n = 480).
Of the 485 respondents, 25% initially reported that they were familiar with the term citizen science. Results of the first regression with familiarity with the term as the dependent variable indicate that individuals with higher levels of education were more likely to be familiar with the term, as were those with citizen science experience (Table 1). When provided with a definition of the term, 43% (n = 484) reported that they recalled hearing or seeing the term before; experience with citizen science was a positive predictor of familiarity with the term in the second regression analysis (Table 1). Seventy-three percent of respondents (n = 484) stated that they were familiar with at least one of the following terms sometimes used to describe citizen science: Public participation in research, crowd science, crowd-sourced science, and community-based monitoring. In the third regression analysis, which considered familiarity with these additional terms as the dependent variable, familiarity was positively correlated with citizen science experience and negatively correlated with age and participation in other citizen science events at the 2015 Minnesota State Fair (Table 1).
|Familiarity||Intercept||CS Experience||Education||Age||Gender (Male)||Fair CS||Pseudo R2|
Chi-square tests revealed significant differences in respondents’ confidence in citizen science projects compared to purely professional projects based on the degree of citizen scientist involvement (χ2 = 156, df = 4, n = 463, p < 0.001). Study respondents were less likely to be confident in citizen science findings when citizen scientists were completely responsible for all aspects of the research (Figure 2). When only citizen scientists collect data, a subsequent regression analysis (not illustrated in Figure 2) revealed that age was positively correlated with confidence in citizen science findings compared to those produced solely by professionals (t = 2.62, n = 355, p < 0.05); none of the other predictor variables had a significant effect on confidence. No predictor variables had a significant effect on confidence in citizen science findings when volunteers collaborate fully with professionals. A separate regression analysis of confidence in findings when citizen scientists are completely responsible indicated that confidence increased with age (t = 2.63, n = 353, p < 0.05) but decreased with education level (t = –3.28, n = 353, p < 0.05).
When asked about their own confidence in performing different science process tasks, respondents were most likely to report feeling confident about identifying a research question, collecting data, and describing the project and its results to others (Figure 3a). Collecting data was the only task about which more than half the respondents felt confident. When asked if they would enjoy or feel confident engaging in specific nature-related data collection tasks, there were more positive responses. Monitoring rainfall with a rain gauge was the task at which most respondents felt confident, with almost 70% responding positively; the activity about which the smallest number of respondents felt confident (33%) was identifying plants (Figure 3b). Confidence in all of the science process tasks decreased significantly with age. There was a similar, non-significant trend of confidence decreasing with age for the specific data collection tasks. Men had higher confidence levels than women for five out of the six science process aspects of citizen science (both genders felt equally confident about collecting data), but there were no gender differences in confidence about any of the specific data collection tasks. Experience with citizen science was correlated with confidence in all of the science processes and in two of the specific data collection tasks (identifying plants and collecting phenological data, Table 2).
|Confidence||Intercept||CS Experience||Education||Age||Gender (Male)||Fair CS||Pseudo R2|
When respondents were asked what tasks they would enjoy doing, the results were similar to those for confidence in tasks. Writing reports about the project’s data and conclusions was rated as the least enjoyable task (Figure 3c). For each specific data collection task, at least 40% of respondents thought they would enjoy it (Figure 3d). Prior experience with citizen science was correlated with enjoyment for three science process activities and one data collection activity (collecting phenological data), and men were less likely than women to predict that they would enjoy identifying plants or collecting phenological data (Table 3).
|Enjoyment||Intercept||CS Experience||Education||Age||Gender (Male)||Fair CS||Pseudo R2|
Members of the public are both potential participants in and beneficiaries of citizen science. Their familiarity with citizen science and interest in participating in it are likely to affect recruitment and retention, and their confidence in its results could affect public support for and acceptance of citizen science research.
Given that only 25% of our respondents initially recognized the term “citizen science,” but that many more were familiar with the concept under another name, volunteer recruitment efforts or results dissemination that use only “citizen science” might be unclear or ineffective for many people. The list of additional names for citizen science that we provided on the questionnaire is by no means exhaustive. This indicates that the public’s familiarity with the concept of citizen science, if not the specific name, could be even higher than reported here. The terms used to describe citizen science and similar concepts have varied widely over time and across disciplines (Comber et al. 2014; Shirk et al. 2012). Many published papers that use citizen science data do not use the term “citizen science” (Cooper et al. 2014), but its prevalence is rising (Follett and Strezov 2015). The recent creation of membership organizations such as the Citizen Science Association, the Australian Citizen Science Association, and the European Citizen Science Association as well as this journal (Citizen Science: Theory and Practice) also indicate the growing consensus for terminology among scientists and practitioners. Popular science books (e.g., Busch and Kaspari 2013; Russell 2014) and content on websites such as www.citizensciencetoday.org and Discover Magazine’s Citizen Science Salon suggest that the term is growing in use among the public as well. As a result, practitioners who wish to recruit volunteers or share their results with the public might benefit from using “citizen science” and clearly defining it when they do so. Alternatively, they could use both “citizen science” and another prevalent term in their community or field, making it clear that the two are synonymous.
The negative correlation between participating in other citizen-science themed activities at the State Fair and familiarity with other terms for citizen science indicates that respondents may report familiarity only with the term that they have most recently encountered. In this case, fairgoers who participated in hands-on activities described as “citizen science” might not have immediately recalled seeing or hearing other similar terms, because their recent experience was at the forefront of their mind.
With the exception of data collection, fewer than half of respondents were confident in their ability to perform specific science process tasks. These results are not surprising in light of documented low levels of science literacy among the American public; for instance, the National Science Board found that less than half of Americans demonstrated an understanding of scientific inquiry (2012). Our results provide additional evidence for the need to improve understanding of the processes of science, and there is some evidence from other recent work that citizen science volunteers can improve their knowledge about these processes (Crall et al. 2013). Indeed, our respondents who reported experience with citizen science were more confident in their ability to engage in all of the science processes, although it is impossible to separate cause from effect in this finding. Our results also indicate that citizen science project leaders may need to increase volunteers’ confidence in performing scientific tasks, perhaps by offering activities with a range of difficulties, targeting specific age or other demographic groups, or using more understandable and relatable names for activities. For example, while only 53% of our respondents said they would feel confident collecting data, 69% reported that they would be confident measuring rainfall, which is a data collection task. Clearly, as with describing citizen science in general, the terminology used to describe volunteer tasks is important.
For every science process task, confidence decreased with age. This is consistent with research that has found lower understanding of the science process among individuals over 65 and that adults demonstrate less familiarity with experimental design than middle school students (National Science Board 2012). These results could indicate recent improvements in science education, or they could result from more recent exposure of younger respondents to formal science education. The higher self-confidence of men regarding science process is in keeping with many other studies indicating that men demonstrate more confidence in fields ranging from medicine (Blanch et al. 2008) to computer science (Irani 2004). Martin et al. (2016) examined members of the public’s “interest” in various citizen science opportunities, and found that interest decreased with age. It is not possible to know how much of that interest was related to confidence versus enjoyment of a task, but the pattern is similar to what was found in our study.
Differences between ages and genders can influence and inform project recruitment. Younger people and men might be initially more inclined to volunteer as citizen scientists based on their higher levels of confidence; however, many other factors, including sense of place, environmental commitment, and altruism can influence recruitment of volunteers (Dickinson et al. 2012; Newman et al. 2017) and influence the decision to volunteer, and women were significantly more likely than men to state that they would enjoy several data collection tasks. In the United States, women are more likely than men to volunteer, and 35–44 year olds are the most likely to volunteer (Bureau of Labor Statistics 2014). Targeted recruitment could increase the gender and age representation in a citizen science project if needed. We treated confidence and enjoyment in citizen science activities as binomial variables, providing a broad-strokes picture. While this is appropriate for the purposes of this study, additional research could consider these opinions as Likert-type items. This would provide more detailed information and would be especially useful when conducted as project-specific surveys of populations targeted for recruitment.
To our knowledge, no other study has examined the public’s potential confidence in performing citizen science tasks. However, a limited number of studies have examined these factors for existing citizen science volunteers. Koss et al. (2009) found that 10–40% of volunteers participating in underwater marine surveys reported not feeling confident in their data collection abilities, depending on the task. Kremen et al. (2011) found that volunteers’ confidence in identifying insects was higher when identifying to a more general taxon level than when asked to identify to species level. Additionally, volunteers increased their confidence over time, after training, or after repeated monitoring opportunities (Finn et al. 2010; Savan et al. 2003). These findings suggest that the low levels of confidence in performing citizen science tasks found in this study might not be completely different from confidence levels of existing volunteers, and that those confidence levels can increase over time.
Respondents’ confidence in the findings of citizen science research compared to the findings of research conducted solely by professionals indicates that the majority of people are confident in citizen science findings if professional scientists are involved in some way, indicating a high degree of public support for citizen science. Interestingly, up to 24% of respondents were more confident in findings that involved citizen scientists than in solely professional findings. It has been suggested that citizen science has the potential to minimize bias, introduce new viewpoints, empower volunteers with decision making capacity, and democratize science (Bonney et al. 2015; reviewed in Conrad and Hilchey 2011; Dickinson et al. 2012), all of which could be potential reasons for higher confidence in citizen science findings. Some individuals may place more trust in local knowledge than in information generated by scientific professionals, which also could lead to more confidence in citizen science findings (Jenkins 1999). An area of future study would be to examine which of these reasons, if any, members of the public cite for their confidence in citizen science. Confidence in citizen science findings was highest when professionals and citizen scientists collaborated fully on all aspects of research. Currently this type of full partnership is relatively uncommon in citizen science, but it should be considered if there is concern about public confidence or use of a project’s findings.
While most respondents indicated confidence in citizen science-professional pairings, this was not the case when respondents were asked about research conducted solely by citizen scientists. This lack of confidence could present difficulties for projects that are created and led by citizen scientists without professional involvement, an approach that is a recognized subsection of citizen science and is sometimes encouraged by programs in the citizen community (e.g., SciStarter, CitSci.org), and platforms like CitSci.org, Zooniverse Project Builder, and iNaturalist allow anyone to create a web interface for data collection or classification. Such projects could have difficulty recruiting volunteers or finding external uses for their results, if potential volunteers are considering the reliability or efficacy of a project when deciding to volunteer. It is important to note that we looked only at three discrete options on the diverse spectrum of volunteer involvement in citizen science (citizen scientists as data collectors, full citizen scientist-professional collaborations, and citizen scientists acting alone); future research could explore public confidence in the many different types and levels of volunteer involvement.
The results of our work are likely not completely representative of Americans or Minnesota residents as a whole. People who chose to enter a research-oriented building at the State Fair and to complete an opinion questionnaire on science are probably more interested in science than those who did not. As a result, they might be more likely to be familiar with citizen science or to have participated in the past. In addition, the admission fee ($13 for adults under 65, $11 for those 65 and over) to enter the State Fair might act as a barrier for some individuals. Furthermore, the racial composition of our respondents was not wholly representative of Minnesota or the United States (U.S. Census Bureau 2011), and we lacked sufficient diversity among our respondents to consider race in our analysis. Nevertheless, our data provide an important first look at public perceptions of citizen science and reveal interesting patterns in opinions and knowledge, especially related to age and gender, which can elucidate our understanding of the field and inform practitioners’ strategies.
We appreciate the assistance of S. Weaver, C. Stenoien, and B. Bohn in the University of Minnesota Monarch Lab with data collection; the University of Minnesota Driven to Discover Research Building Team for providing research facilities and equipment; three anonymous reviewers; and Minnesota State Fair attendees for completing our questionnaire. EJL was partially supported by a Conservation Biology Graduate Program Fellowship during this project.
The authors have no competing interests to declare.
Blanch, D.C., Hall, J.A., Roter, D.L. and Frankel, R.M. (2008). Medical student gender and issues of confidence. Patient Education and Counseling 72: 374–381, DOI: https://doi.org/10.1016/j.pec.2008.05.021
Bonney, R., Phillips, T.B., Ballard, H.L. and Enck, J.W. (2015). Can citizen science enhance public understanding of science?. Public Understanding of Science 25(1): 2–16, DOI: https://doi.org/10.1177/0963662515607406
Brossard, D., Lewenstein, B. and Bonney, R. (2005). Scientific knowledge and attitude change: The impact of a citizen science project. International Journal of Science Education 27(9): 1099–1121, DOI: https://doi.org/10.1080/09500690500069483
Bureau of Labor Statistics (2014). Volunteering in the United States-2014. Washington, D.C.: U.S. Department of Labor. No. USDL-15-0280.
Busch, A. and Kaspari, D.C. (2013). The incidental steward: Reflections on citizen science. New Haven: Yale University Press.
Comber, A., Schade, S., See, L., Mooney, P. and Foody, G. (2014). Semantic analysis of citizen sensing, crowdsourcing and VGI. Paper presented at Connecting a Digital Europe through Location and Place. Proceedings of the AGILE 2014 International Conference on Geographic Information Science. Castellón
Conrad, C.C. and Hilchey, K.G. (2011). A review of citizen science and community-based environmental monitoring: Issues and opportunities. Environmental Monitoring and Assessment 176(1–4): 273–291, DOI: https://doi.org/10.1007/s10661-010-1582-5
Cooper, C.B., Dickinson, J., Phillips, T. and Bonney, R. (2007). Citizen science as a tool for conservation in residential ecosystems. Ecology and Society 12(2): 11.DOI: https://doi.org/10.5751/ES-02197-120211
Cooper, C.B., Shirk, J. and Zuckerberg, B. (2014). The invisible prevalence of citizen science in global research: Migratory birds and climate change. PloS One 9(9): e106508.DOI: https://doi.org/10.1371/journal.pone.0106508
Crall, A.W., Jordan, R., Holfelder, K., Newman, G.J., Graham, J. and Waller, D.M. (2013). The impacts of an invasive species citizen science training program on participant attitudes, behavior, and science literacy. Public Understanding of Science 22(6): 745–764, DOI: https://doi.org/10.1177/0963662511434894
Dickinson, J.L. Shirk, J. Bonter, D. Bonney, R. Crain, R.L. Martin, J. Purcell, K. et al. (2012). The current state of citizen science as a tool for ecological research and public engagement. Frontiers in Ecology and the Environment 10(6): 291–297, DOI: https://doi.org/10.1890/110236
Dickinson, J.L., Zuckerberg, B. and Bonter, D.N. (2010). Citizen science as an ecological research tool: Challenges and benefits. Annual Review of Ecology, Evolution, and Systematics 41: 149–172, DOI: https://doi.org/10.1146/annurev-ecolsys-102209-144636
Dillman, D.A., Smyth, J.D. and Christian, L.M. (2008). Internet, mail, and mixed-mode surveys. New York, NY: Wiley.
Evans, C., Abrams, E., Reitsma, R., Roux, K., Salmonsen, L. and Marra, P.P. (2005). The Neighborhood Nestwatch Program: Participant outcomes of a citizen-science ecological research project. Conservation Biology 19(3): 589–594, DOI: https://doi.org/10.1111/j.1523-1739.2005.00s01.x
Finn, P.G., Udy, N.S., Baltais, S.J., Price, K. and Coles, L. (2010). Assessing the quality of seagrass data collected by community volunteers in Moreton Bay Marine Park, Australia. Environmental Conservation 37(01): 83–89, DOI: https://doi.org/10.1017/S0376892910000251
Follett, R. and Strezov, V. (2015). An analysis of citizen science based research: Usage and publication patterns. PloS ONE 10(11)DOI: https://doi.org/10.1371/journal.pone.0143687
Irani, L. (2004). Understanding gender and confidence in CS course culture. ACM SIGCSE Bulletin 36(1): 195–199, DOI: https://doi.org/10.1145/1028174.971371
Jenkins, E.W. (1999). School science, citizenship and the public understanding of science. International Journal of Science Education 21(7): 703–710, DOI: https://doi.org/10.1080/095006999290363
Jordan, R.C., Gray, S.A., Howe, D.V., Brooks, W.R. and Ehrenfeld, J.G. (2011). Knowledge gain and behavioral change in citizen-science programs. Conservation Biology 25(6): 1148–1154, DOI: https://doi.org/10.1111/j.1523-1739.2011.01745.x
Koss, R., Miller, K., Wescott, G., Boxshall, A., Bellgrove, A., Gilmour, P., Bunce, A., McBurnie, J. and Ierodiaconou, D. (2009). An evaluation of Sea Search as a citizen science programme in Marine Protected Areas. Pacific Conservation Biology 15: 116–127, DOI: https://doi.org/10.1071/PC090116
Kremen, C., Ullmann, K.S. and Thorp, R.W. (2011). Evaluating the quality of citizen-scientist data on pollinator communities. Conservation Biology 25: 607–617, DOI: https://doi.org/10.1111/j.1523-1739.2011.01657.x
Lewandowski, E. and Oberhauser, K.S. (2017). Butterfly citizen scientists in the United States increase their engagement in conservation. Biological Conservation 208: 106–112, DOI: https://doi.org/10.1016/j.biocon.2015.07.029
Lewandowski, E. and Specht, H. (2015). Influence of volunteer and project characteristics on data quality of biological surveys. Conservation Biology 29(3): 713–723, DOI: https://doi.org/10.1111/cobi.12481
Martin, V.Y., Christidis, L. and Pecl, G.T. (2016). Public interest in marine citizen science: Is there potential for growth?. BioScience 66(8): 683–692, DOI: https://doi.org/10.1093/biosci/biw070
McKinley, D.C. Miller-Rushing, A.J. Ballard, H.L. Bonney, R. Brown, H. Evans, D.M. Ryan, S.F. et al. (2015). Investing in citizen science can improve natural resource management and environmental protection. Issues in Ecology 19
Minnesota State Fair (2015). Minnesota state fair website. Available at: http://www.mnstatefair.org/ [Last Accessed 27 July 2016].
National Science Board (2012). Science and engineering indicators 2012 (NSB 12-01). Arlington: National Science Foundation.
Newman, G. Chandler, M. Clyde, M. McGreavy, B. Haklay, M. Ballard, H. Gallo, J. et al. (2017). Leveraging the power of place in citizen science for effective conservation decision making. Biological Conservation 208: 55–64, DOI: https://doi.org/10.1016/j.biocon.2016.07.019
Rayner, S. (2003). Democracy in the age of assessment: Reflections on the roles of expertise and democracy in public-sector decision making. Science and Public Policy 30(3): 163–170, DOI: https://doi.org/10.3152/147154303781780533
Riesch, H. and Potter, C. (2014). Citizen science as seen by scientists: Methodological, epistemological and ethical dimensions. Public Understanding of Science 23(1): 107–120, DOI: https://doi.org/10.1177/0963662513497324
Russell, S.A. (2014). Diary of a citizen scientist: Chasing tiger beetles and other new ways of engaging the world. Corvalis: Oregon State University Press.
Savan, B., Morgan, A.J. and Gore, C. (2003). Volunteer environmental monitoring and the role of the universities: The case of Citizens’ Environment Watch. Environmental management 31(5): 0561–0568, DOI: https://doi.org/10.1007/s00267-002-2897-y
Shanley, P. and Lopez, C. (2009). Out of the loop: Why research rarely reaches policy makers and the public and what can be done. Biotropica 41(5): 535–544, DOI: https://doi.org/10.1111/j.1744-7429.2009.00561.x
Shirk, J.L. Ballard, H.L. Wilderman, C.C. Phillips, T. Wiggins, A. Jordan, R. Bonney, R. et al. (2012). Public participation in scientific research: A framework for deliberate design. Ecology and Society 17(2): 29.DOI: https://doi.org/10.5751/ES-04705-170229
Stocklmayer, S.M., Rennie, L.J. and Gilbert, J.K. (2010). The roles of the formal and informal sectors in the provision of effective science education. Studies in Science Education 46(1): 1–44, DOI: https://doi.org/10.1080/03057260903562284
U.S. Census Bureau (2011). Overview of race and hispanic origin: 2010. U.S. Census Bureau. No. C2010BR-02.