Introduction

Citizen Science (CS) approaches in biodiversity research offer the potential for large-scale and long-term data collection, which can contribute to population monitoring, species distribution mapping, and conservation policies, as well as including an educational benefit for the volunteers. Application of, and interest in, citizen science has over the past two decades grown exponentially (; ), and citizens typically engage in activities such as 1) data collection, 2) data processing, 3) curriculum-based participation, and 4) community science, the classification types not being mutually exclusive (). However, involving citizens in several steps of the scientific process remains in its infancy.

A novel non-invasive way of evaluating species diversity in different biomes that is reliant on relatively large datasets and exhaustive sampling is monitoring by environmental DNA (eDNA) (; ; ) that involves detection of genetic material shed by living organisms to their surrounding habitat. Monitoring of eDNA in water samples is less dependent on taxonomical expertise (Bohmann et al. 2014; ), and sample collection is reasonably straightforward and can be performed with very little training, which makes the approach a suitable method for a CS setup. Monitoring of eDNA can be done either by detection of single species using a quantitative polymerase chain reaction (i.e., qPCR) (; ) or by a metabarcoding approach targeting a broader diversity within a limited taxonomical group, e.g., bony fishes (; ). The species-specific approach initially had a focus on freshwater species (; ; ), but there is a growing body of studies focusing on marine eDNA (, ; ). With an increase in the number of eDNA studies (), and a desire to attain larger datasets for eDNA monitoring of biodiversity, a consequential and interesting next step is to apply CS in eDNA monitoring. Although it can be argued to be more precise when carried out by trained laboratorial staff, we opted for a citizen-involved laboratory approach as it gives a unique and exciting hands-on experience, that increases awareness of monitoring biodiversity.

Coupling CS with eDNA monitoring has previously been attempted (; ; ), but these studies involved the participants only in the sampling, not in the subsequent laboratory analysis.

Although CS facilitates the collection of larger datasets, concerns regarding the data quality have been raised (). Typically, sound design and volunteer training have been mentioned as essential to secure data quality (). In cases in which volunteers are conducting similar work as professionals, data-quality assessments should be performed for the data to be scientifically robust (). Still, scientists have been found to ascribe lower credibility to data collected by younger CS volunteers, indicating a preference for using data collected by college students or older (). Whether the eDNA monitoring is performed by trained researchers or untrained students, there is an inherent risk of obtaining false-positive or false-negative detections. For eDNA monitoring, this is either a suspicion that a species is present when it is in fact absent (i.e., false positive) in the aquatic habitat, or the reverse—that the eDNA monitoring suggests the species is absent when it is in fact present (i.e., false negative). False- positive/negative detections in eDNA monitoring usually arise from cross contamination of samples with DNA not originally stemming from the sample or by confusing samples. Both can happen in the laboratory as well as in the field. The consequences of erroneous evaluations based on false-positive and/or -negative detections can be dire, especially when monitoring introduced species (). Plans involving eradication of introduced species can be costly and have negative impacts to the environment associated, and if based on incorrect premises of false-positive detections, be a saddening affair. Similar, rare, and threatened species can be overlooked if a large proportion of samples are falsely evaluated as negative when the rare species in fact was present. In such cases, this can lead to a failure in taking the necessary conservation measurement precautions in time to avoid eradication of threatened species. To avoid this problem, it is important that a CS-based eDNA monitoring approach take into consideration the risk of obtaining false-positive and/or -negative detections. One important step to minimize the risk of getting false-positive and/or false-negative detections is to include multiple positive and negative controls—that is, control samples that are known to return either positive and/or negative eDNA detection in previous laboratorial set ups. Inclusion of such control samples for each individual preparation of mix of reagents used for eDNA detection will help reduce the risk of getting false-positive and/or -negative detections, and will help avoid many incorrect conclusions being drawn on incorrect premises.

In this paper, we present a project involving citizens in fieldwork sampling as well as in the following advanced laboratory analyses. We also assess the quality of the resulting data by direct comparison with a trained researcher as well as species occurrence data. To avoid the risk of getting false-positive and/or -negative detections, we also ensure that the laboratorial work performed has an adequate number of control samples, specifically to avoid drawing wrong conclusions from the data obtained.

Methods and Materials

This study builds on a project called “DNA & Liv” (abbreviated ‘DL’) offered to Danish high school students by the Natural History Museum of Denmark. The collection of eDNA samples and analysis of samples was performed by the participants (i.e., the high-school students) who collected samples from the years 2017 and 2018—resulting in a total of 47 unique samples (Figure 1).

Figure 1 

Geographical distribution across Denmark of the 47 analyzed marine samples from 2017–2018. Many samples overlap, explaining the limited number of sampling sites plotted.

Figure 2 illustrates an overall schematic process diagram of the project, where the collaboration and contribution of both citizens and researchers are highlighted.

Figure 2 

Schematic overview of the project “DNA & Liv” (abbreviated DL) offered by the Natural History Museum of Denmark as a teaching programme for high school students. The figure icons above the boxes illustrate which parts of the process were conducted by a researcher or by citizens, respectively.

Experimental design

The teaching programme was designed to incorporate citizens in the scientific research process, facilitating hands-on experiences by testing eDNA assays for environmental monitoring of both fresh and marine organisms in Denmark. The study design was undertaken by the researchers to ensure that the project addressed specific, unanswered research questions, and was based on already developed and tested species-specific assays (; ; ), (Table A in Supplemental File 1).

Collection of water samples

Field kits, which contained materials and instructions on how to collect and handle the eDNA samples correctly, were shipped to the participants. The collection of eDNA from water samples was performed at local marine environments chosen by the citizens. In 2017, the eDNA samples were collected from July to September, and in 2018, the samples were collected from August to December. eDNA sampling was conducted by filtering water using a Sterivex Filter Unit (Merck Millipore) following past protocols (; ) with the addition of 96% ethanol to filters for preservation (Appendix A in Supplemental File 2).

DNA extraction

The ethanol-fixed Sterivex filters were shipped to Natural History Museum of Denmark and stored at -18°C until DNA extraction (Appendix A in Supplemental File 2). The extraction of eDNA from filtered samples was performed by a researcher because it is mostly a time-consuming process fitting less well with citizen involvement compared with setting up qPCR analysis for detection of eDNA in the extracted filtered samples. Extractions from filters followed protocols presented in past eDNA studies (; Sigsgaard et al. 2016; ). After the eDNA was extracted from the filter units, the sample was stored at -18°C and thawed the same day that the eDNA sample was to be analyzed via qPCR at the DNA research laboratory.

Training citizens to work in the lab

Our project included both theoretical and practical training of the participants. A full-day program was scheduled in our DNA laboratory, which is a workspace that can fully accommodate up to 24 people working simultaneously at individual working stations that contain micropipettes, small tabletop centrifuges for 1.5 mL and 2.0 mL tubes, and additional required equipment (See Figure 3).

Figure 3 

Citizens at work in the DNA laboratory, working with eDNA samples and analyses, October 2015. Photo by Anders P. Schultz.

First, participants were given an introduction to the aspects of working with eDNA, qPCR, and molecular methods including species-specific primers and probes as well as instructions on how to prepare and interpret a qPCR analysis. Second, they were trained in how to work sterile, to avoid cross-contamination of samples, and to handle a micropipette. After completing this training, participants were asked to commence their eDNA analysis following a written qPCR analysis protocol (Field protocol and qPCR protocol hand-outs in Supplemental Files 3 and 4, respectively). After having prepared the qPCR analyses (Figure 4a), the PCR tubes were placed in the qPCR machine. The program for the qPCR machine ran for 2 hours and 9 minutes.

Figure 4 

Each species-specific qPCR analysis consisted of four tubes. Along with qPCR reagents, negative and positive control samples were added to the tubes with extracted eDNA obtained from filters. The positive control sample (blue) is a purified and diluted target DNA molecule initially obtained from the target species. The negative control sample (red) is double-distilled sterile water. The eDNA sample (green) is extracted DNA from the filter unit (a). The sigmoid amplification plot obtained from the PCR reaction (b) is a typical diagram and result of a qPCR assay. The increase in relative fluorescence levels reflects a higher number of DNA molecules present in the reaction tube for each cycle of amplification in the qPCR.

When the qPCR program was finished, the citizens were able to see their individual results on amplification plots (Figure 4b). The academic staff and the participants did the interpretation of the plots together, and the citizens validated each analysis to confirm whether the analysis was able to detect eDNA from the specific species in the given eDNA sample.

qPCR analysis

Each species-specific qPCR analysis consisted of four tubes, each with a different specific DNA template added per set of four. (Appendix A in Supplemental File 2). The protocols for volumes and concentrations of reagents follow what has been used in previous studies (Agersnap et al. 2016; ) using qPCR for monitoring eDNA. We deviated slightly from these past protocols (Field protocol and qPCR protocol hand-outs in Supplemental Files 3 and 4, respectively) as we omitted the standard dilution series, and opted for screening of multiple species with two out of four tubes allocated for control test. These DNA templates consisted of a positive control sample, a negative control sample with only double-distilled sterile water, and two tubes with added extracted eDNA stemming from the water sample (Figure 4a). Contrary to more traditional qPCR analysis, a standard dilution series was omitted from the setup, as this would have required a dilution series to be included for each species. This was not possible when multiple different species were to be monitored simultaneously in the same qPCR setup, with only four tubes allocated per species assay in the qPCR machine. The decision to monitor multiple species in parallel instead of focusing on just one species per qPCR run was made to allow citizens to witness at least a couple of positive detections from their own water samples. A qPCR run with only a single species assay would have allowed for the inclusion of a standard dilution series, but would for the very rare and infrequent species equal a large proportion of detection attempts being negative, which would have been disheartening for the citizen, and their experience would be more positive with at least a couple of positive detections.

Data analysis

The positive and negative control tests ensured that the performance of citizens’ abilities with laboratory eDNA work could be evaluated. The citizens’ tests were compared with similar tests conducted by an established researcher within the eDNA field, and tests for statistically significant differences were conducted using the Chi-square test. This comparison was carried out for 14 of the 16 species assays, as two of the assays in the project were discarded because the researcher did not analyze these two assays. Each citizen scientist included a positive and a negative control sample for each of the two replicates of eDNA from their single water sample. The control tests were included to eliminate false-positive detection. The number of tests between the citizens and the researcher is not directly comparable, as the qPCR setup prepared by the researcher involved several positive controls in various concentrations. To minimize the risk of interpreting false positives, an increase in amplification signals after PCR cycle 41 and below a relative fluorescence threshold of 0.1 was disregarded; this applied to the setup performed by the researcher and by the citizens.

Mapping study of eDNA from round goby and Atlantic cod

To assess the resulting data produced by the citizens, we mapped the results inferred for eDNA detection of two fish species and compared this with validated mappings in a national database, Fish Atlas (www.fiskeatlas.dk). The two species were the round goby (Neogobius melanostomus) and the Atlantic cod (Gadus morhua). The round goby was selected because it is a non-indigenous species to the Danish marine environment that is currently observed in the southeastern part of Danish seas (; ). The round goby is suspected to have an extensive effect on the ecosystems due to competition with native species for food () and perhaps breeding and shelter grounds (). With its considerable dispersal ability, the round goby has become one of the most significant non-indigenous species in Danish waters (). The Atlantic cod was included because it is widely distributed and is a well-known commercial species in the Danish waters. It is one of the few commercial marine fishes that tolerate brackish waters, and they are found far into the Baltic Sea (). In recent years, however, stocks are suffering from environmental stress () and overfishing, leaving fishermen and managers in great despair ().

Results

In total, the citizens looked for 16 different marine animal species’ eDNA in each of the 47 water samples. Figure 5 illustrates the citizens’ average success rate per species assay, where the success rate is defined as passing both the negative and positive control test. The success rate of the citizens was above 60% for all 16 marine species assays, with the average success rate at 72%.

Figure 5 

Share of valid controls conducted by citizens per species assay. The average success rate across species, 0.72, is marked by the dotted line.

For citizens, 1,249 out of 1,310 negative samples performed as expected, i.e., unable to return amplification (~95%), whereas only 989 out of 1,312 (~75%) of the positive controls performed as expected, i.e., able to return amplification on added DNA (Figure 6). This indicates that the citizens had more difficulties in performing the positive control, compared with their negative control and also deviates from the performance of the researcher, whose performance is more or less consistent across the two types of control tests (Table 1). For the researcher, 130 of the 138 negative controls performed as expected, returning no amplification (~94%), and similarly, 889 of the 930 positive controls performed as expected, able to amplify on DNA added (~96%).

Figure 6 

Share of failed and successful control tests for the researcher and citizens pooled across the 14 species assays included in the comparison. See Table 1 for statistical results.

Table 1

Chi-squared test of difference in proportions of negative and positive control tests, performing as expected and failing to perform as expected, between researcher and citizens.


RESEARCHERCITIZENSCHI-SQUARED VALUELEVEL OF SIGNIFICANCE

Negative control being negative as expected/total130/1381249/13100.36

Positive control being positive as expected/total889/930989/1312163.46***

Failed negative controls/total8/13861/13100.15

Failed positive controls/total41/930323/1312161.97***

Note: Significance level: *** p = 0.01, ** p = 0.05, * p = 0.10.

Thus, our results indicate that citizens can perform negative control tests with similar quality as a trained researcher. However, for the positive control tests, citizens perform worse than the researcher (Table 1).

Mapping study of eDNA from round goby and Atlantic cod

Our citizen eDNA results confirm the currently known distribution of round goby and Atlantic cod (Figure 7). The round goby is known only in the southeastern part of the inner Danish seas, matching the presence as inferred in the Fish Atlas except for one sample from northern Denmark, indicating a potential range extension (see Discussion section). The Atlantic cod is found throughout the Danish seas, which matches the broad distribution of this common species inferred from the Fish Atlas project.

Figure 7 

Presence and absence data based on eDNA data for the Atlantic cod (Gadus morhua) (a) and the round goby (Neogobius melanostomus) (b). The presence and absence of the same two species but based on data from the official database, Fish Atlas, for Atlantic cod (c) and the round goby (d). Photo inserts of Atlantic cod (41 cm) and round goby (9.9 cm) by Henrik Carl.

Discussion

In this study, we present the successful involvement of citizens in several parts of the scientific process. The participants collect water samples, conduct advanced laboratory analyses, and interpret results, thus producing data of the same quality as trained researchers. If citizens can perform these tasks, while ensuring a high level of data credibility, their work could be taken directly as a starting point for data analysis that can handle the scrutiny of the peer-reviewed evaluation required for scientific publication. Furthermore, if the combination of CS with species-specific eDNA can be performed with adequate precision, this enables a continuous and broad-scale CS-based biodiversity monitoring for both fresh and marine water environments. Citizen scientist involvement in the lab work has educational and training benefit as well as motivational aspects for scientist to invest their time and efforts in collecting samples. This can contribute to the assessment of both non-indigenous and commercial species across a wide geographic area and over time, which again can help when evaluating the environmental status in the aquatic ecosystems.

The inclusion of both positive and negative control samples for each single reagent mix prepared by each student group ensures that false-negative detections play an extremely low role in the data obtained. If one student group were to forget a reagent in their preparation of a mix of reagents, this would lead to no detection of eDNA. The inclusion of positive controls for every single mix prepared avoids this otherwise potentially introduces false negative detections in the obtained data. Similarly, the inclusion of negative controls in each single mix and setup prepared by each student group ensures that extracted eDNA from filtered water samples have been added correctly to reaction tubes. If negative controls start detecting eDNA, it is a clear indication that something has been performed incorrectly and that the obtained data should be disregarded. The setup with four reaction tubes per student, where two out of four tubes are assigned as positive and negative controls, ensures that false detections to a large extent can be weeded out of the data sets obtained.

The citizens’ positive control tests showed a high success rate but was significantly lower compared with the researchers’ positive control tests. This result was expected because the sensitivity in a qPCR setup usually involves many replicates and inclusion of standard dilution series, which students were not able to perform because it was their first time working with this type of analysis in the lab, and we did not include high concentrations of DNA that can serve as positive controls as this can pose a risk of cross contamination. Also, the standard dilution series was excluded because it would have taken up too many qPCR reaction wells per analysis, and would have made it complicated to monitor eDNA from many different species in the same single setup. As our study set-up for qPCR analysis of eDNA samples includes only results with control tests performing as expected (i.e., being negative or positive in amplification as respective control indicated), there is a considerable exclusion of false-negative results.

Mapping the eDNA results for the Atlantic cod showed a few absences of eDNA in locations where the official database had registered observations within the same sampling years (Figure 7). This difference can be caused by the preferred habitat choice of the Atlantic cod, the location of the citizens’ choice of sampling site, and the one-sample strategy in the project.

The results for round goby indicate that eDNA from this species is present in one water sample collected in the northern part of Denmark (Figure 7), which deviates from the observations in the Fish Atlas. This result is a surprise and a false positive cannot be completely ruled out, but the presence of round goby in this northern location is plausible because the species is currently spreading in Danish waters () and might have reached the area in small numbers.

We were able to generate a mapped distribution of the round goby and the Atlantic cod that is overall similar to the already known distribution of these two species. The maps (Figure 7) support that CS species-specific eDNA monitoring can be used actively in the monitoring of both non-indigenous and commercial species. However, to fully test the scale of potential citizen inclusion in laboratory work, future work should focus on testing the participating citizens’ educational background and experience, and assessing whether this influences their ability to perform the laboratory analyses. Another interesting follow-up would be to investigate the effects of previous training—e.g., how the same group of students would perform during a revisit to the lab, and whether there might be an improvement in proportion of failed control tests.

This CS project was also intended to benefit the participants (high school students) by increasing their knowledge of both monitoring species-specific eDNA via a qPCR setup and the scientific process in general by working with authentic samples and producing data for use in species management (). When engaging citizens in a CS project, the practice of learning about the scientific process can be viewed as a core benefit of the project, as the citizens are allowed to engage with authentic data, the research process, and the work involved in answering scientific questions (). Moreover, the experience of participating in a CS project can ideally increase the citizens’ engagement with science and nature, while scientists get more data and the opportunity to increase public knowledge of their research (). Previous studies using different CS methods have found that the participants appreciate the aspect of real research, and the value of their efforts in contributing to the research (; ). Future work should ideally investigate the learning outcomes and experiences of the participants in this relatively new field of combining CS and eDNA approaches.

Conclusion

Our study finds that citizens, after a few hours of training, can successfully work with species-specific qPCR based eDNA analyses and generate validated results useful for monitoring marine species. The accumulated success rate for expected performance of positive and negative control tests reaches a level of 72%. On the basis of citizens’ successful control tests, it is possible to examine and rely on the corresponding results of eDNA detection from specific species, as shown for round goby and Atlantic cod.

The described project has promising applications in monitoring of non-indigenous, threatened, or range-restricted species. It should, however, be emphasized that eDNA monitoring, just like any other method, can be biased by false-positive and false-negative results when performed both by experienced personnel and by citizen scientists. Detailed and careful evaluations should therefore always be performed before eDNA results are used in, for example, eradication campaigns, checklists, or new field guides to certain environments.

Supplementary Files

The supplementary files for this article can be found as follows:

Supplemental File 1

Table A. DOI: https://doi.org/10.5334/cstp.382.s1

Supplemental File 2

Appendix A. DOI: https://doi.org/10.5334/cstp.382.s2

Supplemental File 3

Field protocol handout. DOI: https://doi.org/10.5334/cstp.382.s3

Supplemental File 4

qPCR protocol handout. DOI: https://doi.org/10.5334/cstp.382.s4