Everipedia Logo
Everipedia is now IQ.wiki - Join the IQ Brainlist and our Discord for early access to editing on the new platform and to participate in the beta testing.
Citizen science

Citizen science

Citizen science (CS; also known as community science, crowd science, crowd-sourced science, civic science, volunteer monitoring, or online citizen science) is scientific research conducted, in whole or in part, by amateur (or nonprofessional) scientists.[1] Citizen science is sometimes described as "public participation in scientific research," participatory monitoring, and participatory action research whose outcomes are often advancements in scientific research, as well as an increase in the public's understanding of science.[2][3] Based on Alexa rankings[4] iNaturalist is currently the most popular citizen science website[5] followed by eBird[6] and then Zooniverse[7] in second and third place respectively.

Definition

Members of the Cascades Butterfly Citizen Science Team pictured on Sauk mountain

Members of the Cascades Butterfly Citizen Science Team pictured on Sauk mountain

The term CS has multiple origins, as well as differing concepts.[8] It was first defined independently in the mid-1990s by Rick Bonney in the United States and Alan Irwin in the United Kingdom.[8][9][10] Alan Irwin, a British sociologist, defines CS as "developing concepts of scientific citizenship which foregrounds the necessity of opening up science and science policy processes to the public".[8] Irwin sought to reclaim two dimensions of the relationship between citizens and science: 1) that science should be responsive to citizens' concerns and needs; and 2) that citizens themselves could produce reliable scientific knowledge.[11] The American ornithologist Rick Bonney, unaware of Irwin's work, defined CS as projects in which nonscientists, such as amateur birdwatchers, voluntarily contributed scientific data. This describes a more limited role for citizens in scientific research than Irwin's conception of the term.[11]

The terms citizen science and citizen scientists entered the Oxford English Dictionary (OED) in June 2014.[12][13] "Citizen science" is defined as "scientific work undertaken by members of the general public, often in collaboration with or under the direction of professional scientists and scientific institutions".[13] "Citizen scientist" is defined as: (a) "a scientist whose work is characterized by a sense of responsibility to serve the best interests of the wider community (now rare)"; or (b) "a member of the general public who engages in scientific work, often in collaboration with or under the direction of professional scientists and scientific institutions; an amateur scientist".[13] The first use of the term "citizen scientist" can be found in the magazine New Scientist in an article about ufology from October 1979.[14]

Muki Haklay cites, from a policy report for the Wilson Center entitled "Citizen Science and Policy: A European Perspective", an alternate first use of the term "citizen science" by R. Kerson in the magazine MIT Technology Review from January 1989.[15][16] Quoting from the Wilson Center report: "The new form of engagement in science received the name 'citizen science'. The first recorded example of the use of the term is from 1989, describing how 225 volunteers across the US collected rain samples to assist the Audubon Society in an acid-rain awareness raising campaign."[15][16]

A "Green Paper on Citizen Science" was published in 2013 by the European Commission's Digital Science Unit and Socientize.eu, which included a definition for CS, referring to "the general public engagement in scientific research activities when citizens actively contribute to science either with their intellectual effort or surrounding knowledge or with their tools and resources. Participants provide experimental data and facilities for researchers, raise new questions and co-create a new scientific culture."[17][18]

Citizen science may be performed by individuals, teams, or networks of volunteers.

Citizen scientists often partner with professional scientists to achieve common goals.

Large volunteer networks often allow scientists to accomplish tasks that would be too expensive or time consuming to accomplish through other means.[19]

Many citizen-science projects serve education and outreach goals.[20][21][22] These projects may be designed for a formal classroom environment or an informal education environment such as museums.

Citizen science has evolved over the past four decades.

Recent projects place more emphasis on scientifically sound practices and measurable goals for public education.[23] Modern citizen science differs from its historical forms primarily in the access for, and subsequent scale of, public participation; technology is credited as one of the main drivers of the recent explosion of citizen science activity.[19]

In March 2015, the Office of Science and Technology Policy published a factsheet entitled "Empowering Students and Others through Citizen Science and Crowdsourcing".[25] Quoting: "Citizen science and crowdsourcing projects are powerful tools for providing students with skills needed to excel in science, technology, engineering, and math (STEM). Volunteers in citizen science, for example, gain hands-on experience doing real science, and in many cases take that learning outside of the traditional classroom setting".[25]

In May 2016, a new open-access journal was started by the Citizen Science Association along with Ubiquity Press called Citizen Science: Theory and Practice (CS:T&P).[26][27] Quoting from the editorial article titled "The Theory and Practice of Citizen Science: Launching a New Journal", "CS:T&P provides the space to enhance the quality and impact of citizen science efforts by deeply exploring the citizen science concept in all its forms and across disciplines. By examining, critiquing, and sharing findings across a variety of citizen science endeavors, we can dig into the underpinnings and assumptions of citizen science and critically analyze its practice and outcomes."[27]

Alternative definitions

Other definitions for citizen science have also been proposed.

For example, Bruce Lewenstein of Cornell University's Communication and S&TS departments describes 3 possible definitions:[28]

  • The participation of nonscientists in the process of gathering data according to specific scientific protocols and in the process of using and interpreting that data.[28]

  • The engagement of nonscientists in true decision-making about policy issues that have technical or scientific components.[28]

  • The engagement of research scientists in the democratic and policy process.[28]

Scientists and scholars who have used other definitions include Frank N. von Hippel, Stephen Schneider, Neal Lane and Jon Beckwith.[29][30][31] Other alternative terminologies proposed are "civic science" and "civic scientist".[32]

Further, Muki Haklay offers an overview of the typologies of the level of citizen participation in citizen science, which range from "crowdsourcing" (level 1), where the citizen acts as a sensor, to "distributed intelligence" (level 2), where the citizen acts as a basic interpreter, to "participatory science", where citizens contribute to problem definition and data collection (level 3), to "extreme citizen science", which involves collaboration between the citizen and scientists in problem definition, collection and data analysis.[33]

A 2014 Mashable article defines a citizen scientist as: "Anybody who voluntarily contributes his or her time and resources toward scientific research in partnership with professional scientists."[34]

In 2016 the Australian Citizen Science Association released their definition which states "Citizen science involves public participation and collaboration in scientific research with the aim to increase scientific knowledge."[35][36]

In 2016, the book "Analyzing the Role of Citizen Science in Modern Research" defined citizen science as "work undertaken by civic educators together with citizen communities to advance science, foster a broad scientific mentality, and/or encourage democratic engagement, which allows society to deal rationally with complex modern problems".[37]

In a Smart City era, Citizen Science relays on various web-based tools (eg.WebGIS) and becomes Cyber Citizen Science.[38] Some projects, such as SETI@home, use the Internet to take advantage of distributed computing. These projects are generally passive. Computation tasks are performed by volunteers' computers and require little involvement beyond initial setup. There is disagreement as to whether these projects should be classified as citizen science.

The astrophysicist and Galaxy Zoo co-founder Kevin Schawinski stated: "We prefer to call this [Galaxy Zoo] citizen science because it's a better description of what you're doing; you're a regular citizen but you're doing science. Crowd sourcing sounds a bit like, well, you're just a member of the crowd and you're not; you're our collaborator. You're pro-actively involved in the process of science by participating."[39]

Compared to SETI@home, "Galaxy Zoo volunteers do real work.

They're not just passively running something on their computer and hoping that they'll be the first person to find aliens.

They have a stake in science that comes out of it, which means that they are now interested in what we do with it, and what we find."[39]

Citizen policy may be another result of citizen science initiatives.

Bethany Brookshire (pen name SciCurious) writes: "If citizens are going to live with the benefits or potential consequences of science (as the vast majority of them will), it's incredibly important to make sure that they are not only well informed about changes and advances in science and technology, but that they also... are able to... influence the science policy decisions that could impact their lives."[40]

Benefits and limitations

Citizen involvement in scientific projects has become a means of encouraging curiosity and greater understanding of science whilst providing an unprecedented engagement between professional scientists and the general public.[3] In a research report published by the National Park Service in 2008, Brett Amy Thelen and Rachel K. Thiet mention the following concerns, previously reported in the literature, about the validity of volunteer-generated data:[41]

  • Some projects may not be suitable for volunteers, for instance, when they use complex research methods or require a lot of (often repetitive) work.[41]

  • If volunteers lack proper training in research and monitoring protocols, they are at risk of introducing bias into the data.[41]

  • Members may lie about data.

  • This risk is even greater when bounties are awarded as an incentive to participate.[41]

The question of data accuracy, in particular, remains open.[42] John Losey, who created the Lost Ladybug citizen science project, has argued that the cost-effectiveness of citizen science data can outweigh data quality issues, if properly managed.[43]

In December 2016, authors M. Kosmala, A. Wiggins, A. Swanson and B. Simmons published a study in the journal Frontiers in Ecology and the Environment called "Assessing Data Quality in Citizen Science".[44] The abstract describes how ecological and environmental CS projects have enormous potential to advance science. Also, CS projects can influence policy and guide resource management by producing datasets that are otherwise infeasible to generate.[44] In the section "In a Nutshell" (pg3), four condensed conclusions are stated. They are:[44]

Datasets produced by volunteer CSs can have reliably high quality, on par with those produced by professionals.

Individual volunteer accuracy varies, depending on task difficulty and volunteer experience.

Multiple methods exist for boosting accuracy to required levels for a given project.

Most types of bias found in CS datasets are also found in professionally produced datasets and can be accommodated using existing statistical tools. Reviewers of CS projects should look for iterated project design, standardization and appropriateness of volunteer protocols and data analyses, capture of metadata, and accuracy assessment.

They conclude that as CS continues to grow and mature, a key metric of project success they expect to see will be a growing awareness of data quality.

They also conclude that CS will emerge as a general tool helping "to collect otherwise unobtainable high-quality data in support of policy and resource management, conservation monitoring, and basic science."[44]

A study of Canadian lepidoptera datasets published in 2018 compared the use of a professionally curated dataset of butterfly specimen records with four years of data from a CS program, eButterfly.[45][46] The eButterfly dataset was used as it was determined to be of high quality because of the expert vetting process used on the site, and there existed a historic dataset covering the same geographic area consisting of specimen data, much of it institutional. The authors note that, in this case, CS data provides both novel and complementary information to the specimen data. Five new species were reported from the CS data, and geographic distribution information was improved for over 80% of species in the combined dataset when CS data was included.

Law

In March 2015, the state of Wyoming passed new laws (Senate Files 12 and 80) clarifying that trespassing laws applied even if the trespasser's intention was to gather data to further a U.S. government science program.[47] This hampered some CS researchers who were collecting data while on other people's land.

Ethics

Various studies have been published that explore the ethics of CS, including issues such as intellectual property and project design.(e.g.[8][48][49][50][51]) The Citizen Science Association (CSA), based at the Cornell Lab of Ornithology, and the European Citizen Science Association (ECSA), based in the Museum für Naturkunde in Berlin, have working groups on ethics and principles.[52][53]

In September 2015, the European Citizen Science Association (ECSA) published its Ten Principles of Citizen Science, which have been developed by the "Sharing best practice and building capacity" working group of the ECSA, led by the Natural History Museum, London with input from many members of the association.[54][55]

Citizen science projects actively involve citizens in scientific endeavour that generates new knowledge or understanding.

Citizens may act as contributors, collaborators, or as project leader and have a meaningful role in the project.

Citizen science projects have a genuine science outcome.

For example, answering a research question or informing conservation action, management decisions or environmental policy.

Both the professional scientists and the citizen scientists benefit from taking part.

Benefits may include the publication of research outputs, learning opportunities, personal enjoyment, social benefits, satisfaction through contributing to scientific evidence e.g. to address local, national and international issues, and through that, the potential to influence policy.

Citizen scientists may, if they wish, participate in multiple stages of the scientific process.

This may include developing the research question, designing the method, gathering and analysing data, and communicating the results.

Citizen scientists receive feedback from the project.

For example, how their data are being used and what the research, policy or societal outcomes are.

Citizen science is considered a research approach like any other, with limitations and biases that should be considered and controlled for.

However unlike traditional research approaches, citizen science provides opportunity for greater public engagement and democratisation of science.

Citizen science project data and meta-data are made publicly available and where possible, results are published in an open access format.

Data sharing may occur during or after the project, unless there are security or privacy concerns that prevent this. Citizen scientists are acknowledged in project results and publications. Citizen science programmes are evaluated for their scientific output, data quality, participant experience and wider societal or policy impact. The leaders of citizen science projects take into consideration legal and ethical issues surrounding copyright, intellectual property, data sharing agreements, confidentiality, attribution, and the environmental impact of any activities.

The medical ethics of internet crowdsourcing has been questioned by Graber & Graber in the Journal of Medical Ethics.[56] In particular, they analyse the effect of games and the crowdsourcing project Foldit. They conclude: "games can have possible adverse effects, and that they manipulate the user into participation".

In March 2019 the online journal Citizen Science: Theory and Practice launched a collection of articles on the theme of Ethical Issues in Citizen Science.[57] The articles are introduced with (quoting): "Citizen science can challenge existing ethical norms because it falls outside of customary methods of ensuring that research is conducted ethically.

What ethical issues arise when engaging the public in research?

How have these issues been addressed, and how should they be addressed in the future?"[57]

In June 2019, East Asian Science, Technology and Society: An International Journal (EASTS) published an issue titled "Citizen Science: Practices and Problems" which contains 15 articles/studies on CS, including many relevant subjects of which ethics is one.[58] Quoting from the introduction Citizen, Science, and Citizen Science: "The term citizen science has become very popular among scholars as well as the general public, and, given its growing presence in East Asia, it is perhaps not a moment too soon to have a special issue of EASTS on the topic."[59]

Economic worth

In the research paper "Can citizen science enhance public understanding of science?" by Bonney et al. 2016,[60] statistics which analyse the economic worth of citizen science are used, drawn from two papers: i) Sauermann and Franzoni 2015,[61] and ii) Theobald et al. 2015.[62] In "Crowd science user contribution patterns and their implications" by Sauermann and Franzoni (2015), seven projects from the Zooniverse web portal are used to estimate the monetary value of the CS that had taken place. The 7 projects are: Solar Stormwatch, Galaxy Zoo Supernovae, Galaxy Zoo Hubble, Moon Zoo, Old Weather, The Milky Way Project and Planet Hunters.[61] Using data from 180 days in 2010, they find a total of 100,386 users participated, contributing 129,540 hours of unpaid work.[61] Estimating at a rate of $12 an hour (an undergraduate research assistant's basic wage), the total contributions amount to $1,554,474, an average of $222,068 per project.[61] The range over the 7 projects was from $22,717 to $654,130.[61]

In "Global change and local solutions: Tapping the unrealized potential of citizen science for biodiversity research" by Theobald et al. 2015, the authors surveyed 388 unique biodiversity-based projects.[62] Quoting: "We estimate that between 1.36 million and 2.28 million people volunteer annually in the 388 projects we surveyed, though variation is great" and that "the range of in-kind contribution of the volunteerism in our 388 citizen science projects as between $667 million to $2.5 billion annually."[62]

Worldwide participation in citizen science continues to grow.

A list of the top five citizen science communities compiled by Marc Kuchner and Kristen Erickson in July 2018 shows a total of 3.75 million participants, although there is likely substantial overlap between the communities.

Education

There have been studies published which examine the place of CS within education.(e.g.[3][63][64]) Teaching aids can include books and activity or lesson plans.(e.g.[65][66][67][68]). Some examples of studies are:

From the Second International Handbook of Science Education, a chapter entitled: "Citizen Science, Ecojustice, and Science Education: Rethinking an Education from Nowhere" by Mueller and Tippins (2011), acknowledges in the abstract that: "There is an emerging emphasis in science education on engaging youth in citizen science."

The authors also ask: "whether citizen science goes further with respect to citizen development."[69] The abstract ends by stating that the "chapter takes account of the ways educators will collaborate with members of the community to effectively guide decisions, which offers promise for sharing a responsibility for democratizing science with others."[69]

From the journal Democracy and Education, an article entitled: "Lessons Learned from Citizen Science in the Classroom" by authors Gray, Nicosia and Jordan (GNJ) (2012) give a response to a study by Mueller, Tippins and Bryan (MTB) called "The Future of Citizen Science".[70][71] GNJ begins by stating in the abstract that the study The Future Of Citizen Science: "provides an important theoretical perspective about the future of democratized science and K12 education." But GRB state: "However, the authors (MTB) fail to adequately address the existing barriers and constraints to moving community-based science into the classroom." They end the abstract by arguing: "that the resource constraints of scientists, teachers, and students likely pose problems to moving true democratized science into the classroom."[70]

In 2014, a study was published called "Citizen Science and Lifelong Learning" by R. Edwards in the journal Studies in the Education of Adults.[72] Edwards begins by writing in the abstract that CS projects have expanded over recent years and engaged CSs and professionals in diverse ways. He continues: "Yet there has been little educational exploration of such projects to date."[72] He describes that "there has been limited exploration of the educational backgrounds of adult contributors to citizen science". Edwards explains that CS contributors are referred to as volunteers, citizens or as amateurs. He ends the abstract: "The article will explore the nature and significance of these different characterisations and also suggest possibilities for further research."[72]

In the journal Microbiology and Biology Education a study was published by Shah and Martinez (2015) called "Current Approaches in Implementing Citizen Science in the Classroom".[73] They begin by writing in the abstract that CS is a partnership between inexperienced amateurs and trained scientists. The authors continue: "With recent studies showing a weakening in scientific competency of American students, incorporating citizen science initiatives in the curriculum provides a means to address deficiencies".[73] They argue that combining traditional and innovative methods can help provide a practical experience of science. The abstract ends: "Citizen science can be used to emphasize the recognition and use of systematic approaches to solve problems affecting the community."[73]

In November 2017, authors Mitchell, Triska and Liberatore published a study in PLOS ONE titled "Benefits and Challenges of Incorporating Citizen Science into University Education".[74] The authors begin by stating in the abstract that CSs contribute data with the expectation that it will be used. It reports that CS has been used for first year university students as a means to experience research. They continue: "Surveys of more than 1500 students showed that their environmental engagement increased significantly after participating in data collection and data analysis."[74] However, only a third of students agreed that data collected by CSs was reliable. A positive outcome of this was that the students were more careful of their own research. The abstract ends: "If true for citizen scientists in general, enabling participants as well as scientists to analyse data could enhance data quality, and so address a key constraint of broad-scale citizen science programs."[74]

History

"Citizen science" is a fairly new term but an old practice.

Prior to the 20th century, science was often the pursuit of gentleman scientists, amateur or self-funded researchers such as Sir Isaac Newton, Benjamin Franklin, and Charles Darwin.[19] By the mid-20th century, however, science was dominated by researchers employed by universities and government research laboratories. By the 1970s, this transformation was being called into question. Philosopher Paul Feyerabend called for a "democratization of science".[76] Biochemist Erwin Chargaff advocated a return to science by nature-loving amateurs in the tradition of Descartes, Newton, Leibniz, Buffon, and Darwin—science dominated by "amateurship instead of money-biased technical bureaucrats".[77]

A study from 2016 indicates that the largest impact of citizen science is in research on biology, conservation and ecology, and is utilized mainly as a methodology of collecting and classifying data.[78]

Amateur astronomy

Amateur astronomers can build their own equipment and can hold star parties and gatherings, such as Stellafane.

Amateur astronomers can build their own equipment and can hold star parties and gatherings, such as Stellafane.

Astronomy has long been a field where amateurs have contributed throughout time, all the way up to the present day.[79]

Collectively, amateur astronomers observe a variety of celestial objects and phenomena sometimes with equipment that they build themselves. Common targets of amateur astronomers include the Moon, planets, stars, comets, meteor showers, and a variety of deep-sky objects such as star clusters, galaxies, and nebulae. Observations of comets and stars are also used to measure the local level of artificial skyglow.[80][81] One branch of amateur astronomy, amateur astrophotography, involves the taking of photos of the night sky. Many amateurs like to specialize in the observation of particular objects, types of objects, or types of events that interest them.[82][83]

The American Association of Variable Star Observers has gathered data on variable stars for educational and professional analysis since 1911 and promotes participation beyond its membership on its Citizen Sky website.[84]

Butterfly counts

Butterfly counts have a long tradition of involving individuals in the study of butterflies' range and their relative abundance.

Two long-running programs are the UK Butterfly Monitoring Scheme (started in 1976) and the North American Butterfly Association's Butterfly Count Program (started in 1975).[85][86] There are various protocols for monitoring butterflies and different organizations support one or more of transects, counts and/or opportunistic sightings.[87] eButterfly is an example of a program designed to capture any of the three types of counts for observers in North America. Species-specific programs also exist, with monarchs the prominent example.[88] Two examples of this involve the counting of monarch butterflies during the fall migration to overwintering sites in Mexico: (1) Monarch Watch is a continent-wide project, while (2) the Cape May Monarch Monitoring Project is an example of a local project.[89][90] The Austrian project Viel-Falter [219] investigated if and how trained and supervised pupils are able to systematically collect data about the occurrence of diurnal butterflies, and how this data could contribute to a permanent butterfly monitoring system. Despite substantial identification uncertainties for some species or species groups, the data collected by pupils was successfully used to predict the general habitat quality for butterflies.[91]

Ornithology

Citizen science projects have become increasingly focused on providing benefits to scientific research.[92][93][94] The North American Bird Phenology Program (historically called the Bird Migration and Distribution records) may have been the earliest collective effort of citizens collecting ornithological information in the U.S.[95] The program, dating back to 1883, was started by Wells Woodbridge Cooke. Cooke established a network of observers around North America to collect bird migration records. The Audubon Society's Christmas Bird Count, which began in 1900, is another example of a long-standing tradition of citizen science which has persisted to the present day. Citizen scientists help gather data that will be analyzed by professional researchers, and can be used to produce bird population and biodiversity indicators.

Raptor migration research relies on the data collected by the hawkwatching community. This mostly volunteer group counts migrating accipiters, buteos, falcons, harriers, kites, eagles, osprey, vultures and other raptors at hawk sites throughout North America during the spring and fall seasons.[96] The daily data is uploaded to hawkcount.org where it can be viewed by professional scientists and the public.

Such indices can be useful tools to inform management, resource allocation, policy and planning.[97] For example, European breeding bird survey data provide input for the Farmland Bird Index, adopted by the European Union as a structural indicator of sustainable development.[98] This provides a cost-effective alternative to government monitoring.

Similarly, data collected by citizen scientists as part of BirdLife Australia's has been analysed to produce the first-ever Australian Terrestrial Bird Indices.[99]

Citizen oceanography

The concept of citizen science has been extended to the ocean environment for characterizing ocean dynamics and tracking marine debris. For example, the mobile app Marine Debris Tracker is a joint partnership of National Oceanic and Atmospheric Administration and the University of Georgia.[100] Long term sampling efforts such as the continuous plankton recorder has been fitted on ships of opportunity since 1931. Plankton collection by sailors and subsequent genetic analysis was pioneered in 2013 by Indigo V Expeditions as a way to better understand marine microbial structure and function.[101]

Coral reefs

Citizen science in Coral reef studies developed in the 21st century.

Underwater photography has become more popular since the early 2000s, resulting on millions of pictures posted every year on various websites and social media. This mass of documentation has great scientific potential, as millions of tourists possess a much superior coverage power than professional scientists, who cannot spend so much time in the field.

As a consequence, several participative sciences programs have been developed, supported by geotagging and identification web sites (such as iNaturalist.org [220] ). The Monitoring through many eyes project collates thousands of underwater images of the Great Barrier Reef and provides an interface for elicitation of reef health indicators.[102]

The National Oceanic and Atmospheric Administration (NOAA) also offers opportunities for volunteer participation. By taking measurements in The United States' National Marine Sanctuaries, citizens contribute data to marine biology projects. In 2016, NOAA benefited from 137,000 hours of research.[103]

There also exist protocols for auto-organization and self-teaching aimed at biodiversity-interested snorkelers, in order for them to turn their observations into sound scientific data, available for research.

This kind of approach has been successfully used in Réunion island, allowing for tens of new records and even new species.[104]

Agriculture

Farmer participation in experiments has a long tradition in Agricultural science.[105] There are many opportunities for citizen engagement in different parts of food systems.[106] Citizen science is actively used for crop variety selection for climate adaptation, involving thousands of farmers.[107]

Art history

Citizen science has a long tradition in Natural science. But nowadays, citizen science projects can also be found in various fields of science like Art history. For example, the Zooniverse project AnnoTate is a transcription tool developed to enable volunteers to read and transcribe the personal papers of British-born and émigré artists.[108] The papers are drawn from the Tate Archive. Another example of citizen science in art history is ARTigo.[109] ARTigo collects semantic data on artworks from the footprints left by players of games featuring artwork images. From these footprints, ARTigo automatically builds a semantic search engine for artworks.

Modern technology

Citizen Science Center exhibit in the Nature Research Center wing of the North Carolina Museum of Natural Sciences

Citizen Science Center exhibit in the Nature Research Center wing of the North Carolina Museum of Natural Sciences

Newer technologies have increased the options for citizen science.[110] Citizen scientists can build and operate their own instruments to gather data for their own experiments or as part of a larger project.

Examples include amateur radio, amateur astronomy, Six Sigma Projects, and Maker activities. Scientist Joshua Pearce has advocated for the creation of open-source hardware based scientific equipment that both citizen scientists and professional scientists, which can be replicated by digital manufacturing techniques such as 3D printing.[111] Multiple studies have shown this approach radically reduces scientific equipment costs.[112][113] Examples of this approach include water testing, nitrate and other environmental testing, basic biology and optics.[113][114][115][116] Groups such as Public Lab, which is a community where citizen scientists can learn how to investigate environmental concerns using inexpensive DIY techniques, embody this approach.[114]

Video technology is much used in scientific research.

The Citizen Science Center in the Nature Research Center wing of the North Carolina Museum of Natural Sciences has exhibits on how to get involved in scientific research and become a citizen scientist. For example, visitors can observe birdfeeders at the Prairie Ridge Ecostation satellite facility via live video feed and record which species they see.

Since 2005, the Genographic Project has used the latest genetic technology to expand our knowledge of the human story, and its pioneering use of DNA testing to engage and involve the public in the research effort has helped to create a new breed of "citizen scientist". Geno 2.0 expands the scope for citizen science, harnessing the power of the crowd to discover new details of human population history.[117] This includes supporting, organization and dissemination of personal DNA (genetic) testing. Like Amateur astronomy, citizen scientists encouraged by volunteer organizations like the International Society of Genetic Genealogy have provided valuable information and research to the professional scientific community.[118][119]

With unmanned aerial vehicles, further citizen science is enabled. One example is the ESA's AstroDrone smartphone app for gathering robotic data with the Parrot AR.Drone.[120]

Citizens in Space (CIS), a project of the United States Rocket Academy, seeks to combine citizen science with citizen space exploration.[121] CIS is training citizen astronauts to fly as payload operators on suborbital reusable spacecraft that are now in development.

CIS will also be developing, and encouraging others to develop, citizen-science payloads to fly on suborbital vehicles.

CIS has already acquired a contract for 10 flights on the Lynx suborbital vehicle, being developed by XCOR Aerospace, and plans to acquire additional flights on XCOR Lynx and other suborbital vehicles in the future.[121]

CIS believes that "The development of low-cost reusable suborbital spacecraft will be the next great enabler, allowing citizens to participate in space exploration and space science."[122]

Internet

How your gameplay helps ScienceAtHome build a quantum computer

How your gameplay helps ScienceAtHome build a quantum computer

An NASA/JPL image from the Zooniverse's The Milky Way Project showing a hierarchical bubble structure

An NASA/JPL image from the Zooniverse's The Milky Way Project showing a hierarchical bubble structure

The Internet has been a boon to citizen science, particularly through gamification.[110] One of the first Internet-based citizen science experiments was NASA's Clickworkers, which enabled the general public to assist in the classification of images, greatly reducing the time to analyze large data sets. Another was the Citizen Science Toolbox, launched in 2003, of the Australian Coastal Collaborative Research Centre.[123] Mozak is a game in which players create 3D reconstructions from images of actual human and mouse neurons, helping to advance understanding of the brain. One of the largest citizen science games is Eyewire, a brain-mapping puzzle game developed at the Massachusetts Institute of Technology that now has over 200,000 players.[124] Another example is Quantum Moves, a game developed by the Center for Driven Community Research at Aarhus University, which uses online community efforts to solve quantum physics problems.[125][126] The solutions found by players can then be used in the lab to feed computational algorithms used in building a scalable quantum computer.

More generally, Amazon's Mechanical Turk is frequently used in the creation, collection, and processing of data by paid citizens.[127][111] There is controversy as to whether or not the data collected through such services is reliable, as it is subject to participants' desire for compensation.[129] However, use of Mechanical Turk tends to quickly produce more diverse participant backgrounds, as well as comparably accurate data when compared to traditional collection methods.[130]

The internet has also enabled citizen scientists to gather data to be analyzed by professional researchers.

Citizen science networks are often involved in the observation of cyclic events of nature (phenology), such as effects of global warming on plant and animal life in different geographic areas,[131] and in monitoring programs for natural-resource management.[132][133][134] On BugGuide.Net, an online community of naturalists who share observations of arthropod, amateurs and professional researchers contribute to the analysis. By October 2014, BugGuide has over 808,718 images submitted by more than 27,846 contributors.[135]

Not counting iNaturalist and eBird[5], the Zooniverse is home to the internet's largest, most popular and most successful citizen science projects.[137][138] The Zooniverse and the suite of projects it contains is produced, maintained and developed by the Citizen Science Alliance (CSA).[139] The member institutions of the CSA work with many academic and other partners around the world to produce projects that use the efforts and ability of volunteers to help scientists and researchers deal with the flood of data that confronts them. On June 29, 2015, the Zooniverse released a new software version with a project-building tool allowing any registered user to create a project.[140] Project owners may optionally complete an approval process to have their projects listed on the Zooniverse site and promoted to the Zooniverse community.[141] A NASA/JPL picture to the right gives an example from one of Zooniverse's projects The Milky Way Project.

The website CosmoQuest has as its goal "To create a community of people bent on together advancing our understanding of the universe; a community of people who are participating in doing science, who can explain why what they do matters, and what questions they are helping to answer.[142]

CrowdCrafting enables its participants to create and run projects where volunteers help with image classification, transcription, geocoding and more.[143] The platform is powered by PyBossa software, a free and open-source framework for crowdsourcing.[144]

Project Soothe is a citizen science research project based at the University of Edinburgh.

The aim of this research is to create a bank of soothing images, submitted by members of the public, which can be used to help others through psychotherapy and research in the future.

Since 2015, Project Soothe has received over 600 soothing photographs from people in 23 countries.

Anyone aged 12 years or over are eligible to participate in this research in two ways: (1) By submitting soothing photos that they have taken with a description of why the images make them feel soothed (2) By rating the photos that have been submitted by people worldwide for their soothability.

[145]

Smartphone

The bandwidth and ubiquity afforded by smartphones has vastly expanded the opportunities for citizen science.

Examples include iNaturalist, the San Francisco project, the WildLab, Project Noah,[146][147][148] and Aurorasurus. Due to their ubiquity, for example, Twitter, Facebook, and smartphones have been useful for citizen scientists, having enabled them to discover and propagate a new type of aurora dubbed "STEVE" in 2016.[149]

There are also apps for monitoring birds, marine wildlife and other organisms, and the "Loss of the Night".[150][151]

An Android app Sapelli is a mobile data-collection and -sharing platform designed with a particular focus on non-literate and illiterate users.[152] The SPOTTERON app creates synergy effects for projects by sharing a common feature set.[153]

"The Crowd and the Cloud" is a four-part series broadcast during April 2017, which examines citizen science.[154] It shows how smartphones, computers and mobile technology enable regular citizens to become part of a 21st-century way of doing science.[154] The programs also demonstrate how CSs help professional scientists to advance knowledge, which helps speed up new discoveries and innovations. The Crowd & The Cloud is based upon work supported by the National Science Foundation.[154]

Seismology

Since 1975, in order to improve earthquake detection and collect useful information, the European-Mediterranean Seismological Centre monitors the visits of earthquake eyewitnesses to its website and relies on Facebook and Twitter.[155]

Hydrology

Citizen science has been used to provide valuable data in hydrology (catchment science), notably flood risk, water quality and water resource management.[156][157] A growth in internet use and smartphone ownership has allowed users to collect and share real-time flood-risk information using, for example, social media and web-based forms. Although traditional data collection methods are well-established, citizen science is being used to fill the data gaps on a local level, and is therefore meaningful to individual communities. It has been demonstrated that citizen science is particularly advantageous during a flash flood because the public are more likely to witness these rarer hydrological events than scientists.[158]

Africa, Asia and South America

Snapshot Serengeti classifies animals at the Serengeti National Park in Tanzania

Snapshot Serengeti classifies animals at the Serengeti National Park in Tanzania

Asháninka children in school

Asháninka children in school

Córdoba wetland

Córdoba wetland

There are many CS projects in Africa, Asia and South America. Some examples in Africa are:

  • In South Africa (SA), CS projects include: the Stream Assessment Scoring System (miniSASS) which "encourages enhanced catchment management for water security in a climate stressed society."[159]

  • Also in SA, "Members of the public, or 'citizen scientists' are helping researchers from the University of Pretoria to identify Phytophthora species present in the fynbos."[160]

  • In June 2016, citizen science experts from across East Africa gathered in Nairobi, Kenya for a symposium organised by the Tropical Biology Association (TBA) in partnership with the Centre for Ecology & Hydrology (CEH). The aim was "to harness the growing interest and expertise in East Africa to stimulate new ideas and collaborations in citizen science." Rosie Trevelyan of the TBA said: "We need to enhance our knowledge about the status of Africa's species and the threats facing them. And scientists can't do it all on their own. At the same time, citizen science is an extremely effective way of connecting people more closely to nature and enrolling more people in conservation action".[161]

  • The website Zooniverse hosts several African CS projects, including: Snapshot Serengeti, Wildcam Gorongosa and Jungle Rhythms.[162]

  • Nigeria has the Ibadan Bird Club whose to aim is to "exchange ideas and share knowledge about birds, and get actively involved in the conservation of birds and biodiversity."[163]

  • In Namibia, Giraffe Spotter.org is "project that will provide people with an online citizen science platform for giraffes".[164]

  • Within the Republic of the Congo, the territories of an indigenous people have been mapped so that "the Mbendjele tribe can protect treasured trees from being cut down by logging companies". An Android open-source app called Sapelli was used by the Mbendjele which helped them map "their tribal lands and highlighted trees that were important to them, usually for medicinal reasons or religious significance. Congolaise Industrielle des Bois then verified the trees that the tribe documented as valuable and removed them from its cutting schedule. The tribe also documented illegal logging and poaching activities."[165]

  • In West Africa, the irradication of the recent outbreak of Ebola virus disease was partly helped by CS. "Communities learnt how to assess the risks posed by the disease independently of prior cultural assumptions, and local empiricism allowed cultural rules to be reviewed, suspended or changed as epidemiological facts emerged." "Citizen science is alive and well in all three Ebola-affected countries. And if only a fraction of the international aid directed at rebuilding health systems were to be redirected towards support for citizen science, that might be a fitting memorial to those who died in the epidemic."[166]

Some examples CS projects in Asia are:

  • The Hong Kong Birdwatching Society was established in 1957, and is the only local civil society aiming at appreciating and conserving Hong Kong birds and their natural environment.[167] Their bird surveys go back to 1958, and they carry out a number of Citizen Science events such as their yearly sparrow census.[168]

  • The Bird Count India partnership consists of a large number of organizations and groups involved in birdwatching and bird surveys.

  • They coordinate a number of Citizen Science projects such as the Kerala Bird Atlas and Mysore city Bird Atlas that map the distribution and abundance of birds of entire Indian states.[169]

  • The Taiwan Roadkill Observation Network is a Citizen Science project where roadkill across Taiwan is photographed and sent to the Endemic Species Research Institute for study.

  • Its primary goal has been to set up an eco-friendly path to mitigate roadkill challenges and popularize national discourse on environmental issues and civil participation in scientific research.[170]

  • Japan has a long history of citizen science involvement, the 1,200-year-old tradition of collecting records on cherry blossom flowering probably being the world's longest-running citizen science project.[171] One of the most influential citizen science projects has also come out of Japan: Safecast. Dedicated to open citizen science for the environment, Safecast was established in the wake of the Fukushima nuclear disaster, and produces open hardware sensors for radiation and air-pollution mapping. Presenting this data via a global open data network and maps[172]

CS projects in South America include:

  • In 2015 the Asháninka people from Apiwtxa, which crosses the border between Brazil and Peru, began using the Android app Sapelli to monitor their land. The Ashaninka have "faced historical pressures of disease, exploitation and displacement, and today still face the illegal invasion of their lands by loggers and hunters. This monitoring project shows how the Apiwtxa Ashaninka from the Kampa do Rio Amônia Indigenous Territory, Brazil, are beginning to use smartphones and technological tools to monitor these illegal activities more effectively."[173]

  • In Argentina, two smartphone Android applications are available for CS. i) AppEAR has been developed at the Institute of Limnology and was launched in May 2016.[174] Joaquín Coachman is a researcher who developed an "application that appeals to the collaboration of users of mobile devices in collecting data that allow the study of aquatic ecosystems" (translation).[174] Coachman stated: "Not much of citizen science in Argentina, just a few more oriented to astronomy specific cases. As ours is the first. And I have volunteers from different parts of the country that are interested in joining together to centralize data. That's great because these types of things require many people participate actively and voluntarily" (translation).[174] ii) eBird was launched in 2013, and has so far identified 965 species of birds.[175] eBird in Argentina is "developed and managed by the Cornell Lab of Ornithology at Cornell University, one of the most important ornithological institutions in the world, and locally presented recently with the support of the Ministry of Science, Technology and Productive Innovation of the Nation (MINCyT)" (translation).[175]

  • Projects in Brazil include: i) Platform and mobile app 'Missions' has been developed by IBM in their São Paulo research lab with Brazil's Ministry for Environment and Innovation (BMEI).[176] Sergio Borger, an IBM team lead in São Paulo, devised the crowdsourced approach when BMEI approached the company in 2010. They were looking for a way to create a central repository for the rainforest data.[176] Users can upload photos of a plant species and its components, enter its characteristics (such as color and size), compare it against a catalog photo and classify it. The classification results are juried by crowdsourced ratings.[176] ii) Exoss Citizen Science is a member of Astronomers Without Borders and seeks to explore the southern sky for new meteors and radiants.[177] Users can report meteor fireballs through uploading pictures on to a webpage or by linking to YouTube.[177] A jaguar in Pantanal; an example of Brazilian biodiversity. iii) The Information System on Brazilian Biodiversity (SiBBr) was launched in 2014 "aiming to encourage and facilitate the publication, integration, access and use of information about the biodiversity of the country."[178] Their initial goal "was to gather 2.5 million occurrence records of species from biological collections in Brazil and abroad up to the end of 2016. It is now expected that SiBBr will reach nine million records in 2016." Andrea Portela said: "In 2016, we will begin with the citizen science. They are tools that enable anyone, without any technical knowledge, to participate. With this we will achieve greater engagement with society. People will be able to have more interaction with the platform, contribute and comment on what Brazil has.[178] iv) The Brazilian Marine Megafauna Project (Iniciativa Pro Mar) is working with the European CSA towards its main goal, which is the "sensibilization of society for marine life issues" and concerns about pollution and the over-exploitation of natural resources.[179] Having started as a project monitoring manta ray, it now extends to whale shark and educating schools and divers within the Santos area.[179] Its social media activities include a live streaming of a CS course to help divers identify marine megafauna.[179] v) A smartphone app called Plantix has been developed by the Leibniz Centre for Agricultural Landscape Research (ZALF) which helps Brazilian farmers discover crop diseases quicker and helps fight them more efficiently.[180] Brazil is a very large agricultural exporter, but between 10-30% of crops fail because of disease.[180] "The database currently includes 175 frequently occurring crop diseases and pests as well as 40,000 photos. The identification algorithm of the app improves with every image which records a success rate of over 90 per cent as of approximately 500 photos per crop disease."[180] vi) In an Atlantic Ocean forest region in Brazil, an effort to map the genetic riches of soil is under way.[181] The Drugs From Dirt initiative, based at the Rockefeller University, seeks to turn up bacteria that yield new types of antibiotics- the Brazilian region being particularly rich in potentially useful bacterial genes.[181] Approximately a quarter of the 185 soil samples have been taken by Citizen Scientists without which the project could not run.[181]

  • In Chile CS projects include (some websites in Spanish): i) Testing new cancer therapies with scientists from the Science Foundation for Life.[182] ii) Monitoring the population of the Chilean bumblebee.[183] iii) Monitoring the invasive ladybird Chinita arlequín.[184] iv) Collecting rain water data.[185] v) Monitoring various pollinating fly populations.[186] vi) Providing information and field data on the abundance and distribution of various species of rockfish.[187]

  • Projects in Colombia include (some websites in Spanish): i) The Communications Project of the Humboldt Institute along with the Organization for Education and Environmental Protection initiated projects in the Bogotá wetlands of Cordoba and El Burro, which have a lot of biodiversity.[188][189] ii) In the Model Forest of Risaralda, the Colombia 'proyecto de Ciencia Abierta y Colaborativa' promotes citizen participation in research related to how the local environment is adapting to climate change. The first meeting took place in the Flora and Fauna Sanctuary Otún Quimbaya.[190] iii) The Citizen Network Environmental Monitoring (CLUSTER), based in the city of Bucaramanga, seeks to engage younger students in data science, who are trained in building weather stations with open repositories based on free software and open hardware data.[191] iv) The Symposium on Biodiversity has adapted the CS tool iNaturalist for use in Colombia.[192] v) The Sinchi Amazonic Institute of Scientific Research seeks to encourage the development and diffusion of knowledge, values and technologies on the management of natural resources for ethnic groups in the Amazon. This research should further the use of participatory action research schemes and promoting participation communities.[193]

  • Since 2010, the Pacific Biodiversity Institute (PBI) seeks "volunteers to help identify, describe and protect wildland complexes and roadless areas in South America".

  • The PBI "are engaged in an ambitious project with our Latin American conservation partners to map all the wildlands in South America, to evaluate their contribution to global biodiversity and to share and disseminate this information."[194]

Conferences

The first Conference on Public Participation in Scientific Research was held in Portland, Oregon in August 2012.[195] Citizen science is now often a theme at large conferences, such as the annual meeting of the American Geophysical Union.[196]

In 2010, 2012 and 2014 there were three Citizen Cybersience summits, organised by the Citizen Cyberscience Centre in Geneva.[197] The 2014 summit was hosted in London and attracted over 300 participants.[197]

In January 2015, the ETH Zürich and University of Zürich hosted an international meeting on the "Challenges and Opportunities in Citizen Science".[198]

The first citizen science conference hosted by the Citizen Science Association was in San Jose, California, in February 2015 in partnership with the AAAS conference.[199] The Citizen Science Association conference, CitSci 2017, was held in Saint Paul, Minnesota, United States, between May 17 and 20, 2017. The conference had more than 600 attendees.[200][201] The next CitSci is in March 2019 in Raleigh, USA.[200]

The platform "Österreich forscht" hosts the annual Austrian citizen science conference since 2015.[202]

National and regional portals

Nation or regionPortal
AustraliaAustralian Citizen Science Association[221]
AustraliaAustralian Citizen Science Project Finder[222]
AustriaÖsterreich Forscht[223]
Belgium (Flanders)Citizen Science Vlaanderen[224]
CanadaCitizen science portal[225]
DenmarkCitizen Science Portalen[226]
FranceOpen[227]
GermanyBürger schaffen Wissen[228]
GlobalSciStarter[229]SciStarter
GlobalZooniverse: People-powered research[230]
IrelandEnvironmental Protection Agency[231]
Netherlands and FlandersEOS Wetenschap[232]
ScotlandCitizen Science with TCV[233].
SpainObservatorio De La Ciencia Ciudadana[234]
SwedenArenas for co-operation through citizen science[235]
SwitzerlandSchweiz Forscht[236]
United KingdomUK Environment Observation Framework[237]
United StatesUSA Government Official Website[238]

See also

  • Genealogy

  • Independent scientist

  • Independent scholar

  • List of citizen science projects

  • List of distributed computing projects

  • Open science

  • Open-Source Lab (book)

  • Outsider art (produced by artists that are non-institutionalized, in the same way as citizen scientists)

  • Participation (decision making)

  • Reinventing Discovery

  • Popular science

  • Public participation

  • Scientific instrument

  • Virtual volunteering

References

[1]
Citation Link//www.ncbi.nlm.nih.gov/pubmed/23586092Gura, Trisha (2013). "Citizen science: amateur experts". Nature. 496 (7444): 259–261. doi:10.1038/nj7444-259a. PMID 23586092.
Sep 20, 2019, 12:43 AM
[2]
Citation Link//www.ncbi.nlm.nih.gov/pubmed/20686547Hand, E. (2010). "Citizen science: People power". Nature. 466 (7307): 685–687. doi:10.1038/466685a. PMID 20686547.
Sep 20, 2019, 12:43 AM
[3]
Citation Link//doi.org/10.1145%2F3292522.3326022C. Doyle; R. David; Y.Li; M. Luczak-Roesch; D. Anderson; C.M Pearson (30 June 2019). Using the Web for Science in the Classroom: Online Citizen Science Participation in Teaching and Learning. doi:10.1145/3292522.3326022. ISBN 978-1-4503-6202-3. Retrieved 30 July 2019.
Sep 20, 2019, 12:43 AM
[4]
Citation Linkwww.alexa.com"Alexa.com".
Sep 20, 2019, 12:43 AM
[5]
Citation Linkwww.alexa.com"Alexa.com: inaturalist.org Competitive Analysis, Marketing Mix and Traffic".
Sep 20, 2019, 12:43 AM
[6]
Citation Linkwww.alexa.com"Alexa.com: ebird.org Competitive Analysis, Marketing Mix and Traffic".
Sep 20, 2019, 12:43 AM
[7]
Citation Linkwww.alexa.com"Alexa.com: zooniverse.org Competitive Analysis, Marketing Mix and Traffic".
Sep 20, 2019, 12:43 AM
[8]
Citation Link//www.ncbi.nlm.nih.gov/pubmed/23982281H. Riesch; C. Potter (2014). "Citizen science as seen by scientists: Methodological, epistemological and ethical dimensions". Public Understanding of Science. 23 (1): 107–120. doi:10.1177/0963662513497324. PMID 23982281.
Sep 20, 2019, 12:43 AM
[9]
Citation Linkopenlibrary.orgAlan Irwin (1995). Citizen Science: A Study of People, Expertise and Sustainable Development. Routledge.
Sep 20, 2019, 12:43 AM
[10]
Citation Linkopenlibrary.orgR. Bonney; H. Ballard; R. Jordan; E. McCallie; T. Phillips; J. Shirk; C. C. Wilderman (2009). "Bonney et al. 2009 CAISE Report on Public Participation in Scientific Research. A CAISE Inquiry Group Report". Washington, D.C.: Center for Advancement of Informal Science Education (CAISE).
Sep 20, 2019, 12:43 AM
[11]
Citation Linkopenlibrary.orgCavalier, Darlene; Kennedy, Eric (2016). The Rightful Place of Science: Citizen Science. Tempe, AZ: Consortium for Science, Policy & Outcomes. p. 54. ISBN 9780692694831.
Sep 20, 2019, 12:43 AM
[12]
Citation Linkpublic.oed.com"New words list June 2014". Oxford English Dictionary. Archived from the original on 9 May 2016. Retrieved 3 June 2016.
Sep 20, 2019, 12:43 AM
[13]
Citation Linkweb.archive.org"'Citizen science' added to Oxford English Dictionary". The Daily Zooniverse. 16 September 2014. Archived from the original on 16 June 2016. Retrieved 3 June 2016.
Sep 20, 2019, 12:43 AM
[14]
Citation Linkopenlibrary.orgJames Oberg (11 October 1979). "The Failure of the 'Science' of Ufology". New Scientist. Vol. 84 no. 1176. pp. 102–105.
Sep 20, 2019, 12:43 AM
[15]
Citation Linkweb.archive.orgMuki Haklay (2015). "Citizen Science and Policy: A European Perspective" (PDF). Woodrow Wilson International Center for Scholars. p. 11. Archived (PDF) from the original on 18 October 2016. Retrieved 3 June 2016.
Sep 20, 2019, 12:43 AM
[16]
Citation Linkopenlibrary.orgR. Kerson (1989). "Lab for the Environment". MIT Technology Review. Vol. 92 no. 1. pp. 11–12.
Sep 20, 2019, 12:43 AM
[17]
Citation Linkweb.archive.org"Green paper on Citizen Science for Europe: Towards a society of empowered citizens and enhanced research". European Commission. 21 January 2014. Archived from the original on 17 October 2016. Retrieved 18 August 2016.
Sep 20, 2019, 12:43 AM
[18]
Citation Linkweb.archive.org"Green paper on Citizen Science". Socientize.eu. 2013. p. 6. Archived from the original on 26 December 2015. Retrieved 18 August 2016.
Sep 20, 2019, 12:43 AM
[19]
Citation Link//www.ncbi.nlm.nih.gov/pubmed/19586682Silvertown, Jonathan (2009). "A new dawn for citizen science". Trends in Ecology & Evolution. 24 (9): 467–471. doi:10.1016/j.tree.2009.03.017. PMID 19586682.
Sep 20, 2019, 12:43 AM
[20]
Citation Link//doi.org/10.1061%2F40761%28175%2957Osborn, D. A. (2002). "Monitoring Rocky Intertidal Shorelines: A Role for the Public in Resource Management". California and the World Ocean 02. 175. p. 57. doi:10.1061/40761(175)57. ISBN 978-0-7844-0761-5.
Sep 20, 2019, 12:43 AM