Skip to content

Latest commit

 

History

History
804 lines (633 loc) · 45.4 KB

200.en.adoc

File metadata and controls

804 lines (633 loc) · 45.4 KB

Data packaging and mapping

This chapter focuses on practical details on turning your data export into a dataset indexed by a biodiversity data platform. Categorization of your data will help you understand what is the optimal mapping schema for your data at hand. Data mapping describes these mappings in detail.

Data packaging and publishing pathways vary from platform to platform and are described in general documentation. One of the widespread ways to package data files is currently DwC-A, where data tables are arranged in a star schema, with records (rows) in peripheral extension files pointing to a single record in the central core file (Zoom in of DwC-A / IPT from figure 3 in chapter 1.2. The choice of core entity is mainly a matter of fitting data to the data import mechanism (ingestion) of the biodiversity data platforms. Most data could be formulated as either Occurrence, Event or Taxon core, but as only the core can have extensions, this will affect the choice. It is for example not possible to extend occurrences with DNA sequences if data are packaged using Event core.). The different types of core files (e.g. occurrence and sampling-event) correspond to different classes of datasets. Although DNA-derived datasets often are event-based in nature, i.e. hundreds or even thousands of quantified sequence occurrences may derive from a single sampling event and thus share most metadata attributes, the current recommendation is to publish data as Occurrence core (Category I or II) with the DNA derived data extension. This approach compensates for limitations of the DwC star schema, which would not allow any occurrence-level data in extension files (such as processed barcode sequences) to point to records in an event core file. We do, however, recommend including an eventID for each core record, to indicate the association between occurrences derived from the same sampling event.

dwca structure.en
Figure 1. Zoom in of DwC-A / IPT from figure 3 in chapter 1.2. The choice of core entity is mainly a matter of fitting data to the data import mechanism (ingestion) of the biodiversity data platforms. Most data could be formulated as either Occurrence, Event or Taxon core, but as only the core can have extensions, this will affect the choice. It is for example not possible to extend occurrences with DNA sequences if data are packaged using Event core.

Categorization of your data

For the purpose of this guide, we categorize data into five categories, linked by a key ID field (eventID), equivalent to the standards for general biodiversity data, and include fields relevant for DNA-derived data (see Data mapping). These five categories seek to reflect the most commonly used molecular approaches to biodiversity characterization and are I) DNA-derived occurrences, II) enriched occurrences, III) targeted species detection, IV) name references and V) metadata only. Examine the decision tree and proceed to the correct section below.

Table 1. A decision tree for DNA-derived data categorization.

[question circle] Is your data (meta)barcoding or qPCR based?

(Meta)barcoding

qPCR

[question circle] Does data consist of digitized genetic material, or sequences, associated with location and time?

Category III
Targeted species detection

Yes

No

[question circle] Is the genetic material the only evidence of a given organism or community?

[question circle] Is the dataset a list of DNA-based names?

Yes

No

Yes

No

Category I
DNA-based occurrences

Category II
Enriched occurrences

Category IV
Name references

Category V
Metadata-only

eDNA categories.en
Figure 2. Visual representation of categories I-V.

Category I: DNA-derived occurrences

This category concerns data where a DNA sequence or detection through PCR is the only evidence for the presence of a given organism or community. In other words, the data cannot be traced back to an observable specimen. This is the case for many metagenomics, metabarcoding and eDNA studies.

Examples of DNA-derived occurrence datasets

For guidance on how to format and share these datasets, see Mapping metabarcoding (eDNA) and barcoding data. General guidelines for Darwin Core occurrence datasets are also available through the DwC-A template for occurrence datasets and Data quality requirements for occurrences.

Category II: Enriched occurrences

If some genetic material is, or can be, associated with an observation or a specimen, we will categorize this type of data as “enriched occurrences”. In this context, the sequences are not the only evidence of occurrences. One can always trace the information back to a vouchered specimen or observed organism. This category includes barcoding datasets and some DNA metabarcoding datasets with reference material for example. For more guidance on barcoding, follow Centre for Biodiversity Genomics, University of Guelph (2021).

Examples of Enriched occurrence datasets
  • The International Barcode of Life Consortium (2016) International Barcode of Life project (iBOL). Occurrence dataset https://doi.org/10.15468/inygc6 accessed via GBIF.org on 2020-04-16.

  • Takamura K (2019) Chironomid Specimen records in the Chironomid DNA Barcode Database. Version 1.9. National Institute of Genetics, ROIS. Occurrence dataset https://doi.org/10.15468/hxhow5 accessed via GBIF.org on 2020-04-16.

  • Bessey C, Jarman SN, Stat M, Rohner CA, Bunce M, Koziol A, Power M, Rambahiniarison JM, Ponzo A, Richardson AJ & Berry O (2019) DNA metabarcoding assays reveal a diverse prey assemblage for Mobula rays in the Bohol Sea, Philippines. Ecology and Evolution 9 (5) 2459-2474. https://doi.org/10.1002/ece3.4858, (Atlas of Living Australia website at https://collections.ala.org.au/public/show/dr11663. Accessed 24 June 2020)

For guidance on how to format and share these datasets, see Mapping metabarcoding (eDNA) and barcoding data. General guidelines for Darwin Core occurrence datasets are also available through the DwC-A template for occurrence datasets and Data quality requirements for occurrences.

Category III: Targeted species detection (qPCR/ddPCR)

This category concerns data where a specific (qPCR/ddPCR) assay is used to detect the presence (or absence) of a DNA sequence specific to the target organism in an environmental sample. In this case the occurrence record may not even contain sequence data, as it is the process itself that determines the occurrence. With qPCR/ddPCR analyses for targeted species detection, many studies also report absence of that specific species for a given sample. Absence data is highly dependent on the detection limit of the specific assay, as well as field and lab protocols. As for DNA-metabarcoding data there is an issue of both false negatives and false positives, and it is important that sufficient information is reported for evaluating the records.

Examples of targeted species occurrence datasets
  • Strzelecki, Joanna; Feng, Ming; Berry, Olly; Zhong, Liejun; Keesing, John; Fairclough, David; Pearce, Alan; Slawinski, Dirk; Mortimer, Nick. Location and transport of early life stages of Western Australian Dhufish Glaucosoma hebraicum. Floreat, WA: Fisheries Research and Development Corporation; 2013. http://hdl.handle.net/102.100.100/97533 (Atlas of Living Australia website at https://collections.ala.org.au/public/show/dr8131. Accessed 22 July 2020)

For guidance on how to format and share these datasets, see Mapping ddPCR / qPCR data. General guidelines for Darwin Core occurrence datasets are also available through the DwC-A template for occurrence datasets and Data quality requirements for occurrences.

Category IV: Name references

This category corresponds to DNA-derived names, derived from clustering or denoising (error-correction based models), such as stable non-Linnaean Operational Taxonomic Units (OTU), Amplicon Sequence Variant (ASV) and Barcode Index Numbers (BIN)—in other words, any reference to taxa or provisional names that are defined outside of the Linnaean taxonomy. Numerous projects produce local project- or study-specific libraries of OTUs, and although it is technically possible to publish these as checklists, they have limited to no value for data linking or interpretation; as a result, we do not encourage their publication through biodiversity data platforms. However, the inclusion of the widely adopted, stable, global, digitally referenceable OTUs into Linnaean taxonomic backbones is critically important for indexing unnamed “dark” biodiversity. GBIF have accumulated experience in integrating such large and global reference libraries of OTUs into the GBIF taxonomic backbone, which allows the display of OTUs under the nearest parent taxon which has a Scientific name (OTUs (SHs) from UNITE (mainly fungi, above) and from BOLD (BINs) (mainly arthropods, below) are displayed in the GBIF backbone taxonomy under their corresponding parent taxa which have Scientific names. Multiple individually observed occurrences of cryptic biodiversity become discoverable together with non-genetic evidence through a single access point.).

otus from unite.en
Figure 3. OTUs (SHs) from UNITE (mainly fungi, above) and from BOLD (BINs) (mainly arthropods, below) are displayed in the GBIF backbone taxonomy under their corresponding parent taxa which have Scientific names. Multiple individually observed occurrences of cryptic biodiversity become discoverable together with non-genetic evidence through a single access point.
Examples of Name references checklists
  • The International Barcode of Life Consortium (2016). International Barcode of Life project (iBOL) Barcode Index Numbers (BINs). Checklist dataset https://doi.org/10.15468/wvfqoi accessed via GBIF.org on 2020-04-16.

  • PlutoF (2019). UNITE - Unified system for the DNA based fungal species linked to the classification. Version 1.2. Checklist dataset https://doi.org/10.15468/mkpcy3 accessed via GBIF.org on 2020-04-16.

This guide does not provide mapping recommendations for global OTU checklists / reference libraries (Category IV), and publishing referenceable (project- or study-specific) OTU libraries as checklists is discouraged. For guidance on how to format and share OTU checklists, see the following general Darwin Core guidelines in DwC-A template for checklists and Data quality requirements for checklists. General guidelines for MIxS checklists. For advice on how to map global reference libraries of OTUs for inclusion in the GBIF taxonomic backbone, contact the GBIF help desk.

Category V: Metadata-only datasets

Metadata are data about the data and is a description of the dataset in broad terms, such as authors, author affiliations, original research purpose of the dataset, DOI(s), taxonomic scope, temporal scope, and geographical scope. Information regarding laboratory methods and general sequencing methods is included in this category. This category includes datasets or collections that cannot be made available online at the moment, e.g. undigitized work.

Examples of Metadata-only datasets
  • Collins E, Sweetlove M (2019). Arctic Ocean microbial metagenomes sampled aboard CGC Healy during the 2015 GEOTRACES Arctic research cruise. SCAR - Microbial Antarctic Resource System. Metadata dataset https://doi.org/10.15468/iljmun accessed via GBIF.org on 2020-04-16.

  • Cary S C (2015). New Zealand Terrestrial Biocomplexity Survey. SCAR - Microbial Antarctic Resource System. Metadata dataset https://doi.org/10.15468/xnzrhq accessed via GBIF.org on 2020-04-16.

Mapping recommendations for metadata-only DNA-derived datasets (Category V) is the same as for any other metadata-only datasets, and this guide does not provide any specific mapping recommendations for metadata. Please follow general recommendations of biodiversity data portals, paying attention to required and recommended metadata. Descriptions of field, lab, and bioinformatics steps should be as detailed as possible. Describing your methods as method steps in the EML metadata makes them display on the dataset homepage in GBIF (https://www.gbif.org/dataset/3b8c5ed8-b6c2-4264-ac52-a9d772d69e9f#methodology Frøslev T, Ejrnæs R (2018). BIOWIDE eDNA Fungi dataset. Danish Biodiversity Information Facility. Occurrence dataset https://doi.org/10.15468/nesbvx accessed via GBIF.org on 2021-07-06). However, if a structured and possibly more detailed method description is already published somewhere (e.g. at protocols.io or NEON protocols collection), it is straightforward to provide a link through the MIxS SOP field (see Mapping metabarcoding (eDNA) and barcoding data).

Data mapping

While core files store ubiquitous data on the 'what, where and when' of a record, extension files are used to describe the specifics of a certain type of observation. We propose using the DNA derived data extension to complement occurrence data derived from either barcoding, metabarcoding (eDNA) or qPCR/ddPCR. The DNA derived data extension builds on the Minimum information standards developed by the Genomic Standards Consortium (GSC) and applied by the ENA for submission of eDNA sample metadata, for example. We are following and have contributed to the guidelines proposed by the Sustainable DwC-MIxS interoperability task group under TDWG. To improve indexing and search we have opted to split some MIxS terms, for instance separating forward and reverse primer sequences and names. Furthermore, some fields from the GGBN standard and fields from the MIQE (minimum information for the publication of quantitative real-time PCR) guidelines for qPCR and ddPCR data have been included to make it applicable for a wide range of DNA-derived data.

As a first step in preparing your data for publishing, you should make sure your field names / column headers follow the Darwin Core data standard. In many cases this is straightforward, such as renaming your lat or latitude field to decimalLatitude. However, the Darwin Core Standard is quite flexible and some terms are used in different ways, depending on the type of data. An example of this are the fields term:dwc[organismQuantity] and term:dwc[organismQuantityType], which could be used to describe the number of individuals, per cent biomass or a score on the Braun-Blanquet Scale, as well as the number of reads of an ASV within a sample. Therefore, we here provide tables of required and recommended fields with descriptions and examples (Table 1, Table 2, Table 3 and Table 4). The recommendation to use the Occurrence core for DNA-derived data stems from the strong desire to share the sequence to help qualify the determination. Additional fields and extensions (such as extended Measurement or Fact (eMoF)) are applicable - both to occurrence cores and event core. When a sequence is derived from an organism (e.g. a parasite, gut contents, epibiont etc.) the observation may be linked to the observation of the host organism. This can be achieved using the (Resource Relation extension) of Darwin Core (e.g. https://www.gbif.org/species/143610775/verbatim). Perhaps the most important recommendation is to use globally unique (when available) and other permanent identifiers for as many data fields and parameters as possible (in all ID fields in the tables below).

Mapping metabarcoding (eDNA) and barcoding data

This section provides mapping recommendations for Categories I and II.

Table 2. Recommended fields for Occurrence core for Metabarcoding data
Field name Examples Description Required

term:dwc[basisOfRecord]

MaterialSample

The specific nature of the data record - a subtype of the dcterms:type. For DNA-derived occurrences, (see Category I and Category III) use MaterialSample. For enriched occurrences use PreservedSpecimen or LivingSpecimen as appropriate.

Required

term:dwc[occurrenceID]

urn:catalog:UWBM:Bird:89776

A unique identifier for the occurrence, allowing the same occurrence to be recognized across dataset versions as well as through data downloads and use. May be a global unique identifier or an identifier specific to the data set.

Required

term:dwc[eventID]

urn:uuid:a964765b-22c4-439a-jkgt-2

An identifier for the set of information associated with an Event (something that occurs at a place and time). May be a global unique identifier or an identifier specific to the data set.

Highly recommended

term:dwc[eventDate]

2020-01-05

Date when the event was recorded. Recommended best practice is to use a date that conforms to ISO 8601-1:2019. For more information, check https://dwc.tdwg.org/terms/#dwc:eventDate

Required

term:dwc[recordedBy]

"Oliver P. Pearson | Anita K. Pearson"

A list (concatenated and separated) of names of people, groups, or organizations responsible for recording the original Occurrence. The recommended best practice is to separate the values with a vertical bar (' | '). Including information about the observer improves the scientific reproducibility (Groom et al. 2020).

Highly recommended

term:dwc[organismQuantity]

33

Number of reads of this OTU or ASV in the sample.

Highly recommended

term:dwc[organismQuantityType]

DNA sequence reads

Should always be “DNA sequence reads”

Highly recommended

term:dwc[sampleSizeValue]

1233890

Total number of reads in the sample. This is important since it allows calculating the relative abundance of each OTU or ASV within the sample. This number should preferably be calculated after universal processing (quality control, ASV denoising, chimera removal, etc.), but before manual/selective removal of e.g. non-target OTUs or ASVs from the dataset. Rarefaction (resampling to even sequencing depth across samples) is not necessary or advised.

Highly recommended

term:dwc[sampleSizeUnit]

DNA sequence reads

Should always be “DNA sequence reads”

Highly recommended

term:dwc[materialSampleID]

https://www.ncbi.nlm.nih.gov/biosample/15224856

https://www.ebi.ac.uk/ena/browser/view/SAMEA3724543

urn:uuid:a964805b-33c2-439a-beaa-6379ebbfcd03

An identifier for the MaterialSample (as opposed to a particular digital record of the material sample). Use the biosample ID if one was obtained from a nucleotide archive. In the absence of a persistent global unique identifier, construct one from a combination of identifiers in the record that will most closely make the materialSampleID globally unique.

Highly recommended

term:dwc[samplingProtocol]

UV light trap

The name of, reference to, or description of the method or protocol used during a sampling Event. https://dwc.tdwg.org/terms/#dwc:samplingProtocol

Recommended

term:dwc[associatedSequences]

https://www.ncbi.nlm.nih.gov/nuccore/MK405371

A list (concatenated and separated) of identifiers (publication, global unique identifier, URI) of genetic sequence information associated with the Occurrence. Could be used for linking to archived raw barcode reads and/or associated genome sequences, e.g. in a public repository.

Recommended

term:dwc[identificationRemarks]

RDP annotation confidence (at lowest specified taxon): 0.96, against reference database: GTDB

Specification of taxonomic identification process, ideally including data on applied algorithm and reference database, as well as on level of confidence in the resulting identification.

Recommended

term:dwc[identificationReferences]

https://www.ebi.ac.uk/metagenomics/pipelines/4.1

https://github.com/terrimporter/CO1Classifier

A list (concatenated and separated) of references (publication, global unique identifier, URI) used in the Identification. Recommended best practice is to separate the values in a list with space vertical bar space ( | ).

Recommended

term:dwc[decimalLatitude]

60.545207

The geographic latitude (in decimal degrees, using the spatial reference system given in geodeticDatum) of the geographic centre of a Location. Positive values are north of the Equator, negative values are south of it. Legal values lie between -90 and 90, inclusive.

Highly recommended

term:dwc[decimalLongitude]

24.174556

The geographic longitude (in decimal degrees, using the spatial reference system given in geodeticDatum) of the geographic centre of a Location. Positive values are east of the Greenwich Meridian, negative values are west of it. Legal values lie between -180 and 180, inclusive.

Highly recommended

term:dwc[taxonID]

ASV:7bdb57487bee022ba30c03c3e7ca50e1

For eDNA data, it is recommended to use an MD5 hash of the sequence and prepend it with “ASV:”. See also [taxonomy-of-sequences].

Highly recommended, if DNA_sequence is not provided

term:dwc[scientificName]

Gadus morhua L. 1758, BOLD:ACF1143

Scientific name of the closest known taxon (species or higher) or an OTU identifier from BOLD (BIN) or UNITE (SH)

Required

term:dwc[kingdom]

Animalia

Higher taxonomy

Highly recommended

term:dwc[phylum]

Chordata

Higher taxonomy

Recommended

term:dwc[class]

Actinopterygii

Higher taxonomy

Recommended

term:dwc[order]

Gadiformes

Higher taxonomy

Recommended

term:dwc[family]

Gadidae

Higher taxonomy

Recommended

term:dwc[genus]

Gadus

Higher taxonomy

Recommended

Table 3. Recommended fields from the DNA derived data extension (a selection) for metabarcoding data
Field name Examples Description Required

term:mixs[DNA_sequence]

TCTATCCTCAATTATAGGTCATAATTCACCATCAGTAGATTTAGGAATTTTCTCTATTCATATTGCAGGTGTATCATCAATTATAGGATCAATTAATTTTATTGTAACAATTTTAAATATACATACAAAAACTCATTCATTAAACTTTTTACCATTATTTTCATGATCAGTTCTAGTTACAGCAATTCTCCTTTTATTATCATTA

The DNA sequence (ASV). Taxonomic interpretation of the sequence depends on the technology and reference library available at the time of publication. Hence, the most objective taxonomic handle is the sequence which can be reinterpreted in the future.

Highly recommended

term:mixs[sop]

https://www.protocols.io/view/emp-its-illumina-amplicon-protocol-pa7dihn

Standard operating procedures used in assembly and/or annotation of genomes, metagenomes or environmental sequences.

A reference to a well documented protocol, e.g. using protocols.io

Recommended

term:mixs[target_gene]

16S rRNA, 18S rRNA, ITS

Targeted gene or marker name for marker-based studies

Highly recommended

term:mixs[target_subfragment]

V6, V9, ITS2

Name of subfragment of a gene or markerImportant to e.g. identify special regions on marker genes like the hypervariable V6 region of the 16S rRNA gene

Highly recommended

term:mixs[pcr_primer_forward]

GGACTACHVGGGTWTCTAAT

Forward PCR primer that was used to amplify the sequence of the targeted gene, locus or subfragment.

Highly recommended

term:mixs[pcr_primer_reverse]

GGACTACHVGGGTWTCTAAT

Reverse PCR primer that was used to amplify the sequence of the targeted gene, locus or subfragment.

Highly recommended

term:mixs[pcr_primer_name_forward]

jgLCO1490

Name of the forward PCR primer

Highly recommended

term:mixs[pcr_primer_name_reverse]

jgHCO2198

Name of the reverse PCR primer

Highly recommended

term:mixs[pcr_primer_reference]

https://doi.org/10.1186/1742-9994-10-34

Reference for the primers

Highly recommended

term:mixs[env_broad_scale]

forest biome [ENVO:01000174]

Equivalent to env_biome in MIxS v4
In this field, report which major environmental system your sample or specimen came from. The systems identified should have a coarse spatial grain, to provide the general environmental context of where the sampling was done (e.g. were you in the desert or a rainforest?). We recommend using subclasses of ENVO’s biome class:
http://purl.obolibrary.org/obo/ENVO_00000428

Recommended

term:mixs[env_local_scale]

litter layer [ENVO:01000338]

Equivalent to env_feature in MIxS v4
In this field, report the entity or entities which are in your sample or specimen´s local vicinity and which you believe have significant causal influences on your sample or specimen. Please use terms that are present in ENVO and which are of smaller spatial grain than your entry for env_broad_scale.

Recommended

term:mixs[env_medium]

soil[ENVO:00001998]

Equivalent to env_material in MIxS v4
In this field, report which environmental material or materials (pipe separated) immediately surrounded your sample or specimen prior to sampling, using one or more subclasses of ENVO´s environmental material class:
http://purl.obolibrary.org/obo/ENVO_00010483

Recommended

term:mixs[lib_layout]

Paired

Equivalent to lib_const_meth in MIxS v4
Specify whether to expect single, paired, or other configuration of reads

Recommended

term:mixs[seq_meth]

Illumina HiSeq 1500

Sequencing method/platform used

Highly recommended

term:mixs[otu_class_appr]

"dada2; 1.14.0; ASV"

Approach/algorithm and clustering level (if relevant) when defining OTUs or ASVs

Highly recommended

term:mixs[otu_seq_comp_appr]

"blastn;2.6.0+;e-value cutoff: 0.001"

Tool and thresholds used to assign "species-level" names to OTUs or ASVs

Highly recommended

term:mixs[otu_db]

"Genbank nr;221", "UNITE;8.2"

Reference database (i.e. sequences not generated as part of the current study) used to assigning taxonomy to OTUs or ASVs

Highly recommended

Mapping ddPCR / qPCR data

This section provides mapping recommendations for Category III.

Table 4. Recommended fields for Occurrence core for ddPCR/qPCR data
Field name Examples Description Required

term:dwc[basisOfRecord]

MaterialSample

The specific nature of the data record - a subtype of the dcterms:type. For DNA-derived occurrences (see Category I and Category III), use MaterialSample.

Required

term:dwc[occurrenceStatus]

Present, Absent

A statement about the presence or absence of a taxon at a location.

Required

term:dwc[eventID]

urn:uuid:a964765b-22c4-439a-jkgt-2

An identifier for the set of information associated with an Event (something that occurs at a place and time). May be a global unique identifier or an identifier specific to the dataset.

Highly recommended

term:dwc[eventDate]

2020-01-05

Date when the event was recorded. Recommended best practice is to use a date that conforms to ISO 8601-1:2019. For more information, check https://dwc.tdwg.org/terms/#dwc:eventDate

Required

term:dwc[recordedBy]

"Oliver P. Pearson | Anita K. Pearson"

A list (concatenated and separated) of names of people, groups, or organizations responsible for recording the original Occurrence. The recommended best practice is to separate the values with a vertical bar (' | '). Including information about the observer improves the scientific reproducibility (Groom et al. 2020).

Highly recommended

term:dwc[organismQuantity]

50

Number of positive droplets/chambers in the sample

Highly recommended for ddPCR, dPCR

term:dwc[organismQuantityType]

ddPCR droplets
dPCR chambers

The partition type

Highly recommended for ddPCR, dPCR

term:dwc[sampleSizeValue]

20000

The number of accepted partitions (n), e.g. meaning accepted droplets in ddPCR or chambers in dPCR.

Highly recommended for ddPCR, dPCR

term:dwc[sampleSizeUnit]

ddPCR droplets
dPCR chambers

The partition type, should be equal to the value in organismQuantityType

Highly recommended for ddPCR, dPCR

term:dwc[materialSampleID]

https://www.ncbi.nlm.nih.gov/biosample/15224856

urn:uuid:a964805b-33c2-439a-beaa-6379ebbfcd03

An identifier for the MaterialSample (as opposed to a particular digital record of the material sample). Use the biosample ID if one was obtained from a nucleotide archive. In the absence of a persistent global unique identifier, construct one from a combination of identifiers in the record that will most closely make the materialSampleID globally unique.

Highly recommended

term:dwc[samplingProtocol]

UV light trap

The name of, reference to, or description of the method or protocol used during a sampling Event. https://dwc.tdwg.org/terms/#dwc:samplingProtocol

Recommended

term:dwc[decimalLatitude]

60.545207

The geographic latitude (in decimal degrees, using the spatial reference system given in geodeticDatum) of the geographic centre of a Location. Positive values are north of the Equator, negative values are south of it. Legal values lie between -90 and 90, inclusive.

Highly recommended

term:dwc[decimalLongitude]

24.174556

The geographic longitude (in decimal degrees, using the spatial reference system given in geodeticDatum) of the geographic centre of a Location. Positive values are east of the Greenwich Meridian, negative values are west of it. Legal values lie between -180 and 180, inclusive.

Highly recommended

term:dwc[scientificName]

Gadus morhua L. 1758, BOLD:ACF1143

Scientific name of the closest known taxon (species or higher) or an OTU identifier from BOLD or UNITE

Required

term:dwc[kingdom]

Animalia

Higher taxonomy

Highly recommended

term:dwc[phylum]

Chordata

Higher taxonomy

Recommended

term:dwc[class]

Actinopterygii

Higher taxonomy

Recommended

term:dwc[order]

Gadiformes

Higher taxonomy

Recommended

term:dwc[family]

Gadidae

Higher taxonomy

Recommended

term:dwc[genus]

Gadus

Higher taxonomy

Recommended

Table 5. Recommended fields from the DNA derived data extension (a selection) for ddPCR/qPCR data
Field name Examples Description Required

term:mixs[sop]

https://www.protocols.io/view/protocol-for-dna-extraction-and-quantitative-pcr-d-vwie7ce

https://doi.org/10.17504/protocols.io.vwie7ce

Standard operating procedures used in assembly and/or annotation of genomes, metagenomes or environmental sequences.
A reference to a well documented protocol, e.g. using protocols.io

Highly recommended

term:mixs[annealingTemp]

60

The reaction temperature during the annealing phase of PCR.

Required if annealingTemp was supplied

term:mixs[annealingTempUnit]

Degrees Celsius

Highly recommended

term:mixs[pcr_cond]

initial denaturation:94_3;annealing:50_1;elongation:72_1.5;final elongation:72_10;35

Description of reaction conditions and components of PCR in the form of "initial denaturation:94degC_1.5min; annealing=…​"

Highly recommended

term:mixs[probeReporter]

FAM

Type of fluorophore (reporter) used. Probe anneals within amplified target DNA. Polymerase activity degrades the probe that has annealed to the template, and the probe releases the fluorophore from it and breaks the proximity to the quencher, thus allowing fluorescence of the fluorophore.

Highly recommended

term:mixs[probeQuencher]

NFQ-MGB

Type of quencher used. The quencher molecule quenches the fluorescence emitted by the fluorophore when excited by the cycler’s light source as long as fluorophore and the quencher are in proximity, quenching inhibits any fluorescence signals.

Highly recommended

term:mixs[ampliconSize]

83

The length of the amplicon in basepairs

Highly recommended

term:mixs[thresholdQuantificationCycle]

0.3

Threshold for change in fluorescence signal between cycles

qPCR: Highly recommended

term:mixs[baselineValue]

15

The number of cycles when fluorescence signal from the target amplification is below background fluorescence not originated from the real target amplification.

qPCR: Highly recommended

term:mixs[quantificationCycle]

37.9450950622558

The number of cycles required for the fluorescent signal to cross a given value threshold above the baseline. Quantification cycle (Cq), threshold cycle (Ct), crossing point (Cp), and take-off point (TOP) refer to the same value from the real-time instrument. Use of quantification cycle (Cq), is preferable according to the RDML (Real-Time PCR Data Markup Language) data standard

term:mixs[automaticThresholdQuantificationCycle]

no

Whether the threshold was set by instrument or manually

term:mixs[automaticBaselineValue]

no

Whether baseline value was set by instrument or manually

term:mixs[contaminationAssessment]

no

Whether DNA or RNA contamination assessment was done or not

term:mixs[estimatedNumberOfCopies]

10300

Number of target molecules per µl. Mean copies per partition (?) can be calculated using the number of partitions (n) and the estimated copy number in the total volume of all partitions (m) with a formula ?=m/n.

term:mixs[amplificationReactionVolume]

22

PCR reaction volume

term:mixs[amplificationReactionVolumeUnit]

µl

Unit used for PCR reaction volume. Many of the instruments require preparation of a much larger initial sample volume than is actually analysed.

term:mixs[pcr_analysis_software]

BIO-RAD QuantaSoft

The program used to analyse the d(d)PCR runs.

term:mixs[experimentalVariance]

Multiple biological replicates are encouraged to assess total experimental variation. When single dPCR experiments are performed, a minimal estimate of variance due to counting error alone must be calculated from the binomial (or suitable equivalent) distribution.

term:mixs[target_gene]

16S rRNA, 18S rRNA, nif, amoA, rpo

Targeted gene or marker name for marker-based studies

Highly recommended

term:mixs[target_subfragment]

V6, V9, ITS

Name of subfragment of a gene or markerImportant to identify, for example, special regions on marker genes like the hypervariable V6 region of the 16S rRNA gene

Highly recommended

term:mixs[pcr_primer_forward]

GGACTACHVGGGTWTCTAAT

Forward PCR primer that was used to amplify the sequence of the targeted gene, locus or subfragment.

Highly recommended

term:mixs[pcr_primer_reverse]

GGACTACHVGGGTWTCTAAT

Reverse PCR primer that was used to amplify the sequence of the targeted gene, locus or subfragment.

Highly recommended

term:mixs[pcr_primer_name_forward]

jgLCO1490

Name of the forward PCR primer

Highly recommended

term:mixs[pcr_primer_name_reverse]

jgHCO2198

Name of the reverse PCR primer

Highly recommended

term:mixs[pcr_primer_reference]

https://doi.org/10.1186/1742-9994-10-34

Reference for the primers

Highly recommended

term:mixs[env_broad_scale]

forest biome [ENVO:01000174]

Equivalent to env_biome in MIxS v4
In this field, report which major environmental system your sample or specimen came from. The systems identified should have a coarse spatial grain, to provide the general environmental context of where the sampling was done (e.g. were you in the desert or a rainforest?). We recommend using subclasses of ENVO´s biome class:
http://purl.obolibrary.org/obo/ENVO_00000428

Recommended

term:mixs[env_local_scale ]

litter layer [ENVO:01000338]

Equivalent to env_feature in MIxS v4
In this field, report the entity or entities which are in your sample or specimen´s local vicinity and which you believe have significant causal influences on your sample or specimen. Please use terms that are present in ENVO and which are of smaller spatial grain than your entry for env_broad_scale.

Recommended

term:mixs[env_medium]

soil [ENVO:00001998]

Equivalent to env_material in MIxS v4
In this field, report which environmental material or materials (pipe separated) immediately surrounded your sample or specimen prior to sampling, using one or more subclasses of ENVO´s environmental material class:
http://purl.obolibrary.org/obo/ENVO_00010483

Recommended

term:mixs[concentration]

67.5

Concentration of DNA (weight ng/volume µl) see also http://terms.tdwg.org/wiki/ggbn:concentration

Recommended

term:mixs[concentrationUnit]

ng/µl

Unit used for concentration measurement see also http://terms.tdwg.org/wiki/ggbn:concentrationUnit

Recommended

term:mixs[methodDeterminationConcentrationAndRatios]

Nanodrop, Qubit

Description of method used for concentration measurement see also http://terms.tdwg.org/wiki/ggbn:methodDeterminationConcentrationAndRatios

Recommended

term:mixs[ratioOfAbsorbance260_230]

1.89

Ratio of absorbance at 260 nm and 230 nm assessing DNA purity (mostly secondary measure, indicates mainly EDTA, carbohydrates, phenol), (DNA samples only). see also http://terms.tdwg.org/wiki/ggbn:ratioOfAbsorbance260_230

Recommended

term:mixs[ratioOfAbsorbance260_280]

1.91

Ratio of absorbance at 280 nm and 230 nm assessing DNA purity (mostly secondary measure, indicates mainly EDTA, carbohydrates, phenol), (DNA samples only). see also http://terms.tdwg.org/wiki/ggbn:ratioOfAbsorbance260_280

Recommended

term:mixs[samp_collect_device]

biopsy, niskin bottle, push core

The method or device employed for collecting the sample

Recommended

term:mixs[samp_mat_process]

filtering of seawater, storing samples in ethanol

Any processing applied to the sample during or after retrieving the sample from environment. This field accepts OBI, for a browser of OBI (v 2018-02-12) terms please see http://purl.bioontology.org/ontology/OBI

Recommended

term:mixs[samp_size]

5 litre

Amount or size of sample (volume, mass or area) that was collected

Recommended

term:mixs[size_frac]

0-0.22 micrometer

Filtering pore size used in sample preparation

Recommended

term:mixs[pcr_primer_lod]

51

The assay’s ability to detect the target at low levels

Highly recommended

term:mixs[pcr_primer_loq]

184

The assay’s ability to quantify copy number at low levels

Highly recommended

Marine datasets and the Ocean Biodiversity Information System (OBIS)

When working with datasets originating in the marine environment, it is recommended that the information is published also in the Ocean Biodiversity Information System (OBIS) in addition to GBIF. OBIS is a global biodiversity database, which is specialized in providing reliable and accessible data related to marine life and is a part of the IOC-UNESCO. Like GBIF, and ALA, OBIS uses the DwC-A format for data indexing and publishing. By publishing marine datasets through OBIS in addition to other biodiversity databases, the data can reach a broader audience, and diverse groups working in the field of marine biodiversity, as datasets in OBIS are often used for UN processes. With the focus on marine datasets, stringent quality controls on the data increase the reliability of the data and lead to small differences in what information is required for publishing in OBIS as opposed to GBIF.

To ensure consistent taxonomic nomenclature OBIS uses the World Register of Marine Species (WoRMS) as the only taxonomic backbone. This is the case also for occurrences derived from genetic data; a scientific name linked to a scientific name ID from the WoRMS database is highly recommended information for publishing. If a scientific name ID is not provided, OBIS will try to match the scientific name with WoRMS during ingestion, but this should be avoided whenever possible. Scientific names not listed in WoRMS are acceptable, and will be submitted to WoRMS for review and possible inclusion in the register. Fully unclassified sequences are recommended to be classified as "incertae sedis", with the WoRMS scientificNameID urn:lsid:marinespecies.org:taxname:12. This will ensure correct interpretation by both GBIF and OBIS. Additionally, it is recommended that sequence identifiers from the used reference databases (e.g. Barcode index numbers: BINs from BOLD) be added in the taxonConceptID field of the occurrence core table. In this way OBIS will retain its taxonomic backbone based on WoRMS, while enabling linking to disparate reference sequence databases. Names from reference databases which are not strictly scientific names, can be added as verbatimIdentification. Automatic classification of species names can often be done through the WoRMS taxon match services and R packages like worrms and taxize. In the future, OBIS plans to periodically search and update the taxonomic assignments of submitted sequences as reference databases develop with time, so recording the sequence information linked to each occurrence is highly recommended.

Another required field in OBIS data submissions are geographic coordinates. OBIS performs additional quality checks related to marine data; e.g. that coordinates for strictly marine species are not on land, and that the depth value reported is in a reasonable range. Finally, it should be mentioned that in addition OBIS supports the use of the extended Measurement or Fact (eMoF). This extension allows linking environmental data and sampling facts to sampling events or occurrences, as well as biological measurements to occurrences in a flexible and standardized manner. OBIS has an example eDNA metabarcoding dataset with scripts for data formatting available at https://github.com/iobis/dataset-edna.

Table 6. OBIS requirements and recommendations for recording DNA-based occurrences. The table highlights important differences in field values and requirements compared to when publishing to GBIF. Here exemplified with a DNA detection of Blue whale (Balaenoptera musculus).
Field name Value/example (OBIS) Description Required

term:dwc[scientificName]

Balaenoptera musculus

Scientific name, preferably as listed in the WoRMS database. This differs from GBIF, where it is recommended to use the taxon name derived from the classification approach used.

Required

term:dwc[scientificNameID]

urn:lsid:marinespecies.org:taxname:137090

The scientific name ID of "Balaenoptera musculus" as per the WoRMS database.

Highly recommended

term:dwc[taxonConceptID]

NCBI:txid9771

The NCBI ID linked to Balaenoptera musculus in the NCBI taxonomic database. Can also be a BIN-ID if BOLD was used for identification, or another ID from a different database.

Recommended

term:dwc[verbatimIdentification]

Balaenoptera musculus

The name corresponding to the NCBI ID (Balaenoptera musculus) (or other ID). This does not necessarily correspond to the value in scientific name.

Recommended

Table 7. OBIS requirements and recommendations for recording sequences that cannot be classified to a scientific name at any taxonomic level.
Field name Value (OBIS) Description Required

term:dwc[scientificName]

incertae sedis

The scientific name for unknown sequences recommended by OBIS. Use this name when the sequence/taxonomy is unknown. This differs from GBIF, where it is recommended to use the taxon name as retrieved from the classifier even when it is not strictly a scientific name.

Required

term:dwc[scientificNameID]

urn:lsid:marinespecies.org:taxname:12

The scientific name ID of "incertae sedis" as per the WoRMS database for unknown sequences recommended by OBIS. Use this ID when the sequence/taxonomy is unknown.

Highly recommended

term:dwc[taxonConceptID]

NCBI:txid1899546

The ID in an external taxonomic database, like a sequence reference database for example.

Recommended

term:dwc[verbatimIdentification]

Phototrophic eukaryote

The name of the taxon in an external database, corresponding to the taxon concept ID.

Recommended