Skip to content
@4dn-dcic

4D Nucleome Data Coordination and Integration Center

Fourfront Metadata Database

The Fourfront Metadata Database, or just "Fourfront", is an open-source platform developed at the Park Lab in Harvard's Department of Biomedical Informatics (DBMI) as part of our service in the role of Data Coordination and Integration Center (DCIC) for the 4D Nucleome Network, one of the NIH Common Fund programs.

The 4D Nucleome Network aims to understand the principles behind the three-dimensional organization of the nucleus in space and time (the 4th dimension), and the role nuclear organization plays in gene expression and cellular function. The Network uses existing omics and imaging technologies, and develops new ones to generate data and create resources to enable the study of the 4D Nucleome.

More information about the 4D Nucleome program can be obtained at:

Information about our implementation can be found at:

  • our GitHub repositories, detailed below, and

  • our online documentation, detailed below, but including particularly:

Please address all questions and comments to [email protected]

Repositories

Overview

Fourfront consists of multiple repositories which support a complex ecosystem of applications and tools that implement Fourfront (the portal itself), Tibanna (the genomics pipeline), Foursight (tools for monitoring and service actions), and Submit4DN (a command line tool to aid in metadata and data file submission).

History

Work on the Fourfront portal began in 2015 as a fork of earlier work on ENCODE-DCC/encoded and ENCODE-DCC/snovault, developed by the Stanford ENCODE team The initial base and has been substantially developed and changed since then. However, the two teams stay in periodic touch and share ideas since the work is related.

In turn, our later work on the CGAP Portal and SMaHT Portal build on this work. Using a common codebase, especially based on our shared dcicutils and snovault repositories, we have refactored all three systems to no longer use AWS ElasticBeanstalk instances, and instead to use a more modern architecture based on Docker containers and AWS Fargate.

Pipelines & Analysis

  • tibanna - Core software that runs pipelines on Amazon Web Services (AWS).
  • tibanna_ff - An extension of Tibanna that works with the 4DN data portal.

Portal Infrastructure

  • fourfront - The primary codebase of the Fourfront portal.
  • utils - A set of utility functions & scripts which are used in the Fourfront Portal and others.
  • snovault - Contains abstractions for communicating with our databases, including PostgreSQL and ElasticSearch. A major dependency of CGAP Portal. Originally this was forked from ENCODE Project in ~2015.
  • react-workflow-viz - A React component/library for visualizing workflow runs.

Monitoring

  • foursight - Tools for monitoring and periodic service actions.
  • foursight-core - Core software supporting Foursight.

Applications

  • Submit4DN - Command-line tools for submitting and uploading metadata and data files to Fourfront.

Administrative

  • 4DN Policies - NIH Common Fund 4D Nucleome Network Policies.
  • Governance - Repository of governance, legal and policy information for our projects.
  • Legal Notices - Legal notices for portal users.

Pinned Loading

  1. 4dn-policies 4dn-policies Public

    Policies for the NIH Common Fund 4D Nucleome Network.

    6

Repositories

Showing 10 of 92 repositories
  • tibanna_ff Public

    This is an extension of Tibanna that integrates with 4DN/CGAP/SMaHT data portals.

    4dn-dcic/tibanna_ff’s past year of commit activity
    Python 3 MIT 0 0 3 Updated Jul 14, 2024
  • utils Public

    various util modules shared amongst several projects in our organization

    4dn-dcic/utils’s past year of commit activity
    Python 4 MIT 1 1 9 Updated Jul 13, 2024
  • 4dn-dcic/docker-fastqc’s past year of commit activity
    Common Workflow Language 0 0 0 0 Updated Jul 12, 2024
  • 4dn-dcic/docker-4dn-fastq-first-line’s past year of commit activity
    Dockerfile 0 0 0 0 Updated Jul 11, 2024
  • snovault Public

    The SnoVault general purpose hybrid object-relational database

    4dn-dcic/snovault’s past year of commit activity
    Python 1 1 0 10 Updated Jul 11, 2024
  • pipelines-cwl Public

    Pipelines developed and used by 4DN-DCIC in Common Workflow Language

    4dn-dcic/pipelines-cwl’s past year of commit activity
    Common Workflow Language 9 MIT 4 0 1 Updated Jul 11, 2024
  • tibanna Public

    Tibanna helps you run your genomic pipelines on Amazon cloud (AWS). It is used by the 4DN DCIC (4D Nucleome Data Coordination and Integration Center) to process data. Tibanna supports CWL/WDL (w/ docker), Snakemake (w/ conda) and custom Docker/shell command.

    4dn-dcic/tibanna’s past year of commit activity
    Python 70 MIT 27 19 7 Updated Jul 11, 2024
  • 4dn-dcic/dcicwrangling’s past year of commit activity
    Python 0 0 0 2 Updated Jul 11, 2024
  • fourfront Public

    Data portal for submitting and viewing genomic data

    4dn-dcic/fourfront’s past year of commit activity
    JavaScript 13 MIT 2 0 31 Updated Jul 11, 2024
  • hic2cool Public

    Lightweight converter between hic and cool contact matrices.

    4dn-dcic/hic2cool’s past year of commit activity
    Python 62 MIT 7 15 4 Updated Jul 9, 2024