Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

automate updates of DISEASES and TISSUES APIs #117

Open
andrewsu opened this issue Apr 28, 2023 · 4 comments
Open

automate updates of DISEASES and TISSUES APIs #117

andrewsu opened this issue Apr 28, 2023 · 4 comments
Assignees
Labels
On CI Match https://github.com/biothings/biothings_explorer/labels

Comments

@andrewsu
Copy link
Member

From the timestamps in https://download.jensenlab.org/, it looks like the data underlying the DISEASES and TISSUES APIs are updated ~weekly. The current APIs have not been refreshed since Aug 2020 for DISEASES and Sep 2022 for TISSUES. Not a huge priority, but it would be good to automate the updates here to whatever extent is reasonable.

@erikyao erikyao self-assigned this Apr 28, 2023
@colleenXu
Copy link

Related issues

@colleenXu
Copy link

Quick note: also related to this issue biothings/biothings.api#235

@everaldorodrigo
Copy link
Contributor

It's configured now to download and build automatically for DISEASES and TISSUES data.

After few weeks, If everything looks good, we could configure to auto release the data to CI, Test, and/or Prod.

@everaldorodrigo everaldorodrigo added the On CI Match https://github.com/biothings/biothings_explorer/labels label Apr 26, 2024
@ctrl-schaff
Copy link
Contributor

@everaldorodrigo Looking at the tissues API I see the weekly releases in the biothings-studio which is good. But looking at the metadata it doesn't appear to update based off the weekly releases. See the following metadata blob

[⊖](https://biothings.ci.transltr.io/tissues#){
    "biothing_type": "association",
    "build_date": "2024-07-01T09:30:00.298484+00:00",
    "build_version": "20240701",
    "src": [⊖](https://biothings.ci.transltr.io/tissues#){
        "TISSUES": [⊖](https://biothings.ci.transltr.io/tissues#){
            "licence": "CC BY 3.0",
            "code": [⊖](https://biothings.ci.transltr.io/tissues#){
                "folder": "plugins/TISSUES",
                "repo": "https://github.com/biothings/pending.api.git",
                "commit": "5606362",
                "branch": "atc-api-plugin",
                "url": "https://github.com/biothings/pending.api/tree/5606362cd495aa0ca15028e577b04a2452030aa7/plugins/TISSUES"
            },
            "stats": [⊖](https://biothings.ci.transltr.io/tissues#){
                "TISSUES": 15045861
            },
            "download_date": "2024-07-01T09:04:00.080000",
            "version": "2024-07-01",
            "license_url": "https://creativecommons.org/licenses/by/3.0/",
            "url": "https://tissues.jensenlab.org/",
            "upload_date": "2024-07-01T09:04:10.078000"
        }
    },
    "stats": [⊖](https://biothings.ci.transltr.io/tissues#){
        "total": 15045861
    }
}

We should probably investigate our metadata update process to ensure that this is working across the pending.api

@ctrl-schaff ctrl-schaff assigned ctrl-schaff and unassigned erikyao Dec 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
On CI Match https://github.com/biothings/biothings_explorer/labels
Projects
None yet
Development

No branches or pull requests

5 participants