Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pipeline integrations for common NLP/LLM Packages #78

Closed
adamkells opened this issue Oct 6, 2024 · 0 comments · Fixed by #84
Closed

Pipeline integrations for common NLP/LLM Packages #78

adamkells opened this issue Oct 6, 2024 · 0 comments · Fixed by #84
Assignees
Labels
Component: Framework Issue/PR that addresses core framework functionality Issue: Feature Request ✨ New feature or improvement to existing feature

Comments

@adamkells
Copy link
Contributor

Description

Issue #27 involved researching ways to integrate common nlp packages into pipelines. This issue is to track the implementation of the proposed solution (which is detailed as a comment on the original issue).

Context

This would allow users to easily initialise a healthchain pipeline from existing work in spacy, langchain or hugging-face.

Possible Implementation

The expected user interface should be:
# Import an external pipeline libraries pipeline = BasePipeline() pipeline.from_spacy('/path') pipeline.from_hf() pipeline.from_langchain()

The implementation should be reasonably opinionated in that it will require either raw text or a spaCy Document as an input and require either an augmented Document or a tabular object as an output.

All these libraries have significant flexibility which we will restrict to prioritise the use cases most relevant for HealthChain and to avoid re-inventing the wheel.

@adamkells adamkells self-assigned this Oct 6, 2024
@jenniferjiangkells jenniferjiangkells added Issue: Feature Request ✨ New feature or improvement to existing feature Component: Framework Issue/PR that addresses core framework functionality labels Oct 8, 2024
@jenniferjiangkells jenniferjiangkells linked a pull request Oct 14, 2024 that will close this issue
7 tasks
@github-project-automation github-project-automation bot moved this from In review to Done in HealthChain Nov 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Component: Framework Issue/PR that addresses core framework functionality Issue: Feature Request ✨ New feature or improvement to existing feature
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

2 participants