fix(community): Migrate xenova transformers lib to huggingface

[PylotLight]

Fixes # (issue)

• Update all xenova npm pkg references to huggingface and update lib version to latest.
• Noting I have tested building which worked successfully for me after reference changes were made.

I tested the build with the following dockerfile for reference:

FROM node:18-slim
WORKDIR /usr/src
RUN apt-get update \
 && apt-get install -y --no-install-recommends \
    git \
    build-essential \
    python3 \
    python3-pip \
 && apt-get clean \
 && rm -rf /var/lib/apt/lists/*

RUN corepack enable \
 && corepack prepare [email protected] --activate

COPY . .

WORKDIR /usr/src/libs/langchain-community
RUN yarn

WORKDIR /usr/src/langchain-core
RUN yarn && yarn build

WORKDIR /usr/src/app
CMD ["/bin/bash"]

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
langchainjs-docs	✅ Ready (Inspect)	Visit Preview		Dec 31, 2024 1:38am

1 Skipped Deployment

Name	Status	Preview	Comments	Updated (UTC)
langchainjs-api-refs	⬜️ Ignored (Inspect)			Dec 31, 2024 1:38am

[PylotLight]

I didn't touch docs, not sure why that check is failing and if there's anything I can do about it. I can't see logs of what the issue is either.

[jacoblee93]

Thanks for this!

Would be nice to have some kind of fallback so that it fails gracefully for people using the old package - can take over and look into it!

[PylotLight]

Thanks for this!

Would be nice to have some kind of fallback so that it fails gracefully for people using the old package - can take over and look into it!

Please do!
Let me know if there's anything I can help with.

Update:
Added my own version to consider

[jacoblee93]

Hey @PylotLight - given how finicky bundlers can be I think it's safer to just make it a new entrypoint and deprecate the old one

I've done that here. Will merge and ship tonight or tomorrow!

[PylotLight]

Hey @PylotLight - given how finicky bundlers can be I think it's safer to just make it a new entrypoint and deprecate the old one

I've done that here. Will merge and ship tonight or tomorrow!

Love it!
Thank you for pushing this =]