Allow resource release at the end of life of the LitAPI object

[Alexandre-SCHOEPP]

---

🚀 Feature

We have a setup method, which allows one to initialize for each worker the resources needed for inference.

I want the exact reverse: When the server closes, to release the resource (via an abstract teardown method or similar)

Motivation

Some APIs need more than just temporary state (DB connection, prompt files, etc...). Not being able to release them forces one to use garbage collection to release the data, which is an unsafe way to proceed.

Pitch

sequenceDiagram
    participant MAIN as parent process
    create participant WORKER as worker process
    MAIN ->> WORKER: fork()
    WORKER ->> WORKER: setup
    note over MAIN, WORKER: server lifetime
    WORKER ->> WORKER: teardown
    destroy WORKER
    WORKER ->> MAIN: child process is dead
    MAIN ->> MAIN: program finalization

Loading

[aniketmaurya]

great point @Alexandre-SCHOEPP! would you be interested in adding a PR?