Export & import for prompts, copy between projects

[zoltan-fedor]

Describe the feature or potential improvement

We have more and more prompts and it would be nice if we could export them (a whole list of them, not just an individual prompt) and then in another Langfuse instance or just in another project of the same Langfuse instance import them.

Additional information

This would help to migrate a set of prompts between multiple environments.

Prompts imported should overwrite prompts with the same name.

[marcklingen]

Coincidentally chatted today with a team having the same idea/issue when using prompt management across multiple environments. Currently they rely on managing prompts in one project while using tracing in multiple projects.

We’re currently considering adding an organization level to simplify permissions when having multiple projects. Copying records (prompts, dataset items) between projects within an org seems to be a very natural/useful extension here.

[pannaf]

+1 here- this would be super useful

[zoltan-fedor]

Copying records (prompts, dataset items) between projects within an org seems to be a very natural/useful extension here.
Yes, I very much agree.
Either directly copying prompts (preferable more than 1 at a time) between projects or just a simple export/import functionality for prompts would mostly address this need.

[GMartin-dev]

Agree for prompts and datasets, there is a need for easily export / import at least.

[meissnereric]

The core usecase we have for this is promoting a new prompt from dev -> prod environment. Worried about mis-matched changes during deployments otherwise without having to write up our own sort of version-switching code for dev/prod management.

[marcklingen]

we'll add dev/prod labels for prompt versions this week which should make it easy to tag prompts for different envs within the same langfuse project. Organizations will be shipped soon, then enabling between project copying of prompts will be easier.

[touhi99]

would love to have this feature. we tried bunch of prompts and all traces in our dev branch. and when we wished to move to prod, we didnt want to lose old prompt versioning and some stats.

[j10sanders]

@marcklingen Is there currently an ability to export/copy evaluators between projects? We've created a bunch in our non-prod project and want to move them over. I don't see a way to do that?

[marcklingen]

Currently, this is not supported. Could you create a separate thread for this?

[YaEvan]

Due to the difference in costs between cloud servers and development servers, we've also encountered the need to export old data from langfuse cloud servers to development servers. We hope there can be convenient import and export features. Also, thanks for providing the langfuse tool.

[skabbit]

In our case we are looking for feature to move trace from one project to another (from dev/test to prod). Simply changing the project_id in trace table in DB is not enough, and I worry about damaging DB this way.
Is there any other option to do that?

[marcklingen]

This is not supported unfortunately as the projectId are part of the ordering key within Langfuse. You can add the traces to a new project after reading them via the sdks/api.

[skabbit]

Thanks for answer!
"reading them via the sdks/api" - do you mean that Python API support loading from one project a trace to some Python object representing the structure and then saving this object to another project?
Or you mean make it manually by reproducing all necessary steps of trace?

[marcklingen]

"reading them via the sdks/api" - do you mean that Python API support loading from one project a trace to some Python object representing the structure and then saving this object to another project?

You can use fetch_trace and fetch_observation, then employ the low-level Python SDK to add them to another project. However, this process can be tedious since it is not a common use case. If you believe the documentation could be improved or if you could provide an example script that you used, that would be very helpful.

Notebook on the fetch_ methods that could be extended: https://langfuse.com/guides/cookbook/example_query_data_via_sdk