Skip to content

Releases: truera/trulens

TruLens v1.2.1

29 Oct 19:40
46f05d0
Compare
Choose a tag to compare

Bug Fixes

New Contributors

Full Changelog: trulens-1.2.0...trulens-1.2.1

TruLens v1.2.0

28 Oct 21:31
Compare
Choose a tag to compare

What's Changed

Bug Fixes

Examples

Full Changelog: trulens-1.1.0...trulens-1.2.0

trulens-1.1.0

10 Oct 13:13
Compare
Choose a tag to compare

What's Changed

TruLens 1.1 has a ton of exciting changes - we've grouped the updates into the new features they support so you can jump straight to the updates you're most excited about:

  • TruLens Dashboard
  • Feedback Provider Support
  • Search Metric Support
  • Adding dataframes to TruLens
  • OpenTelemetry Support
  • Async and Streaming Support
  • More Reliable Feedback Functions
  • New Examples
  • Docs Updates
  • Bug Fixes

TruLens Dashboard

In TruLens 1.1, we re-imagined the dashboard with a focus on making it easy to track large numbers of experiments, make comparisons and improve your apps for production. We also made several improvements performance and usability including dark mode.

Read more about the new look dashboard.

See the changes:

Expanded Search Metric Support

TruLens now supports common information retrieval (search) metrics including IR Hit Rate, NDCG, Precision, Recall, Mean Reciprocal Rank and more. These new metrics are accessible as ground truth feedback functions and simply require the addition of expected_chunks to your ground truth data. Try the example

See the change:

  • Information retrieval (search) metrics computation with ground truth datasets - notebook + metrics implementation by @sfc-gh-dhuang in #1545

Getting started with existing data

It's now easier than ever to get started with TruLens. Starting with a dataframe with query, response and contexts columns, you can load it to TruLens using add_dataframe and easily run feedback functions against your data. Try it yourself

See the change:

Experimental support for Open Telemetry

We've added experimental preview support for Open Telemetry, enabled with session.experimental_enable_feature("otel_tracing") . We are collecting feedback and will be continuing to improve the user experience for writing and reading OpenTelemetry traces. If you want to try it out, check it out with custom python or Llama-Index.

See the changes:

Restored Async and Streaming Support

More reliable feedback functions

  • Simplify system prompt generation conditions with output space and criteria by @sfc-gh-dhuang in #1554
  • handle partial functions for feedback functions by @sfc-gh-chu in #1551
  • More error handling for groundedness internal steps by @sfc-gh-jreini in #1549
  • RAG triads llm as judges benchmark - adding meta-eval metrics for correlation measurement and experiment notebooks by @sfc-gh-dhuang in #1462
  • Add option to filter trivial statements for groundedness measure by @sfc-gh-pdharmana in #1556
  • Fix splitting key_points issue: generalize the solution for splitting key points in _assess_key_point_inclusion() by @dom7kim in #1519'

Feedback Provider Support

New Examples

Docs Updates

Bug Fixes

Read more

TruLens v1.0.11

10 Oct 00:44
Compare
Choose a tag to compare

Bug Fixes

Full Changelog: trulens-1.0.10...trulens-1.0.11

TruLens v1.0.9

07 Oct 12:48
Compare
Choose a tag to compare

TruLens v1.0.10

07 Oct 17:11
Compare
Choose a tag to compare

Bug Fixes

TruLens v1.0.8

05 Oct 02:26
Compare
Choose a tag to compare

Bug Fixes

TruLens v1.0.7

03 Oct 22:35
Compare
Choose a tag to compare

Bug Fixes

  • Allow using Snowflake Connector for the actual DB Connector instead of the connection parameters by @sfc-gh-dkurokawa in #1527

TruLens v1.0.6

01 Oct 19:54
d8b82ad
Compare
Choose a tag to compare

Bug Fixes

TruLens v1.0.5

01 Oct 19:52
bf9fd2b
Compare
Choose a tag to compare

Bug Fixes