Code

Build Index from regex#125

Code

Draft

torymur wants to merge 22 commits intomaindottxt-ai/outlines-core:mainfrom index-from-regex-97dottxt-ai/outlines-core:index-from-regex-97Copy head branch name to clipboard

+1,056-2,521

Commits

Commits on Jan 9, 2025

• Build Index from regex

  torymur

  committed
  606b460

  Copy full SHA for 606b460

• Test Index from regex in Guide

  torymur

  committed
  bdc120d

  Copy full SHA for bdc120d

• Use FxHash* as default Hash*

  torymur

  committed
  6c5b853

  Copy full SHA for 6c5b853

• Cleaner from_regex logic

  torymur

  committed
  f349404

  Copy full SHA for f349404

• Use bytes as Token type, more tests for Index

  torymur

  committed
  15a85aa

  Copy full SHA for 15a85aa

• Drop majority of intermediate structures

  torymur

  committed
  f02faec

  Copy full SHA for f02faec

• Add PyGuide, use proper types for Index

  torymur

  committed
  70b4bc6

  Copy full SHA for 70b4bc6

• Provide basic Guide binding, test it

  torymur

  committed
  b477598

  Copy full SHA for b477598

• Improve Vocabulary python binding, add tests

  torymur

  committed
  f3266ee

  Copy full SHA for f3266ee

• Non-optional eos_token_id

  torymur

  committed
  7edb831

  Copy full SHA for 7edb831

• Stabilize vocabulary interface

  torymur

  committed
  03e5561

  Copy full SHA for 03e5561

• Add tests for Guide

  torymur

  committed
  64f0d73

  Copy full SHA for 64f0d73

• Python vocabulary to accept pretrained params

  torymur

  committed
  2ab0007

  Copy full SHA for 2ab0007

• Correct interface in pyi, reprs for all python bindings

  torymur

  committed
  063d1c2

  Copy full SHA for 063d1c2

• Adjust benchmarks

  torymur

  committed
  f65d86f

  Copy full SHA for f65d86f

• Drop unused dependencies

  torymur

  committed
  30e29ef

  Copy full SHA for 30e29ef

• Index by ref in Guide

  torymur

  committed
  e04e5be

  Copy full SHA for e04e5be

• Extend interface of python bindings

  torymur

  committed
  7b6781b

  Copy full SHA for 7b6781b

• Disallow insert of eos token into Vocabulary

  torymur

  committed
  1fab872

  Copy full SHA for 1fab872

• Stabilize Index interfaces

  torymur

  committed
  15a45c0

  Copy full SHA for 15a45c0

• Use new interface in statistical

  torymur

  committed
  bf6e8a6

  Copy full SHA for bf6e8a6

Commits on Jan 10, 2025

• Add remove to vocabulary interfaces

  torymur

  committed
  3fef1d8

  Copy full SHA for 3fef1d8