Code

Gpt math solver#991

Code

Draft

yiranwu0 wants to merge 136 commits intomicrosoft:mainmicrosoft/FLAML:mainfrom yiranwu0:gpt_math_solveryiranwu0/FLAML:gpt_math_solverCopy head branch name to clipboard

+2,470

Commits

Commits on Apr 11, 2023

• handle format error in message in _construct_params

  yiranwu0

  committed
  7dc4035

Commits on Apr 12, 2023

• fix typo

  yiranwu0

  committed
  83ff983

Commits on Apr 16, 2023

• Add math solver with automatic tool queries.

  yiranwu0

  committed
  ab2cada

• add imports in QueryHandler

  yiranwu0

  committed
  2d70c99

Commits on Apr 23, 2023

• update math solver

  yiranwu0

  committed
  c823cbf

• require wolfram id in readme

  yiranwu0

  committed
  766b022

• Merge branch 'main' into gpt_math_solver

  yiranwu0

  committed
  84ba0be

• fix bug in running python code

  yiranwu0

  committed
  8f67ed7

• Update flaml/autogen/math_solver/MathSolver.py

  Show description for a511f0a
  

  yiranwu0

  and

  sonichi

  authored
  a511f0a

• Update flaml/autogen/math_solver/README.md

  Show description for 87ad79d
  

  yiranwu0

  and

  sonichi

  authored
  87ad79d

• revise according to comments

  yiranwu0

  committed
  a16fa5f

• Merge branch 'gpt_math_solver' of github.com:kevin666aa/FLAML into gpt_math_solver

  yiranwu0

  committed
  e21fd76

• fix code format

  yiranwu0

  committed
  45dcb7f

• Add prompt to system message

  yiranwu0

  committed
  435e7a4

Commits on Apr 24, 2023

• refrtor file names

  yiranwu0

  committed
  d1747cf

• refine prompts

  yiranwu0

  committed
  56627a7

• add baseline PoT

  yiranwu0

  committed
  9821820

• fix bugs in query_handler

  yiranwu0

  committed
  e37ee3e

• refine prompts

  yiranwu0

  committed
  5d44e5e

• refine prompt to output fractions

  yiranwu0

  committed
  bab2878

• change prompt

  yiranwu0

  committed
  d0b0d4b

• add temperature as args

  yiranwu0

  committed
  3e171a3

• fix concat float to str

  yiranwu0

  committed
  2261c5c

• change prompt back to use fractions instead of decimal

  yiranwu0

  committed
  8c5a86c

Commits on Apr 25, 2023

• rewind prompt back to e37ee3

  yiranwu0

  committed
  2b8b717

• pass args.samples_per_category in PoT

  yiranwu0

  committed
  8b68ff7

• fix counting bug in PoT and print in mth_solver

  yiranwu0

  committed
  54407a7

• fix error: convet exception to str

  yiranwu0

  committed
  4806631

• add logger to log stdouts and compress files

  yiranwu0

  committed
  80a7063

• refine logging

  yiranwu0

  committed
  d737644

Commits on Apr 26, 2023

• add option to put prompt in either system or user message, add option to load one or more categories

  yiranwu0

  committed
  d146e35

• clean up main.py

  yiranwu0

  committed
  26c0caa

• create pseudo_main.py

  yiranwu0

  committed
  2a1a47e

• fix category loading bug

  yiranwu0

  committed
  edfc679

• handle timeout

  yiranwu0

  committed
  6a15761

• two new prompts

  yiranwu0

  committed
  ab64723

Commits on Apr 27, 2023

• add bash

  yiranwu0

  committed
  f723a8f

• more prompts

  yiranwu0

  committed
  1a5c93c

• change run sequence

  yiranwu0

  committed
  955edca

Commits on Apr 28, 2023

• add more prompts

  yiranwu0

  committed
  8519967

• catch wolfram error

  yiranwu0

  committed
  912193e

• more runs on v2.1 select, v1.2 select, add new v3select

  yiranwu0

  committed
  c8f90b4

• compress when all finished

  yiranwu0

  committed
  7a8c2ac

• py exec output fix

  yiranwu0

  committed
  b9a7e04

Commits on Apr 29, 2023

• v3.1 select

  yiranwu0

  committed
  65f1580

• new both prompt, v3.2select

  yiranwu0

  committed
  73088ce

• change execute to run

  yiranwu0

  committed
  144c148

Commits on Apr 30, 2023

• refine query handling and v3.3select

  yiranwu0

  committed
  812477a

• catch wolfram errors

  yiranwu0

  committed
  25e2708

Commits on May 1, 2023

• ablation on only using python and zeroshot baseline

  yiranwu0

  committed
  1c00283

• change run sequence

  yiranwu0

  committed
  1330a00

• new run

  yiranwu0

  committed
  e61212f

• new run

  yiranwu0

  committed
  2b5dd52

• consitent ouput folder in PoT

  yiranwu0

  committed
  ac11d2a

Commits on May 2, 2023

• 1erun pot , refined prompt v1.3 v1.4 and v3.4

  yiranwu0

  committed
  9d291b9

• resume 22 if not finished

  yiranwu0

  committed
  ce7144a

• handle wolfram exception

  yiranwu0

  committed
  6fefde3

• one run for v1.5

  yiranwu0

  committed
  eaae6ce

• one run for v1.5 corrections

  yiranwu0

  committed
  8fdf74f

Commits on May 3, 2023

• two more prompts v3.5select and v3.1python based on v3python

  yiranwu0

  committed
  ca75c91

• remove error string clipping

  yiranwu0

  committed
  47179ce

• handle UnicodeDecodeError

  yiranwu0

  committed
  a8c3758

• handle UnicodeDecodeError

  yiranwu0

  committed
  132638a

• quick test on adding wolfram to v3.1python

  yiranwu0

  committed
  280f9de

Commits on May 4, 2023

• rerun v3.1 with refine, add v3.7select to further test wolfram

  yiranwu0

  committed
  45a4abd

• switch run seq v3.7select then v3.1python

  yiranwu0

  committed
  b0efcbf

• add v3.2python, slightly refine from v3.1. try out v3.3python

  yiranwu0

  committed
  10c28ae

Commits on May 5, 2023

• more args for PoT and refine load_leve5 func

  yiranwu0

  committed
  bfe61aa

• trial 38-42: validate our methods on all level of problems, run large scale level-5 problems

  yiranwu0

  committed
  39ea367

• update run.sh

  yiranwu0

  committed
  0cebecb

Commits on May 6, 2023

• move

  sonichi

  committed
  bddb610

Commits on May 7, 2023

• add v4

  yiranwu0

  committed
  326da82

• Merge branch 'gpt_math_solver' of github.com:kevin666aa/FLAML into gpt_math_solver

  yiranwu0

  committed
  bd040b5

• test with new system message

  yiranwu0

  committed
  c8ba447

Commits on May 8, 2023

• add baseline pnas, run v4.2 on level5 problems, test new sys message s2 with v3.1 and v4.2

  yiranwu0

  committed
  62b5259

• fix trial 49

  yiranwu0

  committed
  ef509d4

• remove print

  yiranwu0

  committed
  e60850f

Commits on May 9, 2023

• run v3 with specified sentence removed, 4.2 with original sys message, try v1.6

  yiranwu0

  committed
  5fe0b0b

• remove trial 52

  yiranwu0

  committed
  d92b559

• endpoint

  sonichi

  committed
  ede98a5

• Merge branch 'gpt_math_solver' of https://github.com/kevin666aa/FLAML into gpt_math_solver

  sonichi

  committed
  7082355

• fix bug in queryhandler

  yiranwu0

  committed
  7d34485

• Merge branch 'gpt_math_solver' of github.com:kevin666aa/FLAML into gpt_math_solver

  yiranwu0

  committed
  8e34218

• fix queryhandler 2

  yiranwu0

  committed
  c592837

Commits on May 10, 2023

• v3.3python

  yiranwu0

  committed
  6345e0b

• remove print

  yiranwu0

  committed
  40fd299

Commits on May 11, 2023

• test final prompts

  yiranwu0

  committed
  dac1551

• change run sequence

  yiranwu0

  committed
  fff4e4b

• run exact v3.1 as before

  yiranwu0

  committed
  da0f7d9

• keep runing v3.1python and add general_5

  yiranwu0

  committed
  2775e08

• add general_5

  yiranwu0

  committed
  ad10b71

Commits on May 12, 2023

• continue run 55 and 56

  yiranwu0

  committed
  7800a46

• switch seq

  yiranwu0

  committed
  4f78539

• trial 63 v3.5python, then run large-scale with v3.3python

  yiranwu0

  committed
  a76113f

Commits on May 13, 2023

• add v3.3, 3.7, 3.8

  yiranwu0

  committed
  7d22c07

• revise 3.6-3.8

  yiranwu0

  committed
  908d283

• v3.9

  yiranwu0

  committed
  079b4e2

• test interalge and precal on v3.9

  yiranwu0

  committed
  f071214

• test v3.9 on 50 problems, then zero shot

  yiranwu0

  committed
  6444f91

• fix prompt

  yiranwu0

  committed
  1c4a278

• endpoint

  sonichi

  committed
  c744613

• Merge branch 'gpt_math_solver' of https://github.com/kevin666aa/FLAML into gpt_math_solver

  sonichi

  committed
  2ad469f

• run all problems on v3.9, and pnas

  yiranwu0

  committed
  b806dfb

• endpoint

  sonichi

  committed
  3733028

Commits on May 15, 2023

• Merge remote-tracking branch 'upstream/main' into gpt_math_solver

  

  Feiran Jia

  committed
  cbd0be0

• run v1python

  yiranwu0

  committed
  89d7512

• Merge branch 'gpt_math_solver' of github.com:kevin666aa/FLAML into gpt_math_solver

  yiranwu0

  committed
  3791326

Commits on May 16, 2023

• run v1python+wolfram

  yiranwu0

  committed
  2a6ffa1

Commits on May 19, 2023

• run pot with sys message

  yiranwu0

  committed
  d833938

• endpoint

  sonichi

  committed
  bf73756

• Merge branch 'gpt_math_solver' of https://github.com/kevin666aa/FLAML into gpt_math_solver

  sonichi

  committed
  f1b3873

• run pot with system message

  yiranwu0

  committed
  e3d8de1

• Merge branch 'gpt_math_solver' of https://github.com/kevin666aa/FLAML into gpt_math_solver

  sonichi

  committed
  d84213d

• Merge branch 'gpt_math_solver' of github.com:kevin666aa/FLAML into gpt_math_solver

  

  Feiran Jia

  committed
  f8c68ff

• fewshot+zeroshot prompt

  

  Feiran Jia

  committed
  9bc17db

• add assert

  

  Feiran Jia

  committed
  769803e

Commits on May 20, 2023

• refine fewshot

  yiranwu0

  committed
  85d9b59

• run pre-commit

  yiranwu0

  committed
  bce7f4f

Commits on May 21, 2023

• rerun v3.9 with cache and get token info

  yiranwu0

  committed
  59bc9f9

Commits on May 22, 2023

• run PoT on all problems

  yiranwu0

  committed
  32de58f

• Merge remote-tracking branch 'upstream/main' into gpt_math_solver

  yiranwu0

  committed
  9dabf61

• merge new changes and update pot

  yiranwu0

  committed
  9c3efd4

• endpoint

  sonichi

  committed
  fc8bcdc

• Merge branch 'gpt_math_solver' of https://github.com/kevin666aa/FLAML into gpt_math_solver

  sonichi

  committed
  c711143

• fix decode in PoT

  yiranwu0

  committed
  f535e50

• Merge branch 'gpt_math_solver' of github.com:kevin666aa/FLAML into gpt_math_solver

  yiranwu0

  committed
  841ff2a

Commits on May 27, 2023

• clean up and rename

  yiranwu0

  committed
  43d8277

• resolve conflict in setup

  yiranwu0

  committed
  01f7712

Commits on Jun 7, 2023

• Merge branch 'microsoft:main' into gpt_math_solver

  yiranwu0

  authored
  d4d8242

• clean up

  yiranwu0

  committed
  1cfce5f

• update readme

  yiranwu0

  committed
  be7bb3d

• add mathchat flow hart

  yiranwu0

  committed
  d3e8719

• Update README.md

  yiranwu0

  authored
  2c8823f

Commits on Jun 10, 2023

• Merge branch 'microsoft:main' into gpt_math_solver

  yiranwu0

  authored
  7808b4f

Commits on Jul 10, 2023

• add missing files

  yiranwu0

  committed
  348446b

• Merge branch 'gpt_math_solver' of github.com:kevin666aa/FLAML into gpt_math_solver

  yiranwu0

  committed
  c49ab9c