Skip to content

Pull requests: promptfoo/promptfoo

New pull request New
30 Open 2,992 Closed
30 Open 2,992 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: gender bias plugin
#3886 opened May 3, 2025 by typpo Loading…
3
feat: add finish reason as assertion option
#3879 opened May 2, 2025 by christophersutton • Draft
1
feat: ability to set evaluateOptions.outputVars [WIP]
#3873 opened May 2, 2025 by typpo Loading…
7
feat: Display audio file variables in result table
#3864 opened May 1, 2025 by faizanminhas • Draft
1
feat: add pi scorer
#3799 opened Apr 24, 2025 by sidd2pir Loading…
8
fix: file content not being loaded when referenced with file:// prefix in vars
#3793 opened Apr 24, 2025 by adityabharadwaj198 Loading…
@mldangelo
3
fix(bedrock): ensure numeric conversion for token counts
#3762 opened Apr 21, 2025 by mldangelo Loading…
@mldangelo
5
chore: update default to azure
#3756 opened Apr 20, 2025 by MrFlounder Loading…
7
test: add unit test for src/providers/vertex.ts
#3750 opened Apr 18, 2025 by gru-agent bot Loading…
test: add unit test for src/providers/google.ts
#3749 opened Apr 18, 2025 by gru-agent bot Loading…
chore: Send auth info to cloud
#3744 opened Apr 18, 2025 by sklein12 Loading…
11
chore: Gemini 2.0 setup and usage guide
#3686 opened Apr 12, 2025 by prasanna-lakshmi18 Loading…
6
feat(providers): add Slack provider
#3469 opened Mar 23, 2025 by mldangelo Loading…
6
refactor(providers): load default providers from a registry
#3386 opened Mar 13, 2025 by mldangelo Loading…
7
fix: handle openai guardrail responses to be a PASS
#3166 opened Feb 20, 2025 by AISimplyExplained Loading…
2
feat: Load tools (and all external files) from Scripts
#3139 opened Feb 19, 2025 by dhodun Loading…
@mldangelo
3
feat(webui): add curl and raw http request
#3132 opened Feb 18, 2025 by devin-ai-integration bot Loading…
3
feat: extra information plugin
#3117 opened Feb 16, 2025 by typpo Loading…
@will-holley
3
feat: add HTTP request view to EvalOutputPromptDialog
#2956 opened Feb 2, 2025 by devin-ai-integration bot Loading…
3 tasks
5
chore: make testcase generation more robust to malformed generations
#2930 opened Jan 31, 2025 by typpo Loading…
2
docs: misc cleanup
#2885 opened Jan 29, 2025 by mldangelo • Draft
2
feat: fanout behavior for jailbreaks (WIP)
#2828 opened Jan 26, 2025 by typpo Loading…
2
feat: add jsonpath support in http provider response transform
#2310 opened Dec 5, 2024 by typpo Loading…
1
feat: get thread id function call
#2263 opened Nov 29, 2024 by gonzab Loading…
2
feat(assertions): add conversational relevancy metric
#2130 opened Nov 12, 2024 by albertlieyingadrian Loading…
10
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.