-
Notifications
You must be signed in to change notification settings - Fork 88
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Blog_Testing GenerativeAI Chatbot Models #265
Conversation
…Evaluation-I.md Initial Draft
…Evaluation-I.md Implemented Review comments from Matthew Griffin.
Initial Draft
Added links to Promptfoo resources
Added image reference
removed image
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good overall, a few minor comments
_posts/2024-09-01-Evolving-with-AI-From-Traditional-Testing-to-Model-Evaluation-I.md
Outdated
Show resolved
Hide resolved
Implemented review comments provided by Sonali
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks really good, I like that you've included multiple testing frameworks and included resources for them both. Just got a few comments for you :)
- Diversity: The variety of responses generated from similar prompts. | ||
- Ethical Considerations: Checking for biases, harmful or inappropriate responses. | ||
|
||
**Simulate Real User Behaviour** Use diverse and realistic test data to emulate actual user interactions. This involves: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This, and the headings below it, need a dash, colon or line break to make them a little more readable as headings :)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
please see if it looks better now
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sorry, I don't think my comment was very clear - what I meant was that the headings (Simulate Real User Behaviour, Focus on Conversation Flow) have no separation from the content that follows it. So they may need some punctuation to separate the headings from the content, i.e:
**Simulate Real User Behaviour** Use diverse and realistic test data to emulate actual user interactions. This involves: | |
**Simulate Real User Behaviour**: Use diverse and realistic test data to emulate actual user interactions. This involves: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Got it.. used "-" instead of ":" coz I have ":" already in the sentence later on.. Please if it look okay now
Co-authored-by: lhancock-scottlogic <[email protected]>
Co-authored-by: lhancock-scottlogic <[email protected]>
Co-authored-by: lhancock-scottlogic <[email protected]>
Implemented review comments from L Hancock
…-Model-Evaluation-I.md
…-11-01-Testing-GenerativeAI-Chatbots.md Updated date in the file and the filename
Added placeholder in the image metadata url
Please add a direct link to your post here:
https://shikha-nandal.github.io/blog/2024/10/28/Testing-GenerativeAI-Chatbots.html
Have you (please tick each box to show completion):
npm install
followed bynpx mdspell "**/{FILE_NAME}.md" --en-gb -a -n -x -t
if that's your thing)Posts are reviewed / approved by your Regional Tech Lead.