This tool is meant to automate the error-checking process in data evaluation. It will process a runspec CSV and output the same CSV file with an extra column "Errors" that includes a list of errors/bugs GPT4 found in the generated text.
\n\n
errors.json
is a dynamic error taxonomy. Update with new errors for GPT4 to label and catch during data evaluation.
To run this project, you need to set up your API keys and other configuration settings.
-
Copy the Example Configuration File
Copy the
config.example.yaml
file toconfig.yaml
:cp config.example.yaml config.yaml
-
Edit the Configuration File
In
config.yaml
, replace placeholder values with your actual API keys and other sensitive information. -
IMPORTANT: Add to .gitignore
Secure your information by making sure
config.yaml
is added to.gitignore
to avoid accidentally committing your API key.
Handle Configuration in Code
import yaml
def load_config():
with open('config.yaml', 'r') as file:
return yaml.safe_load(file)
config = load_config()
api_key = config.get('api_key')