Skip to content

Commit

Permalink
Revert "Gorilla README and repo structure revamp (#799)"
Browse files Browse the repository at this point in the history
This reverts commit 24ed54d.
  • Loading branch information
ShishirPatil authored Jan 5, 2025
1 parent 24ed54d commit 57db2dc
Show file tree
Hide file tree
Showing 123 changed files with 105 additions and 128 deletions.
227 changes: 102 additions & 125 deletions README.md

Large diffs are not rendered by default.

4 changes: 2 additions & 2 deletions gorilla/eval/README.md → eval/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ python get_llm_responses.py --model gpt-3.5-turbo --api_key $API_KEY --output_fi
### Getting Responses with Retrievers (`bm25` or `gpt`)

```bash
python get_llm_responses_retriever.py --retriever bm25 --model gpt-3.5-turbo --api_key $API_KEY --output_file gpt-3.5-turbo_torchhub_0_shot.jsonl --question_data eval-data/questions/torchhub/questions_torchhub_0_shot.jsonl --api_name torchhub --api_dataset ../../data/api/torchhub_api.jsonl
python get_llm_responses_retriever.py --retriever bm25 --model gpt-3.5-turbo --api_key $API_KEY --output_file gpt-3.5-turbo_torchhub_0_shot.jsonl --question_data eval-data/questions/torchhub/questions_torchhub_0_shot.jsonl --api_name torchhub --api_dataset ../data/api/torchhub_api.jsonl
```

### Evaluate the Response with AST tree matching
Expand All @@ -24,6 +24,6 @@ After the responses of the LLM is generated, we can start to evaluate the genera

```bash
cd eval-scripts
python ast_eval_th.py --api_dataset ../../../data/api/torchhub_api.jsonl --apibench ../../../data/apibench/torchhub_eval.json --llm_responses ../eval-data/responses/torchhub/response_torchhub_Gorilla_FT_0_shot.jsonl
python ast_eval_th.py --api_dataset ../../data/api/torchhub_api.jsonl --apibench ../../data/apibench/torchhub_eval.json --llm_responses ../eval-data/responses/torchhub/response_torchhub_Gorilla_FT_0_shot.jsonl
```

File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
2 changes: 1 addition & 1 deletion gorilla/inference/README.md → inference/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -76,7 +76,7 @@ python3 gorilla_eval.py --model-path path/to/gorilla-7b-hf-v0
----answer-file path/to/answers.jsonl
```

You could use your own questions and get Gorilla responses. We also provide a set of [questions](https://github.com/ShishirPatil/gorilla/tree/main/gorilla/eval/eval-data/questions/huggingface) that we used for evaluation.
You could use your own questions and get Gorilla responses. We also provide a set of [questions](https://github.com/ShishirPatil/gorilla/tree/main/eval/eval-data/questions/huggingface) that we used for evaluation.

### 3. Local Inference of Quantized Models

Expand Down
File renamed without changes.
File renamed without changes.
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.

0 comments on commit 57db2dc

Please sign in to comment.