Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What does YOUR_INPUT_FILE look like? Can you provide an example? Thanks very much! #65

Open
XiaozhuLove opened this issue Apr 3, 2024 · 3 comments

Comments

@XiaozhuLove
Copy link

cd retrieval_lm
python passage_retrieval.py
--model_name_or_path facebook/contriever-msmarco --passages psgs_w100.tsv
--passages_embeddings "wikipedia_embeddings/*"
--data YOUR_INPUT_FILE
--output_dir YOUR_OUTPUT_FILE
--n_docs 20

@innovation64
Copy link

cd retrieval_lm python passage_retrieval.py --model_name_or_path facebook/contriever-msmarco --passages psgs_w100.tsv --passages_embeddings "wikipedia_embeddings/*" --data YOUR_INPUT_FILE --output_dir YOUR_OUTPUT_FILE --n_docs 20

its script has some problems, it doesn't have --data argument, only has --dataset or --query, you need change it ,and i try to run it just by simple jsonl or json file with questions @XiaozhuLove

@WiFi-Lost
Copy link

WiFi-Lost commented Oct 8, 2024

@innovation64 Can I just use the json file in eval_data or Could you please share your json file?

cd retrieval_lm python passage_retrieval.py --model_name_or_path facebook/contriever-msmarco --passages psgs_w100.tsv --passages_embeddings "wikipedia_embeddings/*" --data YOUR_INPUT_FILE --output_dir YOUR_OUTPUT_FILE --n_docs 20

its script has some problems, it doesn't have --data argument, only has --dataset or --query, you need change it ,and i try to run it just by simple jsonl or json file with questions @XiaozhuLove

@chanmin0723
Copy link

They may have mistakenly written --data instead of --query. If you use --query YOUR_INPUT_FILE, you can see that it runs correctly, as shown in the image below.

화면 캡처 2024-11-07 185159

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants