-
Notifications
You must be signed in to change notification settings - Fork 117
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
How to execute my own queries? #50
Comments
The easiest approach is to create a dataset in the same format as the Spider development set (dev.json and associated tables.json, but with your questions and database schemas), and then run preprocessing and eval as you normally would for spider. The path to the dev set (dev.json) is in the .config file -- for simplicity you could just replace the spider dev with your own, but alternatively just extend the config file with one of your own that points to your custom questions instead. |
Is there a script available to generate the .jsons given the question in NL and the database file ? [UPDATE] - In fact, the process is straight forward. In case you want to run RAT-SQL on your own dataset the script needed to generate the .json files for the tables of the DB and for the query are not in this repository but in Spider dataset repo: https://github.com/taoyds/spider. So the easiest thing to do would be: 1 - Generate new_table.json , new.json using Spider script. |
I am able to create new_tables.json but while creating the new_dev.json how do I create the sql component for each query? [UPDATE] - I found the solution to above problem, one can follow the instructions given here It worked for me. |
Hello,
If I want to test my own queries,what should I do?
Thank you very much.
The text was updated successfully, but these errors were encountered: