|
|
@@ -64,7 +64,7 @@ The application will be accesible at http://localhost:8000/admin. Login using th
|
|
|
## Load dataset
|
|
|
At the moment there is an implementation for loading MedQA, PubMedQA and MMLU datasets.
|
|
|
```bash
|
|
|
-python manage.py import_medqa --file=medqa/dataset/test.jsonl --target=test --dataset=medqa #will load the medqa test QA to target test
|
|
|
+python manage.py import_medqa --file=datasets/medqa/test.jsonl --target=test --dataset=medqa #will load the medqa test QA to target test
|
|
|
```
|
|
|
```bash
|
|
|
python manage.py import_mmlu --dataset=mmlu --target=test --subject=anatomy #will load the dataset MMLU covering anatomy subject into a dataset called mmlu and target test. The dataset is loaded from hugging face.
|
|
|
@@ -72,7 +72,7 @@ python manage.py import_mmlu --dataset=mmlu --target=test --subject=anatomy #wil
|
|
|
|
|
|
## Execute a session
|
|
|
```bash
|
|
|
-python manage.py eval_qa --target=test --session-id=16 --continue
|
|
|
+python manage.py eval_qa --session-id=16 --continue
|
|
|
```
|
|
|
|
|
|
## Data Loaders
|
