Skip to content

Commit d339ae2

Browse files
authored
Update README.md
1 parent 5708568 commit d339ae2

File tree

1 file changed

+5
-2
lines changed

1 file changed

+5
-2
lines changed

README.md

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -49,18 +49,20 @@ You must also create a `.env` file with your API key (if using OpenAI):
4949
OPENAI_API_KEY=your_openai_api_key
5050
```
5151

52+
If the target LLM is a local model, the URL must be set in the `llm_executor.py` script, specifically in the `call_local_api` function.
53+
5254
## Usage
5355

5456
Run the application using:
5557

5658
```bash
57-
python mipseval.py -e .env -c path/to/config.yaml -p openai '[-j conversation_history.jsonl]'
59+
python mipseval.py -e .env -c path/to/config.yaml -p openai -t openai '[-j conversation_history.jsonl]'
5860
```
5961

6062
For local model usage:
6163

6264
```bash
63-
python mipseval.py -e .env -c path/to/config.yaml -p local '[-j conversation_history.jsonl]'
65+
python mipseval.py -e .env -c path/to/config.yaml -p local -t local '[-j conversation_history.jsonl]'
6466
```
6567

6668
Default OpenAI models used to run MIPSEval are gpt-4o for Planner and gpt-4o-mini for executioner. This can be changed in ```setup.py``` for executioner and ```llm_planner.py``` for planner (in get_step_for_evaluator function). Testing was done with the default models used.
@@ -72,6 +74,7 @@ Default OpenAI models used to run MIPSEval are gpt-4o for Planner and gpt-4o-min
7274
| `-e`, `--env` | Path to environment file (.env) | Yes |
7375
| `-c`, `--config` | Path to YAML configuration file | Yes |
7476
| `-p`, `--provider` | Model provider: `openai` or `local` | Yes |
77+
| `-t`, `--target` | Model provider: `openai` or `local` | Yes |
7578
| `-j`, `--json_history` | Optional path to conversation log `.jsonl` | No |
7679

7780

0 commit comments

Comments
 (0)