Placeholder approach for non FIM LLM

[damianofalcioni]

Hi,
I've see "good" results on different models with this simple prompt:

Replace MY_PLACEHOLDER in the following code. 
Respond with only the text that replace MY_PLACEHOLDER. 
No additional text is allowed in the response.
```javascript
for (let i=0;i<10;MY_PLACEHOLDER) 

As I'm not an LLM expert, do you think that having a template like this and adding MY_PLACEHOLDER at cursor position can be a valid approach for using models that do not support FIM?

Thanks,
Damiano

[igardev]

I guess it could work, but will not be so good as FIM models and will be better if you provide more code, not just one line.
In llama.vscode version 0.0.10 there is an edit with AI feature (requires running chat server, which is not FIM; start it by selecting a code and Ctrl+Shift+E). It uses something similar - replacing the selected text (original text) with a new one based on instructions. The prompt is like this:
Modify the following original code according to the instructions. Output only the modified code. No explanations

instructions:
{instructions}

original code:
{originalCode}

modified code: