[Feature] Add loading spinner during interactive inference

[wizeng23]

Feature request

Since we don't support streaming yet, there is no visual indication that progress is being made for inference, especially for outputs that take multiple seconds to minutes to generate. Adding a loading spinner can help alleviate this.

Motivation / references

Could use this existing _print_and_wait() fn from the job launcher:

oumi/src/oumi/cli/launch.py

Line 75 in f4e90e7

def _print_and_wait(

. It would need to be modified so that the result of the function call is piped through and returned.

Your contribution

I'm happy to consult and provide help for whoever takes this on

[jackz261]

I can help work on this one.

[wizeng23]

Thanks Jack! Let me know if you have any questions.

[shivam096]

Hi @wizeng23 ,

I can take it up if it is available again.

[nikg4]

@shivam096 it's all yours!

[shivam096]

Thanks @nikg4 for assigning the issue.

@wizeng23 can you help me with a brief about the requirement and also it would really help me if you could also provide any resource that could help me with the task.

[wizeng23]

Hi Shivam, the description for this Feature at the top should have most of the details you need. This is the call where the spinner should be displayed:

oumi/src/oumi/infer.py

Line 58 in 47df09e

model_response = infer(