Just like the PDF and HTML, it would be great to have a jupyter notebook button on the toolbar.
This just calls notebook(...) on the file.
I don't believe that there is an obvious "preview" window to show, but you could try out some of the atom packages to see if one exists. Worst case, generating the notebook without preview is perfectly fine.