See previous discussions in #1182 and #1184. In short, it is difficult to use the current compiler architecture with anything other than the signatures built in to Stan's math backend, including add things (like in Torsten) and replacing it entirely (like deepppl)
This is important to consider when thinking about #1373 as well