The built in listen method of IO::Socket::Async is implemented such that a special Tappable is returned from the Supply returned by it when it is tapped. This is named IO::Socket::Async::ListenSocket and provides the usual close method as well as socket-host and socket-port methods. These additional methods are especially important if you allow the OS to select the host or port number.
IO::Socket::Async::SSL ought to provide these methods as well.