Don't assert on the absence of our pubkey in the `partial_sigs`

[darosior]

It's not checked before!