Toggle will invert the state of each input, so if both the key and the mouse button are pressed when the toggle actions are executed, they will be released.
If, however, something else has released one of the inputs, the toggle actions would release one and press the other.
For consistency, explicitly releasing both inputs is likely to yield the best results.