The difference will be overall volume (much louder) and the quality of the low bass notes. If you are not into loud music while you drive, you could remove it to gain the trunk space.

like GR said, there may be a button on your deck that switches it on/off.