It gets involved. Yes, the center speaker must come off. You just have to take your time. First I pulled the lower side panels off of the center console where the cup holder is. Those just pull off, best to use the plastic pullers for dash removals so you don't damage it. Once those are off you will see the bolts to take off, I believe there was four or five on each side. Once you free that up pull it off and to the side, it has a wire connected to it for the cup holder light option but you will have enough line to put it out of the way. Once the center console is off then you can access the bolts to the face of the center console. You will also have to pop off the speaker with the light sensor that is on the top of the dash. It just pulls off. Under that you will have two bolts to remove. The tricky part for me was at the bottom of the dash control module on each side had a spring loaded bolt, that I could not get back on when I put it all together so they currently are not on my car, but everything is fine no rattles or sounds and everything is working fine. I also could not completely remove the dash from the bottom of the center console, I just pulled it forward and had enough space to remove the old module and replace it with the new one. Once that was done, just do everything in reverse order. But please take your time and don't rush it. It actually was harder for me to put it all back together than getting it all apart. The key is have patience and go slow. Mine is working great and all is good with no issues. All bolts are on except for the two spring loaded ones on each side at the bottom of the center control dash. But all is good with no rattles. I hope this helps you out a bit. It's hard to explain with not being at the car with you or a video. Next time I do something I am going to video it so it can help others. I am planing on getting the sync 3 upgrade when OEM comes out with it. So I may be doing it again all over.
Best of Luck to you.