No you just don't use the USBtoSerial connection but connect the TXD/RXD Pins crossed(!) and VCC and GND to the Bluetooth module (usually they came preconfigured at 9600baud 8N1 check this!). On Arduino Pro or such without a proper USB connector this shares pins with the Sketch upload, so you have to disconnect the Bluetooth Module for Sketch updates. All other connections stay the same. An Arduino has plenty ports to use ;-)
Have a look at my image above. The BT module is bottom left, 4 wires red VCC, black GND, the others TXT/RXD.
As soon as the physical connection is there and the config BOTH in sketch and on the BT module is corect you should be able to connect. However... On my Win8.1 PC it was a pita to get the BT working. These options are all scattered around. But now it works (after some 20 Minutes, the Android was like 10 seconds...)
Carsten