I have a rc controller that has a 650mA 8cell battery in it, can i use a 8cell battery pack with 1100mA?

As long as the cell count is the same which you state it is, you can use it.