Paying a compliment can be a great way to start a conversation, but make sure it is genuine. What made you notice him/her? Was it their eyes? Or their smile? Just tell the truth.
Another great way to start a conversation is to say something about yourself, then ask a question. For example, "I am new at this gym. Are there any good classes here? ".