I recognise this kind of putting a sentence from my research about "pick-up-artists".
The "flirting" contains senteces that somehow sound like compliments, but under the surface there is disdain.
The sentence "Your figure wouldn´t bother me" is crafted to confuse the addressed person.
Hearing this she will probably think, that she is not desired, and so on one handside she feels safe, and on the other handside she wants to impress the man(?) talking, and persuade him, that she IS attractive.
Similar sentences might soud like:
"For your age you look really fresh"
"Ah, I see, you are like a casual type"
"I like your puppy-fat cheeks"
and so on.
You were right to hear the alarm-bells ring and to cancell the conversation!