I was trying to say this to someone and it came out "我跟你们没兴趣", which I can tell isn't right.
To clarify, common interests here refer to personal interests or interests in activities, rather than shared goals in the context of business partnership or political alliances.