我对你有情有义= I have a good feeling and an interest in you?
This translation can be considered correct if revising the sentence to 我对你有情意. "意" has the meaning of "wish", or "desire". Combined with "情", "情意", is one's affection towards another person in a love affair and wish (interest in) having a love-based relationship with that person.
"义" is interpreted as "always with reverence" in the dictionary but IMO, it is not quite correct.
If you like Chinese Wuxia stories/movies (武俠小說/電影), or contemporary movies that depict the gangster world, you will notice "义" is used quite often like 俠义, (有,重)講义氣, also 有情有义. In here, "义" describes a person who is passionately attached to another person, or the associates around him, or the association (幫派), for whom/which he would risk his own safety to keep them out of trouble without a second thought. A person posses 义 is often translated into "loyal" but not always.
Similar to the explanation above, in a love affair, 有义 simply means the person will always by the lover's side to take care of the lover, bear the responsibilities regardless of the situation, good or bad, surrounding them.
Note "情" is a feeling, it can easily change/vanish. But a person with "义", a trait, is not likely to change his nature suddenly. So, 有情有义 means "having affection and the willingness to stand with/next to you, or be there for you, always".