That's a problem!
Of course my interpretation was based on your answer (If you want to emphasize the gift). In my mind if a person gives you a gift, I think, you won't say: ''Ik ben verdrietig met het cadeau", but ''Ik ben blij..'' (just for education. You know what I mean). However if you say ''met het cadeau ben ik blij'', that's really mean that.