If it's closer to dudasd's translation, is it a bit naughty in Bosnian? For example, is it something you could say among: observant Muslims; someone's grandmother; your boss and senior coworkers; or just close friends?
The expression is neither vulgar, nor offensive in any way. In that regard, it's more similar to "I don't care" than to "I don't give a damn", since "damn" can still be considered as an expletive, especially among religious people (although not a very strong one these days).
On the other hand, the expression is informal and a bit slangy, so I wouldn't use it in very formal situations. Still, I'd say it's totally OK for all informal situations -- for example, I've used it in front of my parents and other older relatives, in front of whom I never swear and instinctively speak and behave politely. You could definitely use it among your coworkers, and even in front of your boss, unless he expects you to use a very formal and distant tone.