Omega 3 or Fish oils generally has no purported effect on libido. The general effect that it does have on health may have a postive effect on libido, general stamina and mood. There should in no circumstances be a negative effect.
L-Arganine and Zinc is what helps boost libido, from the effect on testes, so try those out.