By introducing a doublet of electromagnetic four dimensional vectorpotentials, we set up a manifestly Lorentz covariant and SO(2) duality invariantclassical field theory of electric and magnetic charges. In our formulation one does not need to introduce the concept of Dirac string.