The Large Magellanic Cloud (LMC) is a satellite galaxy of the Milky Way at a distance of approximately 50 kpc. It harbours several interesting targets for TeV gamma-ray observa-tions: The composite supernova remnant N 157B/PSR J05367-6910 was discovered being a TeV gamma-ray emitter by H.E.S.S. Fermi detected MeV/GeV gamma rays from the massive star forming region 30 Doradus. The very young supernova remnant SN 1987A is a potential gamma-ray source and H.E.S.S. observations could constrain Cosmic Ray acceleration in young supernova remnants. We will present H.E.S.S. observations of the part of the LMC containing these objects. We will put our findings into a multi-wavelength context and discuss in detail the implications of the detection of gamma-ray emission from the pulsar wind nebula.