Operating ultracold quantum gas experiments outside of a laboratory environment has so far been a challenging goal, largely due to the lack of sufficiently stable optical systems. In order to increase the thermal stability of free-space laser systems, the application of nonstandard materials such as glass ceramics is required. Here, we report on Zerodur-based optical systems which include single-mode fiber couplers consisting of multiple components jointed by light-curing adhesives. The thermal stability is thoroughly investigated, revealing excellent fiber-coupling efficiencies between 0.85 and 0.92 in the temperature range from 17°C to 36°C. In conjunction with successfully performed vibration tests, these findings qualify our highly compact systems for atom interferometry experiments aboard a sounding rocket as well as various other quantum information and sensing applications.