Utilizing energy flexibility in households through smart steering of appliances has received attention as one way to reduce power peaks and adapt demand to a renewable energy system. Heating is a big part of the electricity consumption in households, and heat pump technology is growing in popularity for heating detached houses. While there is ongoing research calculating the technical potential for energy flexibility from heat pumps, few studies combine remote control of heat pumps with qualitative research on how households experience this control. The purpose of this study is to find out how long-term steering of heat pumps is experienced by households, how it affects their heating practices, and how they make sense of remote steering as a service. The data originates from an interdisciplinary project combining a field trial where heat pumps of selected Swedish households were remotely controlled for two winter periods, with qualitative interviews with the households. We conducted interviews with 12 participants, before and after the trial.The results show that households were overall positive towards offering flexibility through remote-controlled heat pumps, and that the steering of the heating blended well with normal temperature variation associated with having a villa in Sweden. However, the respondents were mystified by the procedure, which created a ghost in the heat pump. Furthermore, remote steering as a service comes with challenges related to reliability, security, and agency over the heat pump. Important social conditions for adopting flexibility through remote steering of heat pumps are discussed.