There are several work out places in Reykjavik. Hilton and Grand Hotel have a gym. The Blue Lagoon Spa in Reykjavik is a really nice Spa – You can also work out when you book your treatment / massage there ; (it is located in about 5 min walk from Hilton, which is about 25 min walk from the center).