Some do (actually many do during the winter at least) and when they do, they usually have happy hours during week days and from 17 – 19. Happyhour.is is a website that aggregates happy hours in Reykjavík (it’s only available in Icelandic, but you can see the names and hours pretty easily).