Buyers struggling despite record low rates