Why does Harry look for the woman on the third day?

The three men see the woman on the rooftop one day in June as they are working on a roof gutter. She is all naked, save for a “brief red scarf tied around her breasts and red bikini pants.” They see her on the very “first day of the sun,” sunbathing on her roof. She is oblivious to her surroundings and does not seem worried that her presence on the rooftop may bother others. Harry, the oldest of the three workers, is not very keen on watching the sunbathing woman. He tries to dissuade his colleagues from looking at her by telling them that “small things amuse small minds.” On their second day of work, they again see the woman, sunbathing on her roof. This time around, all three men “whistle and yell” at her because she is indifferent to them watching her. Of the three, Stanley is the most affected by the woman’s indifference. In fact, the woman quite upsets him. He thinks that she is wrong to display her body in that manner. Tom is attracted to the woman and has crazy sexual fantasies about her.
On their third day of work, Harry is keen on knowing whether the woman is at her usual place on the rooftop. Therefore, immediately the three men get to the roof, he is the first to look for her presence. Tom knows that Harry does this so as to stop Stanley from looking out for her; he hopes to stave off Stanley’s bad humor. Harry is relieved to find that the woman is absent from the roof. The woman often distracts them from their work and especially puts Stanley in a bad mood. The day progresses smoothly with few incidents. However, later on in the evening, just as they prepare to leave for home, they realize that the woman had been on her roof after all, only that, she had hidden away from them in a different section of her roof.