Sorry...but normal people arrange to meet up at a time thats convenient for both of them.
It happens to be 'convenient' for Harry because he is in town for his work. Maybe Harry should call his father and arrange a meet up when both of them have a free schedule...its what normal people do
Why should Charles have to drop everything to fit into Harry's schedule
...then try and make Charles look bad.