James' relationship to his father centers on the latter's cold and aloof manner. Mr. Ramsay is, for all of his talents, not the most affectionate or attentive man when it comes to his children. His academic work keeps him cloistered from the real world and its problems and he largely leaves the childrearing to his wife. This in essence leaves James without a suitable male role model, which manifests in his development of an attitude of disdain for his father and a preference from a young age for the company of his mother, whose nuturance and tender care for her son brings into sharp contrast the neglectful tendencies of his father. This outward display of malice and ill-will towards his father mirrors what James thinks is his father's indifference toward him, a sort of rebellion against the relinquishing of the paternal duties on the part of Mr. Ramsay.
What James feels toward his father internally is less hatred than a secret reverence and a great disappointment at his father's lack of acknowledgement of his talents and capabilities. Mr. Ramsay does not praise his children, indeed seems to have nothing to say to them unless it is a form of of punishment or displeasure with some aspect of their behavior. James recognizes this as a form of tyranny and urges his sister Cam to fight with him against his father's silent domination of them.
This tension between hatred and reverence, resignation and resistance is something James struggles with greatly after his mother's passing and comes to its most fervent peak during the family's boat trip to the Lighthouse near the end of the book. It is here where James has the realization that he is not separate from his father but inextricably linked to him. The two share an unspoken internal struggle of loneliness and disappointment and James can no more distinguish himself from his father in the same way that Mr. Ramsay, in a moment of great joy for James, comes to the same silent realization and praises his son for the first time.
James' relationship with his father, paticularly this breakthrough toward the end of the novel, represents a struggle for identity, the tension between identifying oneself on the basis of what one is not ("a tyrant") and following the mold of one's parents in the quest to build a life of one's own.
The motif here centers around the role of communication or rather the lack of communication between son and father. In the larger picture throughout the work, we get a sense of the internal monologues of many of the characters, but the ability to communicate their feelings, which often take on contradictory aspects, is troublesome. We get a glimpse of the love they share for one another at the conclusion of the dinner scene, but otherwise there appears to be a siloing of feelings. Mrs. Ramsay cannot tell her husband that she loves him. Mr. Ramsay can only hint at his need for reassurance, which his wife has noticed to pick up on. Lily's outlet for her feelings she tries and many times fails to communicate through her paintings. This moment of concluding praise of James by his father is one of genuine feeling expressed, of direct communication.
As I came upon this episode with James and Mr. Ramsay, I was immediately reminded of a scene from the well-known film by Ingmar Bergman, Through a Glass Darkly. Though it has no bearing on Woolf's work or on this analysis, it merits mentioning for the similarity in the relationship difficulties between father and son we find in To the Lighthhouse.
The plot centers around a young woman who is mentally ill and slowly losing her sanity. Her father is a man very much like Mr. Ramsay: A writer, a man of words, aloof from his children, immersed in his work, undergoing an existential crisis while his family falls apart around him.
The young woman's brother Minus, around the same age as James, is caught up in this turmoil and deeply wishes his father would talk to him and recognize his own talents as a writer. At the end of the film, there is a scene with a very similar motif as the one I've described abaove in To the Lighthouse. Minus' father finally speaks to him, acknowledges him as his son, and Minus echoes James in his joy ("Papa spoke to me!").