The "no" of the son's response is not the Greek negative of opinion which usually goes with a verb of thought or feeling translated as "will" but meaning "want" or "desire," but Jesus only uses this negative with this verb so it makes it feel more adamant.
The change in responses between the first son to the second (see note below and Greek translation) goes back to the Latin Vulgate. This is because Jesus's opponents say that the first son is the more virtuous in Matthew 21:31. This seemed like a "mistake" on the part of Gospel writers, but I suggest that Jesus's opponents really did see the son that answered correctly as the one who did his father's will, that is, telling him what he wanted to hear without lying. See the note on the next article to understand my translation.
(The Perseus source reverses this and the following verse.)
Christ's Words in Matthew as a Guide to 40 Days of Prayer.