Colin Firth's character just came across as a jerk most of the time. 
Agreed. I guess he's supposed to come off as not being good at showing his emotions, but he ends up coming off as a jerk. Did the part with Rebecca happen in the book? If so, I don't remember it. I found that entertaining. The part in Thailand reminded me of watching Brokedown Palace. Seemed like the same prison, same story, etc.