While the actor and writer has since settled into a groove with the series, there was a point where he was worried that the ...