“It's so much more of a physical role than I ever thought it would’ve ever been,” he tells PEOPLE ...