John Deere 568 idler roller bearing replacement

I have a roller that the bearing went out and melted the plastic cap. I cannot seem to get the bearing out of either side. What is the best way to get it out? Do I drive the hex shaft out and then use it to drive the bearing out from the opposite end?

John Deere 568 idler roller bearing replacement