How can I safely upgrade Babel in a project and roll back if the new version breaks my build?

I want to upgrade Babel to take advantage of newer JavaScript features, but I need a reliable process to test the upgrade and revert to the previous version if something goes wrong. What steps should I follow to pin versions, run tests, and safely roll back?