Should we go headless during a CMS migration?

Only if the business case for headless exists independently of the migration. Headless solves real problems - multi-channel delivery, frontend framework freedom, separation of editing and rendering - but it adds complexity. Migrating to headless because the migration was happening anyway is how teams end up with a stack they can't staff.