This was due to the is-layout-flex
CSS class not loading the correct CSS after updating to WordPress v6.1 (probably due to the theme being used not supporting it).
Adding the following solved it. (If you don’t have easy access to the code, you can add via Appearance > Customizer > Additional CSS).
.is-layout-flex {
display: flex;
}