I am quite happy they added the borders, but I know some people use high-contrast themes as a base for their own theming and don’t want this, in this case, add this to your userChrome.css:

:root {
  --toolbarbutton-outline: none !important;
}