This is not a bug. It's an actual Stacks button style, so it's undoubtedly by-design. In fact, this is actually the default style for anything classed as a button. (You have to explicitly opt-in to either an outlined or filled style.) Whether it is sensible to have a button that doesn't look like a button except when you hover over it is debatable, like whether most of Stacks makes sense...
In this specific case, the design shouldn't have a button at all. This is a progressive disclosure idiom; it should use a flippy triangle or something that provides affordance to make the function clear. Unfortunately, Stacks strikes again; "Expandable" components use toggle-buttons (i.e., things that look like buttons, but visually preserve a "toggled" state) to control whether the item is expanded or not.