Hello, thanks for your comments, that was very helpful. I'm guessing this happened because I built the roof before adding the second story.
For anyone who needs this in the future, this was in Home Designer 2024, and the fix is to select the plane in the first floor view and right click -> Display on floor above/display on floor below.