In my town the court is also on the second floor of a two-story building. The police department has offices on the entire first floor and part of the second floor.
There are no signs on the doors leading into the building and I didn't ask whether or not it was legal to carry in there. (My interpretation is that I could not carry into the building, knowing there was a court located in the same building). ETA: The words "POLICE & COURTS BUILDING" appear on the front of the building.
Then I was given verbal notice:
hi-power in another thread wrote:The Sgt. running the program told us the first night: "We know there are a couple of people in here with CHL's and we support that, but you cannot carry in here because we have the court upstairs."