That's exactly what the black holes want you to think.

Basically what they are saying is that there's a possibility of something called a "gravistar" that would be a stable mass held together by dark energy instead of a singular like a black hole. Basically from what I read, it would have even weirder physics but would look exactly the same as a black hole from our outside perspective. My guess is that, in essence, if there's no way for us to tell the difference between a black hole or a gravistar than they could potentially just all be gravistars and we'd never know.