Between the risk of having space junk land near your home (as happened to a farmer in Washington state earlier this year) and the possibility that satellites you depend on could get knocked out of commission at any moment, it is safe to say that the problem of space junk is quite serious.
And that doesn't even account for the sheer ugliness of an Earth surrounded by clutter.