Hosting the Olympics almost always backfires. It sounds glamorous, but in reality, it's anything but. Cities build massive arenas and hotels just to accommodate the events and athletes and then have virtually nothing to use them for after the games hit the road. As a result, the world is positively littered with abandoned Olympics venues. From Sarajevo to Athens, most places just can't handle the Olympics.
Start to finish, host cities run inevitably run into problem after problem. One of the biggest problems is almost always infrastructure. Hosting the Olympics requires several venues and arenas, pretty much all of which need to be new or at least newly renovated.
Of course, after the Olympics are over, there's really no more need for said venues. Some continue to get used for various purposes, but many inevitably fall into a state of disrepair. The specialty sites, in particular, the ones built for things like bobsledding and other less popular sports, are usually the first to go. In the end, the upkeep on old Olympic sites just hasn't been worth it for most past host cities.
There are ghost sites from previous Olympics all over the world. Here are some of the creepiest.