How do I get rid of moss that has overtaken my terrace?

I have a very small terrace between mine and my neighbors home. For some reason the moss just goes crazy on the sidewalk down there. I've tried scrubbit it and everything...I just have no idea how to get rid of it. It looks like a dungeon down there!!