When air moves it picks up tiny bits of loose materials and moves the to other places. Soil carried by wind it scrapes rocks and eventually destroy its composition and this process is known as erosion.
Given enough time, this process will destroy both natural and human made structures no matter how strong and solitd they were.