Ahdullah b. Umar (reported) that he had not seen Allah's Messenger (way peace he upon him) touching anything in the House, except the two Yamani corners.
The Prophet's example teaches us that even though we may be able to do something, if it does not show proper respect then we should refrain from doing so out of reverence towards God's house. We must remember that our actions reflect our faith and beliefs, so by following his example in showing respect towards places like Kaaba, we can demonstrate our love for God and His house too!