Why does he gets nervous , is he intimidated by me?

If you like him, stay. You should simply mention to him that with out physical contact, relationships don't work ;)