It need to be classified as one or the other not both for mortgage. Second homes get much better terms then IPs but they should truly be a non rented property.
Remember you are signing a federal document when you declare what type of home it will be.