Robert gets this question from almost every buyer eyeing a getaway near Lake Acworth or a rental to add to their portfolio: does it matter what you call it? It does. Lenders classify a property as a primary residence, a second home, or an investment property, and each label carries its own down payment, interest rate, and rental income rules. Here is what actually changes.