The IRS will stop making most unannounced visits to taxpayers' homes and businesses

The agency said instead it will send letters to certain taxpayers to set up face-to-face meetings.