Post-crisis developments put a lot of underperforming loans in the hands of a small number of servicers. Increased regulation and the need for specialized skills drove banks out of the business.