It can take time too. One of the ways rich people skirt taxes is paying lawyers to drag things out in court. IRS doesn’t just have to hire new people to do complicated audits on rich people, they also have to pay lawyers to enforce their findings in the courts. Ramping up new agents to handle the audits and going through any court procedures can take years.