At least 100 IRS employees were laid off on Thursday and the local union representing these workers anticipates more layoffs, possibly up to 1,000.