Creating Divisibility Tests

The number $123454321$ is written on a blackboard. Evan walks by and erases some (but not all) of the digits, and notices that the resulting number (when spaces are removed) is divisible by $9$. What is the fewest number of digits he could have erased?

Source: 2012-2013 Winter Online Math Open