Being quite sessile and filter feeders, pollution and loss of habitat would do it. In other words, it is because of the unfortunate ways of man, who, on the contrary, is quite mobile and omnivorous.

Slraep