If the narrator had not knocked on the wall, the cat eventually would have died too. The narrator's undoing had also inadvertently saved his nemesis's life.
The body is explicitly in the cellar wall for a matter of at least two, maybe three days. A cat has to eat, and with nothing else around...there may have been more than one reason she was "clotted with gore" when they found her.