In theory yes, you should redownload all the .torrent files while logged in, but...
If you search the forum there's an easy way mentioned to update all your .torrent files in one fell swoop, involves copy/pasting your new passkey.
Edit:
here and
here(this involved the new tracker, but it should work the same way)
Which torrent client do you use?