It may have to do with the notify mechanism.
When you are downloading something, your computer has to continually send a response to the seeder, which is why you are always downloading some amount of data even when you are only seeding torrents. It's kind of like a "got it!" message that you have to send back for every fully downloaded piece of data.
If there is someone downloading from you at 70-90 kBps, if this person does not send the response quickly enough, you will seed one piece of data at 70-90 kBps, and then seed at 1 kBps to other people while you wait for the response.
This is why people recommend you keep your max upload speed limited to about 80% of your theoretical upload speed that the ISP tells you. Doing this will let your torrents run more smoothly, as the "got it!" messages can use the remaining 20%. Note that in this case it would be the downloader that does not have the right settings.
There's no guarantee that this is the cause, but it's a possibility.
Another possibility is that you are seeding to one person at the high speed, and then he closes his client after a while and you're left with no one to seed to except the slow ones. If your speed fluctuates rapidly, like at least once every two minutes, the response mechanism is more likely the problem. If it fluctuates slowly, like maybe once every hour or two, then the disappearing downloader is more likely the problem.
If it doesn't fluctuate very frequently, like if you notice the change only once or twice a week, it's probably just a lack of leechers.
Either way, you can't do anything about it.
Anyway, be sure to do what BuriaL said too. At least make sure things are fine on your side.
I didn't say I couldn't upload. I just wonder how to do better than I am currently. Like those who upload to me at over 130kbps, which seems to be about the best I can remember seeing.
Most people don't upload at 130 kBps. When you download at a high speed, it is the result of the combination of connections to several seeders that are uploading at lower speeds. That's how torrents work. Seeding works the same way - your upload speed depends on how many leechers you are able to connect to and push data at all at once.
(Edit: BTW, make sure you know the difference between b and B)