Make sure that you're not capping your upload speed. Torrenting networks rely on the concept of uploading and downloading at the same time, the more people uploading, the faster the overall download is for everyone, and in many cases if your upload is set low, then you will be throttled by the torrent.
You could also make sure that family members, room mates, etc are not using up all of your downstream and upstream bandwidth.
