I drank a swiftness potion and went in the nether ... like 10 seconds later and the effect vanished. Don't know if that happens everytime... but it shouldn't.