Scalable video coding is an important mechanism to provide different types of end-user devices with different versions of the same encoded bitstream. However, scalable video encoding remains a computationally expensive operation. To decrease the complexity we propose generic techniques. These techniques can also be combined with existing fast mode decision modes. We show that extending these existing techniques yield an average complexity reduction of 87%.