You can do this across the board via MIME blocking. Determine the MIME types of the videos you want to block, enter them in on the Filter Action.
Blocking only videos on only some sites... I would do blacklist with a combination of "applies to this website" and a regex matching the path of the video you want to block.