If your video is in a Collection, click:
On-Demand > Your Library > select collection > select video
Scroll down to Thumbnail > click Choose file
If your video is in a Course, click:
On-Demand > Courses > select chapter > select video
click Edit Video Details, click the big red X, then add new photo > and Save