Well, yEd might move the viewport, but it does not change the zoom level - at least it does not do so for me with the latest yEd 3.18.1.
Which version of yEd are you using (see "Help" -> "About")? On which operating system are you running yEd? What version of Java are you running yEd on (see "Help" -> "About")?