I find this annoying too. Moreover the SaveAs window starts not with the same folder all the timme, but it starts with the folder where you last saved ANY OTHER file.
If you save X_graph in folder XX, then open Y_graph in folder YY, then the SaveAs window will be by default in folder XX instead of folder YY.
(yEd ver3.13, Windows 7, 64bit)