Update: It is easier. Credit: John K. Kruschke
==The following is obsolete==
The trick is to use Rcmdr to create the new diagram window.
Then the following plots by r codes in rstudio will be coerced to output in the new window.
Both rstudio for Mac and for Windows support the trick.