Yes, the wing window push button is just a small chrome cap. They're knurled to stay on the shaft but over the years many go missing. Replacing the handle is probably going to be easier than finding just the button. You do not need to replace th entire wing window. I might even have an NOS handle.