Yes, it's a fairly common construction, with or without the word "for". It just means they all looked good together, like a painting.
The young couple make a pretty picture
The King and Queen rode in with their son Geric at their side and they made a pretty picture as well
The shadow of the bough and its appendages on the wall, and arching over on the ceiling, made a pretty picture (from a book of 1824!)
There's also an expression "pretty as a picture".