Mine stays in place by itself somehow (perhaps magic?), so I can't speak from experience. However, this style from Peterson's August '59
(page 212 if the link doesn't direct there) claims to "remain securely upon the head"; it has a string run all around the brim, adjustable from the center back edge. I recall Liz's infant cap pattern having a similar feature.