RMS is by default setup to use avery label sheets, multiple labels per 8.5 by 11 page.
But you can design a label that prints one per page, but it takes some trial and error. So it depends on your labels. But might require you to use the label designer to alter the height, width and margins.
If you are using a roll of labels then most likely each label is as wide as the roll, which previews in the Label Wizard as one per page. You can use the next page button to preview the next label. Try printing a single label, and if that works then print a few at the same time.
You should not have to change the printer.