But I also know there are dozens of rocks on the market from Tiger Iron to Bumble Bee that seem to have toxic minerals and people cut the stuff all the time.
Yes, there are quite a few gem materials which get their coloring from such minerals that can be toxic in the raw form. Toxicity is normally not a problem if the mineral is bound up in the silica (similar to their uses as colorants in glass, flooring, pottery glazes, etc.). Raw orpiment/realgar can indeed be toxic if not handled with care, but your photos looked to me like the minerals were chiefly present as a crust on the outside rind (something for you to consider when digging/handling and cutting, but not necessarily for wearing as cut gems. It is quite possible that any sulfides present are so bound up that they do not present any health concern. In a similar situation, toxic lead (Pb) is still added to most all fine crystal drinking glasses and barware, and it isn't considered a problem because it doesn't leach out of the glass in any significant amount (you get less from drinking and eating from such wares than the lead an average person consumes daily direct from the other food in their daily diet) - and other potentially toxic minerals such as cadmium, cobalt, etc. are also regularly used around your home from your dinner plates to the plastic on your children's toys. The difference is that the those minerals are locked up and not available in free form to be absorbed. In addition, we pick up minute amounts of lead, arsenic, copper and other potentially toxic minerals in ordinary foods, from the dust we breathe, water, etc. This natural exposure only becomes toxic when the amounts greatly multiply to a point (toxicity) where the body is unable to handle them. Some, such as copper, are actually things the body needs (in tiny amounts). Something to consider when asking the people at the lab.