Firefighters were called to Springfield Street, near Dodworth Road at around 2.30pm after an underground petrol store exploded.
The fire crew put out the flames and also assisted ambulance crews in providing first aid to the injured men.
Two men were taken to Sheffield's Northern General Hospital while the other was taken by the Yorkshire Air Ambulance to Pinderfields Hospital in Wakefield.
A police and fire investigation into the incident is being carried out.