A man was arrested after being accused of stealing a Tampa Fire Rescue ambulance on Saturday and leading police on a chase.