The Royal College of Physicians highlights "major structural weaknesses" within the department.