There are gaps in accountability for addressing racism across Government departments, according to a new report.