Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generation

This work introduces two new simple rewards to encourage the generation of factually complete and consistent radiology reports: one that encourages the system to generate radiology domain entities consistent with the reference, and one that uses natural language inference to encourage these entities to be described in inferentially consistent ways.