Full Page Transcription Quality Assurance

This feature is available in v41.2 and later.

Accessing this feature

Your access to the feature described in this article depends on your license package and pricing plan.

To learn which features are available to your organization and how to add more, contact your Hyperscience representative.

If you have a custom flow that includes the Full Page Transcription (FPT) Block (e.g., as part of Document Chat), you can measure the accuracy of the block's output by adding the Full Page Transcription QA Block to your flow. This block creates QA tasks for your keyers, where they are asked to mark the transcriptions of text segments as correct, incorrect, or illegible. They do not need to transcribe the text manually or correct any incorrect transcriptions.

Starting FPT QA tasks

Keyers can begin working on Full Page Transcription QA (FPT QA) tasks by following these steps:

1. Go to Tasks > Perform Tasks.

2. In the QA task type card, click Perform Tasks for Full Page Transcription Quality Assurance.

Performing FPT QA tasks

At the beginning of a Full Page Transcription QA task, the keyer can review the provided task guidance. They are then asked to review the transcription of the segments listed in the right-hand sidebar.

For each segment's transcription, the keyer marks the text as correct, incorrect, or illegible by clicking one of the buttons under the transcription or using one of the keyboard shortcuts provided. The result is shown next to the segment's record in the right-hand sidebar ( a checkmark () for correct, an “X” () for incorrect, and a crossed-out eye () for illegible).

Tokens

Some segments may contain multiple tokens, or subsegments, that need to be reviewed individually. If a segment contains tokens, the number of tokens in the segment is shown in the segment's record in the right-hand sidebar.

When a keyer marks any of a segment's tokens as incorrect or illegible, the entire segment is marked in the same way, regardless of whether any other tokens in the segment were marked as correct. In these cases, the system advances the keyer to the next segment, even if there are tokens in the current segment that have not yet been reviewed.

Completing tasks

After the keyer reviews a segment or token, the system advances the keyer to the next segment or token in the list. The keyer can go to any individual segment or token by clicking on it in the right-hand sidebar or using the Next or Back keyboard shortcuts.

When the keyer has marked each segment as correct, incorrect, or illegible, they can submit the task by clicking Submit or pressing Enter or Return on their keyboard. This option is not available to the keyer until all segments have a correct, incorrect, or illegible designation.

Available actions

Keyers can take the following actions to help them complete FPT QA tasks:

• Show guidance — Clicking the question mark icon () in the upper-right corner of the page-viewing area reveals the guidance shown at the start of the task.

• Zoom in or Zoom out — Keyers can click the magnifying glass icons to zoom in on () or zoom out of () their view of the page.

• Move the dialog box to a different part of the page — If the dialog box containing a segment’s transcription is covering the segment, keyers can press F4 once to move the dialog box to the bottom of the page and twice to move it to the top of the page. Pressing it a third time moves the dialog box back to its original position.

• Show keyboard shortcuts — Clicking the keyboard icon () reveals the keyboard shortcuts.

• Hide task sidebar — If keyers need to view more of the page at a time, they can hide the right-hand sidebar by clicking the Hide task sidebar icon ().

Invalid tasks

If a page is unreadable, blank, or rotated incorrectly, a keyer can mark the task as invalid. To do so, they can click the menu at the top of the page ( ) and then click Invalid task.

After a task is marked as invalid, the task ends. The system does not count the task as an incorrect machine read, and it does not include it in accuracy calculations.

FTP QA keyboard shortcuts