Appendix D PIAAC Cycle II Operational Field Test Assessment

Program for the International Assessment of Adult Competencies (PIAAC) Cycle II

2022 Field Test

OMB # 1850-0870 v.10

Appendix D

Field Test Assessment Text

Submitted by National Center for Education Statistics

U.S. Department of Education

September 2019

revised March 2021

Appendix D

PIAAC Cycle II

Field Test Assessment Text

Help Text

Thank you for answering those questions.

In the next part of the study, you will be asked to complete a series of exercises. You will be asked to read and answer questions about different topics that involve real life situations. You may find some questions easy and others more difficult, it’s all right if you can’t do all of them but it is important that you try each one. Here is some paper, a pen/pencil and a calculator in case you would like to use these materials while completing the exercises.

To complete the exercises you will work on this tablet. I will demonstrate how to use the tablet and give you a chance to practice before you begin the exercises.

To select something on the tablet screen, tap it with your finger or the stylus. I will demonstrate how to tap on this shape, first using my finger and then the stylus. Then I will tape on the NEXT arrow at the top of the screen to go on.

Please practice tapping on the shape. Practice using both your finger and the stylus. When you are finished practicing, please hand the tablet back to me.

Sometimes you will be asked to drag and drop something on the screen. I will show you how this works using the stylus. You can also drag and drop it near empty square #2. Note that I can drag the gold square back near its starting location and it will drop back into place.

Please practice dragging and dropping and dropping the squares. Practice using both your finger and the stylus. When you are finished practicing, please hand the tablet back to me.

Sometimes you will be asked to highlight words on the screen. This must be done using the stylus as highlighting with your finger will not work. In the list below, I will show you how to highlight the word “Atlantic” as well as the complete sentence in the note. Then I will tap with the stylus to erase the highlight for “Atlantic.”

Please practice highlighting using the stylus. When you are finished practicing, please hand he tablet back to me.

You will complete all of the remaining exercises on your own. Please read and follow the instructions on each screen. Do you have any questions before you begin? I will now give you the tablet.

HELP

Tap on a link or scroll down to find the information you need.

When you are finished, tap on CLOSE to return to the exercise screen.

Moving from Screen to Screen

How to Answer

Scrolling

Using the Online Calculator

Using Tabs

Websites with Multiple Pages

CLOSE

Moving from Screen to Screen

Tap on the NEXT arrow to go to the next screen.

Tap on the BACK arrow to return to a previous screen.

When an arrow is grey, it cannot be selected.

In some exercises, the NEXT arrow will change color when it is tapped.

You will be asked to confirm that you want to go on.

Once you tap on the NEXT arrow a second time to confirm, you will NOT be able to return to the question.

⇑ Top of Page

CLOSE

How to Answer

Tap on a choice:

These questions have only one answer.

Tap on a choice.

The circle will be filled.

To change the answer, tap on a different choice.

Tap on one or more boxes:

These questions may have more than one answer.

Tap on one or more boxes.

A checkmark will appear in the box.

To change the answer, tap again on any box you have selected.

The checkmark will erase.

Tap on a sentence:

Note that you can select more than one sentence.

Tap on any part of a sentence.

The entire sentence will highlight.

To change the answer, tap again on any sentence you have selected.

The highlighting will erase.

Tap on a table

Tap on a cell.

The circle will be filled.

To change the answer, tap on a different cell.

Tap on other information

Follow the directions on the exercise screen.

Tap on the information – for example part of a graph, chart, table or form – and that part will highlight.

To change the answer, tap again on any information you have selected.

The highlight will erase.

Highlight one or more words or sentences:

Note that you can highlight more than one selection on the screen.

Move the pen across the text you want to highlight.

To change the answer, tap on any highlighted word or sentence with the pen.

The highlighting will erase.

Use the keypad

To answer

Tap on the answer box and the keypad will display.

Tap on one or more numbers on the keypad.

Note that you can also tap on the symbols to enter a decimal point, fraction slash, or negative sign.

Tap on OK when you are finished and the numbers will display in the answer box.

To change the answer

Tap on the answer box again.

Erase part or all of your answer using the backspace key.

Enter a new answer.

Tap on OK.

Drag and drop:

Touch and hold a choice.

Drag the choice to a new location and drop it in an empty box.

To change the answer, drag the choice back near its starting location and it will drop back into place.

⇑ Top of Page

CLOSE

Scrolling

Line 1.

Line 2.

Line 3.

Line 4.

Line 5.

Up arrow

Scroll box

Down arrow

In some units, you will need to scroll to see all of the information on the screen.

You can scroll by tapping on the Up and Down arrows or by dragging the scroll box.

⇑ Top of Page

CLOSE

Using the Online Calculator

This tool works like an ordinary calculator.

Tap on the number keys and symbols.

Tap on the equals sign to see the answer.

You can drag the calculator around the screen if it is covering information you need.

Tap on the “x” in the top right corner to close the calculator.

⇑ Top of Page

CLOSE

Using Tabs

Some units will include more than one text.

You can switch between the texts by tapping on the tabs at the top of the screen

1

2

⇑ Top of Page

CLOSE

Websites with Multiple Pages

Some units will have websites that include multiple pages.

You can switch between the pages by tapping on each page name.

Home

Photos

⇑ Top of Page

CLOSE

Locator Intro

You have completed the practice and introduction.

Now you will begin the exercises.

Use the information provided to answer each question.

Be sure to check your answers before you go on.

Remember that you may find some questions easy and some more difficult.

It is all right if you can’t do all of the questions, but it is important that you try each one.

Tap on the NEXT arrow to begin.

Locator end

Thank you.

You have completed this set of exercises.

Tap on the NEXT arrow to continue.

Navigation

Navigation

Confirmation

You are leaving this unit and will NOT be able to return to this work.

Are you ready to go on to the next unit?

YES

NO

Calculator

OK

Accept

Clear

Backspace

Space

Orientation Module Literacy

Global Competence Stimulus_tab

Using Tabs

Some units will include more than one text.

You can switch between the texts by tapping on the tabs at the top of the screen.

Tab 1

Tab 2

Websites: Multiple Pages

Some units will have websites that include multiple pages.

You can switch between the pages by tapping on each page name.

Home

Photos

Line 1.

Line 2.

Line 3.

Line 4.

Line 5.

Line 6.

Line 7.

Line 8.

Line 9.

Introduction

The next set of exercises will include everyday reading materials.

You will be able to view these materials in several ways.

Tap on the NEXT arrow to learn more.

Look at the information about using tabs.

Tap on the tabs to view each text.

Tap on the NEXT arrow when you have finished.

Look at the information about using websites with multiple pages.

Tap on the page names to see the different web pages.

Tap on the NEXT arrow when you have finished.

In some units, you will be asked to highlight information in a text to answer a question.

You can highlight one or more words or sentences.

Remember that, for these questions, you will not be able to use your finger to answer.

The image shown above will appear on the question screen as a reminder to use the stylus to highlight your answer.

In some units, you will need to scroll to see all of the information on the screen.

You can scroll by tapping on the “Up” and “Down” arrows or by dragging the scroll box.

Line 1.

Line 2.

Line 3.

Line 4.

Line 5.

Down arrow

Scroll box

Up arrow

Scroll

Follow the steps below to practice scrolling.

Scroll down until you can see “Line 9”.

Then scroll back up again so that “Line 1” is visible.

Tap on the NEXT arrow when you have finished.

Line 1.

Line 2.

Line 3.

Line 4.

Line 5.

Line 6.

Line 7.

Line 8.

Line 9.

Each unit in the next set of exercises will include one or more questions.

Once you leave a unit, you will NOT be able to go back to the questions in that unit.

The message below will display after you tap on the NEXT arrow.

You are leaving this unit and will NOT be able to return to this work.

Are you ready to go on to the next unit?

YES

NO

If you want to go back and continue working on the unit, tap on NO.

Once you tap on YES, you will not be able to return to the unit.

You have completed the introduction and practice.

As you work on the following exercises, read each question carefully and then answer it.

Remember that you will NOT be able to go back to a unit once you have chosen to go on.

Tap on the NEXT arrow to begin.

Orientation Module Numeracy

To answer:

Tap on the answer box and the keypad will display.

Tap on one or more numbers on the keypad.

Note that you can also tap on the symbols to enter a decimal point, fraction slash, or negative sign.

Tap on OK when you are finished and the numbers will display in the answer box.

To change the answer:

Tap on the answer box again.

Erase part or all of your answer using the backspace key.

Enter a new answer.

Tap on OK.

Introduction

You will be asked to use the keypad to answer many questions in the next set of exercises.

The instructions that were shown previously are repeated on the next screen for review.

Tap on the NEXT arrow to review the keypad instructions.

Use the keypad to answer

If you would like to practice using the keypad, tap on the answer box.

Tap on the NEXT arrow when you have finished.

Each unit in the next set of exercises will include one or more questions.

Once you leave a unit, you will NOT be able to go back to the questions in that unit.

The message below will display after you tap on the NEXT arrow.

You are leaving this unit and will NOT be able to return to this work.

Are you ready to go on to the next unit?

YES

NO

If you want to go back and continue working on the unit, tap on NO.

Once you tap on YES, you will not be able to return to the unit.

You have completed the introduction and practice.

As you work on the following exercises, read each question carefully and then answer it.

Remember that you will NOT be able to go back to a unit once you have chosen to go on.

Tap on the NEXT arrow to begin.

Orientation Module Adaptive Problem Solving

Using Tabs

Some units will include more than one source of information.

You can switch between the sources by tapping on the tabs at the top of the screen.

Tab 1

Tab 2

Websites:

Multiple Pages

Some units will have websites that include multiple pages.

You can switch between the pages by tapping on each page name.

Home

Calendar

[Numbers of the calendar]

Introduction

The next set of exercises will include different sources of information including calendars and schedules.

You will be able to view this information in several ways.

Tap on the NEXT arrow to continue.

Look at the information about using tabs.

Tap on the tabs to view each source of information.

Tap on the NEXT arrow when you have finished.

Look at the information about using websites with multiple pages.

Tap on the page names to see the different web pages.

Tap on the NEXT arrow when you have finished.

Each unit in the next set of exercises will include more than one question.

Once you go on to a new question, you will not be able to go back to any of the previous questions in the unit.

There will be no BACK arrow available.

When you tap on the NEXT arrow, it will change color and a message will display as shown below:

Tap again to confirm.

Once you tap on the NEXT arrow a second time to confirm, you will NOT be able to return to the question.

You have completed the introduction and practice.

As you work on the following exercises, read each question carefully and then answer it.

Remember that you will NOT be able to go back to a question once you have chosen to go on.

Tap on the NEXT arrow to begin.

Performance – Effort

Thank you.

You have completed this set of exercises.

Tap on the NEXT arrow to continue.

Before concluding the study, you will be asked two final questions.

Tap on the NEXT arrow to answer the questions.

You have just seen about XX questions.

How many questions do you think you answered correctly?

Tap on a choice to answer.

Just a few

20% or less

21% – 40%

Around half

41% – 60%

61% – 80%

Almost all

81% – 100%

Please provide a response before continuing.

Try to imagine an actual situation (at work or in some other context) that is highly important to you personally, where you would try your very best to put in as much effort as you could in order to do well.

In this situation, you would mark your effort as a 10, as shown here.

1-10

Compared to the situation you have just imagined, how much effort did you put into these exercises?

Tap on a number to answer.

1-10

Thank you.

You have completed all the exercises.

Please hand the tablet back to the interviewer.

Please provide a response before continuing.

OK

Cancel

2