2018–19 CAASPP Online Test Administration Manual

Transcript

1 CALIFORNIA Assessment of Student Performance and Progress CAASPP Online Test Administration Manual 2018–19 Administration Smarter Balanced for English Language Arts/ Literacy and Mathematics Summative Assessments California Alternate Assessments for English Language Arts/Literacy, Mathematics, and Science California Science Test California Spanish Assessment Posted January 8, 2019 Prepared by Educational Testing Service ®

2 CAASPP System California Assessment of Student Performance and Progress Online Test Administration Manual Table of Contents California Support for the CAASPP Assessments 1 3 Chapter 1. CAASPP Testing Overview What’s New in the CAASPP System in 2018 –19 4 4 CAASPP System of Assessments 5 Practice and Training Tests Test Operations Management System (TOMS) Processes 5 5 Accessibility Resources Security and Test Administration Incident Reporting System (STAIRS)/Appeals Process 6 Technical Specifications 6 7 About the Assessments Assessment Participation 7 8 Smarter Balanced Summative Assessments 9 California Alternate Assessments 12 California Science Test 13 California Spanish Assessment 15 Test Administration Roles and Responsibilities Local Educational Agency (LEA) CAASPP Coordinator 15 CAASPP Test Site Coordinator 16 18 Test Administrator Test Examiner 18 Test Administrator & Test Examiner 19 Interim Assessments (IA) Administrator Only 19 – District 20 Educator 20 Educator – Test Site – Roster 20 Educator 21 About This Manual Test Administration Resources 23 Chapter 2. Summative Assessment Administration Documentation Resources 24 28 Training Resources 28 Training and Videos Practice and Training Tests 29 Technology Resources 31 Test Security Chapter 3. 33 34 Security of the Test Environment Requirements 35 Handling Secure Printed Materials 39 Secure Handling of Printed Materials 39 Identifying Testing Improprieties, Irregularities, and Breaches 42 Impact and Definitions 42 Using the Security and Test Administration Incident Reporting System 44 Required Action Steps 45 –ii–

3 CAASPP System AIRS/Appeals Process The ST 48 50 Appeals 53 Chapter 4. Administration Preparation and Planning Technology Infrastructure 54 54 The Secure Browser 55 Student Data 56 General Test Administration Information 57 General Rules of Online Testing for Test Administrators and Test Examiners Testing Time and Recommended Order of Administration 62 Sensitive Responses 70 71 Early Assessment Program (EAP) 72 Universal Tools, Designated Supports, and Accommodations What’s New in 2018– 72 19 72 Accessibility Guidelines Science Assessments 75 Chapter 5. 76 Administration Information for the California Science Test (CAST) 76 Overview of the Assessment 77 Survey Resources 77 User Responsibilities 78 79 Administration Information for the California Alternate Assessment (CAA) for Science Overview of the Assessment 79 Purpose of the Field Test 80 Test Window 80 Test Examiner Resources 81 81 User Responsibilities 83 Chapter 6. California Spanish Assessment 84 Administration Information for the California Spanish Assessment (CSA) Overview of the Assessment 84 84 Test Window 85 Student Survey Resources 86 87 User Responsibilities Using the Test Administrator Interface with Summative Assessments 89 Chapter 7. General Steps to Take When Administering Summative Assessments 90 Establishing Appropriate Testing Conditions 90 Tasks to Complete Prior to Summative Test Administration 93 Use the Summative Test Administrator Sites 97 97 Overview of the Test Administration Sites Understanding User Roles 99 Usin g the Single Sign- on System 99 Test Administrator Site Layout 104 Creating a Test Session 106 Stopping a Test Session and Logging Of f 121 Testing Over Multiple Sessions or Days 122 Transferring a Test Session 123 Test Expiration 124 –iii–

4 CAASPP System 125 Following Test Administration 125 Destroying Test Materials Reporting Testing Improprieties, Irregularities, and Breaches 125 Scripts for Administering Smarter Balanced Summative Assessments Chapter 8. 127 the California Science Test to Students and 128 Test Directions Overview 128 Tasks Administer an Online T 131 est Session Open the Test Administrator Interface and Approve Students for Testing —All Assessments 132 157 Troubleshoot Issues During Testing 157 Resolving Secure Browser Error Messages Scripts for Administering the California Spanish Assessment to Chapter 9. 159 Students 160 Test Directions Overview Tasks 160 Administer an Online Test Session 162 —All Open the Test Administrator Interface and Approve Students for Testing 163 Assessments Troubleshoot Issues During Testing 184 Resolving Secure Browser Error Messages 184 Overview of the Student Testing Application 187 Chapter 10. Signing In to the Student Testing Site 188 Step 1: Signing Students In 188 191 Step 2: Verifying Student Information Step 3: Selecting a Test 191 193 Step 4: Verifying Test Information 194 Step 5a: Text -to-Speech Check 195 Step 5b: Sound and Video Check Step 6: Viewing Test Instructions and Starting the Test 196 198 Features of the Student Testing Application 198 Test Layout Test Tools 199 209 Text Response Formatting Toolbar 212 Keyboard Navigation for Students 217 Proceeding Through a Test Viewing Stimuli 217 o Test Questions 218 Responding t 219 Pausing Tests 220 Reviewing Questions in a Test Reaching the End of a Segment (Smarter Balanced, CSA) or Block (CAST) 220 Submitting a Test 221 Closing the Student Testing Site on Tablets 223 Chapter 11. Appendices 225 Appendix A: Frequently Used Terms 226 Appendix B: Online Item Types 236 Online Item and Response Types 236 –iv–

5 CAASPP System 241 Technical Skills to Access Embedded Resources 243 Appendix C: Practice and Training Tests Overview of the Practice Tests 243 Overview of the Training Tests 244 245 Test Administrator and Test Examiner Logon for the Practice and Training Tests 247 Appendix D: Secure Browser for Testing 247 Guidelines rror Messages 248 Secure Browser E 248 Force -Quit Commands for Secure Browsers 250 Appendix E: Computer Adaptive Test Pause Rule Scenarios Scenarios: 250 Appendix F: Mult 251 iplication Table 252 Appendix G: 100s Number Table 253 Appendix H: LEA CAASPP Coordinator Checklist 253 Direct Responsibilities 258 Moni tor Administration Activities 258 Oversight Responsibilities Contact Information 260 Checklist Appendix I: CAASPP Test Site Coordinator 261 261 Direct Responsibilities Monitor Administration Activities 266 266 Oversight Responsibilities Contact Information 267 268 Appendix J: Test Administrator Checklist Contact Information 274 Appendix K: Test Examiner Checklists 275 California Alternate Assessments (CAAs) for English Language Arts/Literacy and Mathematics 275 280 California Alternate Assessment (CAA) for Science 284 INDEX Change Log 286 List of Tables 25 Table 1. Manuals Table 2. Requirements of the Test Environment Before Testing 35 Table 3. Requirements of the Test Environment During Testing 36 Table 4. Requirements of the Test Environment During and After Testing 37 Table 5. Requirements of the Test Environment After Testing 38 43 Table 6. Definitions for Test Security Incidents Table 7. Estimated Testing Times for Smarter Balanced Online Assessments 63 Table 8. Assessment S equence—ELA 65 Table 9. Assessment Sequence—Mathematics 67 Table 10. Assessment Sequence—Science 69 Table 11. User Role Participation in the CAST 78 Table 12. User Role Participation in the CAA for Science Field Test 81 Table 13. User Role Participation in the CSA 87 Table 14. Test Administrator Site Features 105 –v–

6 CAASPP System 15. Columns in the Students in Your Operational Test Session 115 Table Table 116 Table 16. Student Testing Statuses 200 Table 17. Global Tools Table 18. Context Menu Tools and Stimulus Tools 201 210 Table 19. Description of Formatting Tools Up Windows 213 Table 20. Keyboard Commands for Sign- In Pages and Pop- 213 Table 21. Keyboard Commands for Test Navigation 226 Table 22. Frequently Used Terms Table 23. Online Item and Scoring Types —General Assessments 236 Table 24. Online Item and Scoring Types 239 —Alternate Assessments 241 Table 25. Context Menu for Selecting with the Right Mouse Button 26. Secure Browser Error Messages 248 Table List of Figures 61 Figure 1. Test timeout warning message 2. Buttons on CAASPP.org 100 Figure web form 101 Logon Figure 3. Figure 4. 102 Enter Code web form 5. Select Institution drop- down list 102 Figure Figure 6. web form 103 Logon Figure 7. web form 104 Password Reset Figure 8. Test Administrator Site layout 104 9. Record of alerts 106 Figure Figure 10. Operational Test Selection window 108 Figure 11. Expanded tests in the Test Selection window 109 Figure 12. Summative Assessment confirmation box 109 111 Figure 13. Students awaiting approval Figure 14. Approvals and Student Test Settings window 111 Figure 15. Part of the student 113 Test Settings page for a selected 114 Figure 16. Monitoring student status in the Test Administrator Interface 117 Figure 17. Student Lookup: Quick Search 118 Figure 18. Student Lookup: Advanced Search Figure 19. Student Print Request window 119 Print Requests window 120 Figure 20. End Segment screen 123 Figure 21. Sample Figure 22. [Test Administrator Interface for All Online Tests] button 133 Figure 23. Test Administrator Interface Logon screen 134 Figure 24. Message from the Test Administrator Interface 134 Operational Test Selection window 135 Figure 25. Operational Test Selection Figure 26. 136 screen Figure 27. Smarter Balanced Summative Assessment confirmation box 137 Figure 28. Session ID on the Test Administrator Interface 137 Figure 29. Student Sign I web form 140 n Is This You? screen 141 Figure 30. Figure 31. Your Tests selection screen 142 Figure 32. Waiting for TA Approval dialog box 143 Figure 33. Approvals and Student Test Settings screen 144 –vi–

7 CAASPP System Approvals and Student Test Settings screen Figure 34. 144 screen Figure 35. 145 Is This Your Test? 145 Is This Your Test? Figure 36. screen Figure 37. screen -to-Speech Sound Check Text 146 147 Sound and Video Playback Check Figure 38. screen screen 148 Instructions and Help Figure 39. Figure 40. Monitoring student progress in the Test Administrator Interface 149 Figure 41. Sample EAP question for the CAASPP Smarter Balanced for ELA 154 On system banner 156 42. Single Sign- Figure 164 Figure 43. [Test Administrator Interface for All Online Tests] button screen 165 Figure 44. Test Administrator Interface Logon Figure 45. Message from the Test Administrator Interface 165 Operational Test Selection Figure 46. window 166 Figure Operational Test Selection screen 167 47. 167 Figure 48. Top of the Test Administrator Interface 170 Student Sign In Figure 49. web form screen 171 Figure 50. Is This You? Your Tests selection screen 172 Figure 51. Waiting for TA Approval Figure 52. 172 dialog box Approvals and Student Test Settings 173 Figure 53. screen Approvals and Student Test Settings screen 173 Figure 54. Figure 55. screen 174 Is This Your Test? Figure 56. Is This Your Test? screen 174 Figure 57. Sound and Video Playback Check screen 175 Figure 58. Instruccio 177 nes y ayuda screen 179 Figure 59. Monitoring student progress in the Test Administrator Interface On system banner 183 Figure 60. Single Sign- Student Sign- In 189 web form Figu re 61. 189 Figure 62. Sample session ID 63. Is This You? page 191 Figure Your Tests Figure 64. Sample page 192 65. message 192 Figure Waiting for TA approval Choose Settings page 193 Figure 66. Text -to-Speech Sound Check page 194 Figure 67. 68. Sound and Video Playback Check Figure page 195 Figure 69. Instructions and Help page 196 Figure 70. Test layout 198 Figure 71. Test page 199 204 Figure 72. Global menu 204 Figu re 73. Context menu for questions Figure 74. Context menu for answer options 204 Figure 75. Context menu for ELA item (sample screen) 205 Figure 76. Test page with masked area 206 Figure 77. Line Reader 207 Figure 78. Line Reader with a radio button 207 Figure 79. Line Reader with a check box 208 Figure 80. Speak tool options for questions 208 Figure 81. Text response question with Formatting toolbar 209 –vii–

8 CAASPP System Figure 82. Select Special Character window 211 Figure 83. Spell Check tool 211 Figure 84. Select Special Character window 212 Figure 85. Grid question 215 Figure 86. Sample reading passage 217 218 Figure 87. Video Playback Features Figure 88. Question marked for review 220 page 89. End Segment 220 Figure Figure 90. Global Menu with [End Test] button 221 Figure 91. End Test page 222 Figure 92. Your Results page 223 –viii–

9 CAASPP System Online Test Administration Manual Table of Acronyms and Initialisms in the Meaning Term Autonomous Single App Mode ASAM ASL American Sign Language CA NGSS California Next Generation Science Standards CAA California Alternate Assessments s CAASPP California Assessment of Student Performance and Progress CALPADS California Longitudinal Pupil Achievement Data System CalTAC California Technical Assistance Center California CAST Science Test CAT computer adaptive test CCC California Community Colleges California Code of Regulations CCR CCSS Common Core State Standards CDE California Department of Education CSA California Spanish Assessment CSU California State University Directions for Administration DFA Early Assessment Program EAP English language arts/literacy ELA English learners ELs individualized education program IEP ISAAP Individual Student Assessment Accessibility Profile LEA local educational agency NPS nonpublic, nonsectarian school ORS Online Reporting System PT performance task SSC Survey of Student Characteristics SSID Statewide Student Identifier STAIRS Security and Test Administration Incident Reporting System TOMS Test Operations Management System TTS Text -to-Speech –ix–

10 This page is left blank intentionally.

11 CAASPP System Assessments CAASPP California Support for the in This Subse Resources ction: • California Assessment of Student Performance and Progress (CAASPP) Portal website— http://www.caaspp.org/ • CAASPP Forms web page—http://www.caaspp.org/administration/forms/ Portal all CAASPP is the home for The CAASPP System assessments. For questions regarding the online testing system or for additional assistance: Local educational agency (LEA) CAASPP coordinators should contact the California • Technical Assistance Center ( 955 -2954, by email at ) by phone at 800- CalTAC at CAASPP Portal , or by using the chat function linked on the [email protected] . http://www.caaspp.org/ CAASPP test site coordinators should contact their LEA CAASPP coordinator. • and other school personnel should contact their Test administrators, test examiners, • CAASPP test site coordinator. is open from 7 a.m. to 5 CalTAC p.m. Pacific time Monday through Friday. During these will respond promptly to calls. hours, staff When contacting CalTAC, provide the representative with as much detail as possible about the issue(s) encountered and the system on which it occurred, including the following: • type of device being used for the test; any error messages that appeared (code and description); • operating • system and browser ( web browser or secure browser) information; • network configuration information; -up, including an email address and phone number; • your contact information for follow • test session ID; and Statewide any relevant and authorized student and school information, including • Student Identifier (SSID), grade level, content area, and performance task (PT) or performance task test). computer adaptive test (CAT) (also known as a non– the CalTAC Contact Log for LEA CAASPP Coordinators , a Microsoft Word You may use for your internal form, that has CAASPP Portal on the w eb page Forms been posted to the tracking use in calls to CalTAC. the questions and issues associated with your 201 8– 19 CAASPP Online Test Administration Manual January 2019  1 by the California Department of Education Customization Copyright © 2019

12 CAASPP Syste m CalTAC may be contacted by LEA CAASPP coordinators for situations and questions that include the following: 1. The testing environment is down or unavailable. 2. User accounts are not avail able, or users are not able to administer tests. 3. Student information is incorrect or missing. 4. You experience difficulty loading student test settings into the Test Operations Management System. 5. You have questions about or need assistance with Security and Test Administration Incident Reporting System or Appeals functionality. —downloading the secure browser, voice 6. You need help preparing for online testing packs, etc. 7. Tests are incorrectly showing as available to students when they log on to begin testing. 8. You want to request password resets for LEA users. 9. Student test s ettings are not presenting as intended. Manual 8– 19 CAASPP Online Test Administration  201 January 2019 2 Customization Copyright © by the California Department of Education 2019

13 Chapter 1. CAASPP Testing Overview

14 CAASPP Testing Overview | What’s New in the CAASPP System in 201 8– 19 in 2018–19 What’s New in the CAASPP System California Assessment of Student 2018–19 This section describes what is new in the also to the manuals for the Test Refer Performance and Progress (CAASPP) administration. Operations Management System (TOMS) for more information on how these changes have been implemented. CAASPP System of Assessments Smarter Balanced Summative Assessments -pencil Smarter Balanced Summative Assessments for English language arts/ Paper • literacy (ELA) and mathematics are no longer offered with the exception of braille and . These can be ordered from the California Technical large -print special versions Assistance Center. Alternate Assessment Because all students are assigned grades in the California Longitudinal Pupil • Achievement Data System and there is no longer a designation of “ungraded programs,” any student who is listed as grade twelve and has not yet taken the assigned to California Alternate Assessment (CAA) for Science in high school will be take the CAA for Science. s for ELA There is no longer a Survey of Student Characteristics at the end of the CAA • and mathematics. Science • The California Science Test ( CAST ) is now an operational assessment. CAA for Science is an online assessment. The field test for the • the will not be CAST field test Grade twelve students who took the • assigned to take operational CAST (or CAA for Science field test if an alternate assessment had been selected for the student). • ent Science Participation Information ], was added Stud to the Student A new button, [ Student Science Participation . Select this button to open the screen in TOMS Profile Information message showing whether or not a student in high school participated in science testing in a prior administration (either the CAST or CAA for Science).  201 8– 19 CAASPP Online Test Administration Manual 4 January 2019 by the California Department of Education Customization Copyright © 2019

15 CAASPP Testing Overview | What’s New in the CAASPP System in 2018– 19 Spanish Assessment The operational California Spanish Assessment (CSA) can be administered to students • in grades three through twelve. are no longer part of the This CAASPP System. -based Tests in Spanish The Standards • assessment was replaced with the CSA. Practice and Training Tests • Practice tests are now available for the CAST. • Practice and training tests are available for the CSA. Test Operations Management System (TOMS) Processes For users assigned roles in both programs, TOMS allows the option to switch between • CAASPP and English Language Proficiency Assessments for California processes. Reports • provides The High School Participation Report for the CAST and CAA for Science trackin g information on students who took a high school science assessment during the CAASPP administration previous (2017– 18). Accessibility Resources of new the for a complete description y Guide for CAASPP Online Testing Accessibilit Refer to and updated resources. General or All • . has been reassigned as an embedded designated support Streamline • device ” is a new for all assessments. non- embedded designated support “Medical The button used to clear unlisted resources in TOMS is now called [ MAKE INACTIVE ]. • Smarter Balanced Burmese is now among the embedded translation glossaries available as a designated • support for the mathematics assessment. CAST on April 1, 2019. The braille version of the CAST will be available • • Hmong is available as a translation glossary. 201 8– 19 CAASPP Online Test Administration Manual January 2019  5 by the California Department of Education Customization Copyright © 2019

16 CAASPP Testing Overview | What’s New in the CAASPP System in 2018– 19 Operational CSA Unlisted resources are available starting with the operational CSA. • The following accessibility resources will be available in Spanish: • − Audio transcript Closed -captioning − Braille − Security and Test Administration Incident Reporting System (STAIRS)/Appeals Process STAIRS incident reports are filed using TOMS. • Appeals are requested using TOMS. • Technical Specifications for Specifications and Configuration Guide for CAASPP Online Testing Technical Refer to the information about the updated secure browser and operating system versions required for –19 administration. testing in the CAASPP 2018  201 8– 19 CAASPP Online Test Administration Manual 6 January 2019 by the California Department of Education Customization Copyright © 2019

17 CAASPP Testing Overview | About the Assessments Assessments About the , there are In 2018–19 assessments administered as a part of summative four types of online CAASPP): California Assessment of Student Performance and Progress ( Summative Online (grades three through eight and Smarter Balanced • Assessments grade eleven) . Each assessment consists of a computer adaptive test (CAT) and a PT). performance task ( ELA) English language arts/literacy ( − Mathematics − (CAAs) California Alternate Assessments • − and grade eleven) ELA (grades three through eight − Mathematics (grades three through eight and grade eleven) Science ( PTs to studen embedded three online, ts field test This online − is delivered as in grades five, eigh t, and twelve, and students in grades ten and eleven whom the .) LEA recommends to take a science assessment California Science Test (CAST) • − Science (grades five, eight , and twelve, and students in grades ten and eleven whom science assessment) the local educational agency [LEA] recommends to take a • California Spanish Assessment (CSA) (grades three specific reading, writing Spanish- , and listening skills − mechanics through eight and high school ) Assessment Participation All students are required to participate in the CAASPP assessments for which they are eligib le with the exception of those for whom a parent/guardian exemption has been submitted to the test site. All students who are logged on and presented with the first test (for both the CAT and the PT portions) , CAA, and question of the Smarter Balanced California Science Test (CAST) are counted for participation. 201 8– 19 CAASPP Online Test Administration Manual January 2019  7 by the California Department of Education Customization Copyright © 2019

18 CAASPP Testing Overview | About the Assessments Smarter Balanced Summative Assessments n This Subsection i Resource : — w eb document Accessibility Guide for CAASPP Online Testing • 19.pdf -guide.2018- http://www.caaspp.org/rsc/pdfs/CAASPP.accessibility web page— • CAASPP Student Accessibility Resources and Test Settings http://www.caaspp.org/administration/accessibility / w eb • California Department of Education ( CDE) Student Accessibility Resources page— https://www.cde.ca.gov/ta/tg/ca/accesssupport.asp • CDE Matrix One: California Assessment of Student Performance and Progress sources web document https://www.cde.ca.gov/ta/tg/ai/ Accessibility Re — documents/caasppmatrixone0918.docx website— Smarter Balanced Assessment Consortium • http://www.smarterbalanced.org / • web Smarter Balanced Usability, Accessibility, and Accommodations Guidelines document Accessibility Resources and Test Student —linked on the CAASPP Settings w eb page at http://www.caaspp.org/administration/accessibility/ Smarter Balanced Summative Assessments for ELA and mathematics are next -generation , a t he Smarter Balanced Assessment Consortium assessments that were developed by multistate, state aligned to the Common Core State . These tests are -led consortium in ELA and mathematics that accurately measure student progress toward (CCSS) Standards college -readiness. - and career Consist ent with the Smarter Balanced testing plan and California’s educational mission, all students, including students with disabilities, English learners (ELs), and ELs with disabilities, should have equal opportunity to participate in assessments administered in California. Participation Requirements: All students enrolled in grades three through eight and grade eleven are required to participate in the Smarter Balanced mathematics assessment except for the following: Students with the most significant cognitive disabilities who meet the criteria for the CAA • for Mathematics based on alternate achievement standards (approximately one percent will take the CAA for Mathematics. These students or fewer of the student population) must also take the CAA for ELA. All students enrolled in grades three through eight and eleven are required to participate in : for the following the Smarter Balanced ELA assessment except • Students with the most significant cognitive disabilities who meet the criteria for the CAA for ELA alternate assessment based on alternate achievement standards  201 8– 19 CAASPP Online Test Administration Manual 8 January 2019 by the California Department of Education Customization Copyright © 2019

19 CAASPP Testing Ove rview | About the Assessments (approximately one percent or fewer of the student population) will take the CAA for ELA. These students must also take the CAA for Mathematics. • ELs who are within their first 12 months of enrollment in a U.S. school after April 15 of time exemption from the the previous school year have a one- Smarter Balanced for assessment (but may opt to take the ELA assessment) and are required to take ELA . These students the Smarter Balanced for Mathematics will also participate in the . English Language Proficiency Assessments for California testing Resources Accessibility Smarter Balanced has crafted a comprehensive accessibility and accommodations framework, , Smarter Balanced Usability, Accessibility, and Accommodations Guidelines the for all students, including those with special assessment needs. The Consortium has also tools that are embedded in the test delivery developed a variety of innovative universal engine as well as a variety of designated supports and accommodations. To assist CAASPP Accessibility Guide for CAASPP , the resources users in implementing these accessibility is available as well. Online Testing w eb document lists Matrix One: CAASPP In addition, the CDE the universal tools, designated supports, and accommodations that are allowed as part of all CAASPP general and alternate assessments. Student Finally, the CDE Accessibility Resources w eb page lists all the universal tools, designated supports, and accommodat ions for the CAASPP assessments. California Alternate Assessments in This Subsection: Resources for ELA and Mathematics Version Assignments web page— CAASPP CAAs • http://www.caaspp.org/administration/about/caa/caa- assignments.2018- 19.html • ence Version Assignments web page— CAASPP CAA for Sci http://www.caaspp.org/administration/about/caa/caa-science-assign ments.2018- 19.html • web page— CAASPP California Alternate Assessments http://www.caaspp.org/administration/about/caa/ web Individualized Education Program ( IEP ) Teams CDE CAA Guidance for • https://www.cde.ca.gov/ta/tg/ca/caaiepteamrev.asp page— CDE California Alternate Assessments web page— • https://www.cde.ca.gov/ta/tg/ca/altassessment.asp w eb page— Student Accessibility Resources CDE • https://www.cde.ca.gov/ ta/tg/ca/accesssupport.asp 201 8– 19 CAASPP Online Test Administration Manual January 2019  9 by the California Department of Education Customization Copyright © 2019

20 CAASPP Testing Overview | About the Assessments CAAs are for students with the most significant cognitive disabilities whose The summative IEP team has designated the use of an alternate assessment on statewide summative field test assessments. and mathematics and for ELA tests, These online , are the science administered to eligible students whose disability prevents them from taking the Smarter Balanced Summative Assessments for ELA and mathematics and the CAST . Students who are identified for an alternate assessment will take all the alternate assessments to which they have been assigned. Students in grades three through eight and grade eleven will take the CAAs for ELA and • mathematics. whose IEP designates twelve , eight , and either ten, eleven, or Students in grades five • they take a science assessment will take the CAA for Science if they did not take Science All grade twelve students are required to take the • CAA for the CAA for Science during the previous administration. s in grades ten and eleven whom the LEA recommends to take a science Student • and meet this requirement also may be assigned to take the CAA for assessment Science. are delivered one on one by a test examiner and science s for ELA The CAA , mathematics, and use the same test delivery system as the other CAASPP online assessments. Additionally, t he CAA for Science is delivered one on one as embedded PTs, three per grade level assessed. There are five versions of the CAA s for ELA and mathematics and two versions of each CAA for Science embedded PT s that are assigned at the school level . Version assignments are CAA for Science posted on the CAA s for ELA and Mathematics Version Assignments and on the CAASPP Portal. we b pages Directions , version-specific Version Assignments Secure . for Administration ( DFA ) are available for download from TOMS PTs by a test is administered one field test The CAA for Science on one as embedded examiner during the course of instruction and shortly after instruction of related science DFA in PT is available for download embedded for each . The separate content is complete after January 8, 2019; the online assessment is available on that date as well TOMS . Use the web page to CAAs linked on the CAASPP CAA for Science Administration Planning Guides plan and schedule testing. Participation and Eligibility Requirements The CAAs for ELA level are online, summative, grade- , and science , mathematics assessments for students with the most significant cognitive disabilities whose IEP designates the use of an alternate assessment. These students are receiving grade- level instruction in grades three through eight and eleven in ELA and mathematics. In addition, and once in high school will participate in the CAA for Science. students in grades five, eight, resources s, teachers may provide any For the CAA required by a student’s IEP or 504 plan or Section those that are needed and used by the student during regular classroom instruction.  2018– 19 CAASPP Online Test Administration Manual 10 January 2019 by the California Department of Education Customization Copyright © 2019

21 CAASPP Testing Overview | About the Assessments w eb CAA Guidance for IEP Teams The following are the eligibility guidelines on the CDE determining whether a student should take the CAAs: page that IEP teams should follow in school The student has a significant cognitive disability. • A review of the student’s record IEP or cumulative record) indicates a disability or multiple disabilities that s (e.g., significantly impact int ellectual functioning and adaptive behavior essential for someone to live independently and to function safely in daily life. Having a significant cognitive disability is not determined by an IQ test score; rather, a holistic understanding of a student is required. • The student is learning content derived from the CCSS and California Next Goals and instruction listed in the IEP for Generation Science Standards (CA NGSS) . the student are linked to the enrolled grade- level CCSS through Core Content Connectors (Connectors) and address knowledge and skills that are appropriate and challenging for this student. The student is learning content, linked with (derived from) and CA NGSS the CCSS , that appropriately breaks the standards into smaller steps. A a representation of the essential “core” content of a standard in the CCSS s Connector i . and CA NGSS direct individualized instruction and substantial The student requires extensive, • and age -appropriate level supports to achieve measurable gains in the grade- The student requires extensive, repeated, individualized instruction and curricul um. , and uses substantially adapted support that is not of a temporary or transient nature materials and individualized methods of accessing information in alternative ways to acquire, maintain, generalize, demonstrate, and transfer skills across multiple settings. Accessibility Resources Students provide responses to the assessments by using the mouse or keyboard if they are able. Students are encouraged to complete items as independently as possible. However, in some cases, the test examiner selects the responses indicated by the student. Modes of communication may include gesture, eye gaze, assistive communication device, or other means. The test examiner should use the training tes ts to determine the student’s mode of Student The CDE communication. Accessibility Resources w eb page describes the accessibility resources available for the CAAs. 201 8– 19 CAASPP Online Test Administration Manual January 2019  11 by the California Department of Education Customization Copyright © 2019

22 CAASPP Testing Overview | About the Assessments California Science Test n This Subsection: i Resources — w eb document Accessibility Guide for CAASPP Online Testing • 19.pdf http://www.caaspp .org/rsc/pdfs/CAASPP.accessibility- guide.2018- CAASPP California Science Test http://www.caaspp.org/ web page— • administration/about/science/ d Test Settings web page— • CAASPP Student Accessibility Resources an / http://www.caaspp.org/administration/accessibility CDE California Science Test • https://www.cde.ca.gov/ta/tg/ca/ web page— caasppscience.asp • CDE Matrix One: California Assessment of Student Performance and Progress https://www.cde.ca.gov/ta/tg/ai/ — web document Accessibility Resources documents/caasppmatrixone0918.docx https://www.cde.ca.gov/ w eb page— Student Accessibility Resources CDE • ta/tg/ca/accesssupport.asp CA NGSS The CAST is an online test based on the . All LEAs with eligible students in grades Additionally, the CAST. five , eight , and twelve will administer students in grades ten and eleven whom the LEA recommends to take a science assessment may also take the CAST; they will not be required to retake the CAST in grade eleven or twelve. • students in grades ten eight , twelve, and All LEAs with eligible students in grades five, and eleven whom the LEA science assessment will administer recommends to take a the CAST. Scores for students in grades ten and eleven who take the CAST will be saved and • reported for accountability purposes when those students are in grade twelve. while their testing grade is grade ten or eleven will not be Students who take the CAST • required to retake the CAST in grade eleven or . twelve • All grade twelve students are required to take the CAST if they did not take the CAST during the previous administration. Reso urces Accessibility Smarter Balanced Usability, The CAST uses the Smarter Balanced framework, the Accessibility, and Accommodations Guidelines that is used for other CAASPP assessments. , a variety of innovative tools that are embedded in the test universal The framework includes delivery engine as well as a variety of designated supports and accommodations. To assist Accessibility Guide for , the resources CAASPP users in implementing these accessibility CAASPP Online Testing is available as well.  2018– 19 CAASPP Online Test Administration Manual 12 January 2019 by the California Department of Education Customization Copyright © 2019

23 CAASPP Testing Overview | About the Assessments w eb document lists the universal tools, desi gnated In addition, the CDE Matrix One: CAASPP supports, and accommodations that are allowed as part of all CAASPP general and alternate assessments. Finally, the CDE w eb page lists all the universal tools, Accessibility Resources Student designated supports, and accommodations for the CAASPP assessments. California Spanish Assessment in This Subsection: Resources — w eb document Accessibility Guide for CAASPP Online Testing • http://www.caaspp.org/rsc/pdfs/CAASPP.accessibility -guide.2018- 19.pdf http://www.caaspp.org/ • CAASPP California Spanish Assessment web page— administration/about/csa/ • web page— CAASPP Student Accessibility Resources and Test Settings / http://www.caaspp.org/administration/accessibility • https://www.cde.ca.gov/ — w eb page California Spanish Assessment CDE ta/tg/ca/csa.asp • CDE Matrix One: California Assessment of Student Performance and Progress Accessibility Resources web document — https://www.cde.ca.gov/ta/tg/ai/ documents/caasppmatrixone0918.docx CDE • https://www.cde.ca.gov/ w eb page— Resources Student Accessibility ta/tg/ca/accesssupport.asp level assessment for students , summative , grade- The CSA is an online, linear (nonadaptive) their in grades three through eight and high school who are seeking a measure that evaluates the CAASPP Spanish reading, writing mechanics, and listening skills. The CSA is a part of the Standards -b ased Tests in Spanish. system and replaced The CSA is aligned to the CCSS en Español, which were developed as a joint effort between the San Diego County Office of Education, the Council of Chief State School Officers, and the are a translated and linguistically augmented version of the CDE. The CCSS en Español English -language CCSS for English Language Arts & Literacy. Accessibility Resources Smarter Balanced framework, the The CSA uses the Smarter Balanced Usability, ed for other CAASPP assessments. that is us , Accessibility, and Accommodations Guidelines a variety of innovative tools that are embedded in the test universal The framework includes delivery engine as well as a variety of designated supports and accommodations. To assist , the resources sibility CAASPP users in implementing these acces Accessibility Guide for CAASPP Online Testing is available as well. 201 8– 19 CAASPP Online Test Administration Manual January 2019  13 by the California Department of Education Customization Copyright © 2019

24 CAASPP Testing Overview | About the Assessments In addition, the CDE w eb document lists Matrix One: CAASPP the universal tools, designated supports, and accommodations that are allowed as part of all CAASPP general and alternate assessments. Student Accessibility Resources w eb page lists all the universal tools, Finally, the CDE designated supports, and accommodations for the assessments. CAASPP January 2019 Manual 19 CAASPP Online Test Administration 2018–  14 Copyright © by the California Department of Education Customization 2019

25 CAASPP Testing Overview | Test Administration Roles and Responsibilities Test Administration Roles and Responsibilities in This Subsection: Resources • Manuals California Assessment of Student Performance and Progress (CAASPP) http://www.c web page— and Instructions aaspp.org/administration/instructions/ ) CAASPP Security and Test Administration Incident Reporting System ( STAIRS • http://www.caaspp.org/stairs/ web page— Process for Summative Assessments This section provides descriptions of sample users’ roles and responsibilities for the CAASPP. Local Educational Agency (LEA) CAASPP Coordinator LEA CAASPP coordinators were designated by the district superintendent at the beginning of the 201 the LEA identifying Superintendent Designation Form school year. A signed 8–19 from the LEA CAASPP Test Security Agreement CAASPP coordinator and a signed CAASPP coordinator must be on file with the California Technical Assistance Center for a checklist of test administration activities . (CalTAC). Refer to appendix H LEA CAASPP c oordinators are responsible for adding CAASPP test site coordinators, test administrators, and test examiners into the • Test Operations Management System (TOMS); setting up test administration windows in TOMS and assigning schools within the LEA to • those windows; • assigning students to tests either in TOMS or using batch upload; verifying and assigning designated supports and accommodations to students either in • TOMS, using the Individual Student Assessment Accessibility Profile (ISAAP) Tool, or using batch upload; ources for students in TOMS; requesting unlisted res • ensuring that the CAASPP test site coordinators, test administrators, and test • examiners in their LEA are appropriately trained regarding CAASPP assessment administration as well as security policies and procedures; Manuals printing out checklists from this manual (and also posted independently on the • and Instructions w eb page on the CAASPP Portal for CAASPP test site coordinators, test administrators, and test examiners to review in preparation for the summative assessments; 201 8– 19 CAASPP Online Test Administration Manual January 2019  15 by the California Department of Education Customization Copyright © 2019

26 CAASPP Testing Overview | Test Administration Roles and Responsibilities reporting all test security irregularities and breaches that occur before, during, or after • within 24 hours of test administration to the California Department of Education discovery using the online on the described process, which is /Appeals STAIRS Process for Summative Assessments CAASPP STAIRS/Appeals w eb page on the , Title California Code of Regulations [5 C and linked in TOMS CR], ( CAASPP Portal 5 Section 859[e]); • assuming general oversight responsibilities for all administration activities in their LEA schools; • accessing and reviewing test completion rates for the LEA in the Completion Status system; creating student rosters in the Roster Management system; • assigning student condition codes in TOMS, as appropriate; • • accessing and reviewing preliminary student reports (including assessment target reports) and aggregate statistics for the LEA in the Online Reporting System (ORS); • accessing and reviewing preliminary and final student reports and aggregate data for the LEA in TOMS; and distributing printed Student Score Reports to students and test sites. • CAASPP Test Site Coordinator s: Note • site coordinator can be a principal, vice principal, technology A CAASPP test coordinator, counselor, or other staff member. If possible, a CAASPP test site coordinator should be a person with noninstructional or limited instructional duties so that he or she can coordinate and monitor testing activity in the school. • There can be more than one CAASPP test site coordinator as required by school need. CAASPP test site coordinators are designated by the LEA CAASPP coordinator. CAASPP Refer to by the LEA CAASPP coordinator. test site coordinators are added to TOMS for a checklist of test administration activities . appendix I CAASPP test site c oordinators are responsible for , Test • as Test Examiner identifying test administrators and other test site staff (such , IA Administrator Only, Educator – Test Site, and Administrator & Test Examiner – Roster) as appropriate, ensuring that they are properly trained, and ensuring Educator CAASPP Test Security Affidavits that they have submitted signed as appropriate Section 859[c]); CCR (5  2018– 19 CAASPP Online Test Administration Manual 16 January 2019 by the California Department of Education Customization Copyright © 2019

27 CAASPP Testing Overview | Test Administration Roles and Responsibilities , IA , Test Administrators & Test Examiners , Test Examiners Test Administrators adding • Administrator Only, Educator – Test Site, and Educator – Roster as appropriate into TOMS; administrators and test examiners at their sites maintaining registration accounts for test • for use of the CAASPP System, including the summative and interim assessments and formative assessment tools; and Test Administrators & Test Examiners Test Administrators coordinating with • so they administer all assessments; • verifying and assigning designated supports and accommodations to students either in TOMS, using the ISAAP Tool, or using batch upload; • requesting unlisted resources for students in TOMS; • creating or approving testing schedules and procedures for the school (consistent with state and LEA policies); working with technology staff to ensure that necessary secure browsers are installed • and any other technical issues are resolved; monitoring testing progress during the testing window using the Completion Status • application and ensuring that all students participate, as appropriate; • using the school’s procedure for correcting student data errors reported by test administrators and test examiners in the California Longitudinal Pupil Achievement Data , verifying the corrections in TOMS, and ensuring that the student’s test session System is rescheduled; addressing testing problems, as needed; • • mitigating and reporting all test security incidents in a manner consistent with Smarter Balanced, state, a nd LEA policies; assuming general oversight responsibilities for all administration activities in their school • , and for all Test Administrators , Test Examiners , Test Administrators & Test Examiners and other school staff; creating student rosters in the Roster Management system; • • accessing and reviewing completion status reports for the test site in the Completion Status system; and • accessing and reviewing preliminary student reports and aggregate statistics for the test site in the ORS. 201 8– 19 CAASPP Online Test Administration Manual January 2019  17 by the California Department of Education Customization Copyright © 2019

28 CAASPP Testing Overview | Test Administration Roles and Responsibilities Test Administrator e), a test administrator is an employee or contractor of an , Section 850(a CCR Pursuant to 5 CAASPP Test Security LEA or a nonpublic, nonsectarian school (NPS) who has signed a and has received training to administer the CAASPP achievement tests. Affidavit Test administrators administer the Smarter Balanced assessments and the California Science Test ( CAST ). CAASPP test site coordinators should identify school personnel to act Refer to as test administrators. appendix J for a checklist of test administration activities . Test administrators are responsible for reading and signing the , which is returned to the • CAASPP Test Security Affidavit CAASPP test site coordinator; complet refer to the ing CAASPP administration training ( Training Resources • , and CAASPP policy and subsection) and reviewing all Smarter Balanced, CAST administration documents prior to administering any CAASPP assessments; viewing student information in the Test Administrator Interface prior to testing to ensure • . Test resources that the correct student receives the proper test with the appropriate dinators administrators should report any potential data errors to CAASPP test site coor and LEA CAASPP coordinators as appropriate; , and California Spanish administering the Smarter Balanced assessments , CAST • Assessment (CSA) ; • assuring the test environment meets the specific requirements ; reporting all potential test security incidents to their CAASPP test site coordinator and • LEA CAASPP coordinator in a manner consistent with Smarter Balanced, state, and LEA policies; viewing completion status reports in the Completion Status system; and • reviewing preliminary results for students in an associated student roster in the ORS. • (Note that unless the test administrator has been assigned to a student roster, he or she any student results in the ORS.) cannot review Test Examiner by licensed and credentialed individuals. Pursuant to Assessments must be administered Section 850(ag), CCR “Test examiner” is an employee or contractor of an LEA or an NPS 5 who has signed a and has received training to administer the CAASPP Test Security Affidavit Additionally, a test examiner may administer interim assessments. A test examiner CAAs. must be a certificated or licensed LEA staff member. Tes t examiners are responsible for reading and signing the , which is returned to the CAASPP Test Security Affidavit • CAASPP test site coordinator;  2018– 19 CAASPP Online Test Administration Manual 18 January 2019 by the California Department of Education Customization Copyright © 2019

29 CAASPP Testing Overview | Test Administration Roles and Responsibilities subsection) and Training Resources the refer to completing CAA administration training ( • reviewing all CAASPP policy and administration documents prior to administering any CAAs; nt information in the Test Administrator Interface prior to testing to ensure viewing stude • . Test resources that the correct student receives the proper test with the appropriate examiners should report any potential data errors to CAASPP test site coordinators and LEA CAASPP coordinators as appropriate; for the appropriate test or embedded PT Di rections for Administration the downloading • Secure Materials [ from the TOMS tab; ] administering the CAAs; • • reporting all potential test security incidents to their CAASPP test site coordinator and LEA CAASPP coordinator in a manner consistent with CAASPP and LEA policies; and • viewing completion status reports in the Completion Status system . Test Administrator & Test Examiner The test administrator & test examiner must meet the requirements of both the test administrator and the test examiner and has signed a CAASPP Test Security Affidavit . credentialed or licensed employee who The test administrator & test examiner is a admini sters both standard and alternate summative assessments and interim assessments to Test refer to the students. For more information about the role of the test administrator, user role definition. For more information about the role of the test examiner, Administrator the and appendix K refer to . R efer also to appendix J user role definition for Test Examiner . checklists of test administration activities Interim Assessments (IA) Administrator Only It is a local The IA Administrator Only administers only the interim assessments to students. decision whether to require the IA Administrator Only to sign a CAASPP Test Security Affidavit. 201 8– 19 CAASPP Online Test Administration Manual January 2019  19 by the California Department of Education Customization Copyright © 2019

30 CAASPP Testi ng Overview | Test Administration Roles and Responsibilities Educator – District Note s: • An Educator – District’s questions about passwords, the ORS, and technology issues should be relayed to his or her CAASPP test site coordinator or LEA CAASPP coordinator. It is a local decision whether to require the Educator • – District to sign a CAASPP Test Security Affidavit. The Educator – District is a llow ed access to assessment results in the ORS for the entire LEA. This role is assigned by the LEA CAASPP coordinator. Educator – Test Site Note s: • – Test Site’s questions about passwords, the ORS, and technology An Educator issu es should be relayed to his or her CAASPP test site coordinator or LEA CAASPP coordinator. – Test Site to sign a • It is a local decision whether to require the Educator CAASPP Test Security Affidavit. results in the ORS for the entire The Educator – Test Site is a llow ed access to assessment school. Educator – Roster Note s: • An Educator – Roster’s questions about passwords, the ORS, and technology issues should be relayed to his or her CAASPP test site coordinator or LEA CAASPP coo rdinator. CAASPP • – Roster to sign a It is a local decision whether to require the Educator Test Security Affidavit. llow ed access to assessment results for students in an associated – Roster is a The Educator roster in the ORS. Rosters of students are created and assigned to the user by the LEA CAASPP coordinator or test site coordinator. Note that unless this user has been assigned to review a student roster, he or she cannot any student results in the ORS.  2018– 19 CAASPP Online Test Administration Manual 20 January 2019 by the California Department of Education Customization Copyright © 2019

31 CAASPP Testing Overview | About This Manual Manual About This This California Assessment of Student Performance and Progress (CAASPP) Online Test for Smarter Balanced Online Summative Assessments, California Administration Manual Alternate Assessments, the California Science Test, and the California Spanish Assessment is intended for staff who play a role in the administration of assessments, including CAASPP , CAASPP test site coordinators, test local educational agency (LEA) CAASPP coordinators . administrators, and test examiners administer y guidance to This manual provides procedural and polic the CAASPP assessments. The appendi ces of this manual, which contain important information that can be used as stand- alone materials, are easily extracted for printing or distribution. and test examiners For specific questions not addressed in this m anual, test administrators can contact their CAASPP test site coordinator; CAASPP test site coordinators can contact their LEA CAASPP coordinator; and LEA CAASPP coordinators can contact the California Technical Assistance Center. 201 8– 19 CAASPP Online Test Administration Manual January 2019  21 Copyright © by the California Department of Education 2019 Customization

32 CAASPP Tes | ting Overview About This Manual page is left blank intentionally. This Manual January 2019 19 CAASPP Online Test Administration 22  2018– by the California Department of Education Copyright © Customization 2019

33 Chapter 2. Test Administration Resources

34 Test Administration Resources | Summative Assessment Administration Documentation Resources Summative Assessment Administration Documentation Resources Resources in This Section: Accessibility Guide for California Assessment of Student Performance and • CAASPP) Progress ( http://www.caaspp.org/ Online Testing— guide.2018- 19.pdf rsc/pdfs/CAASPP.accessibility- CAASPP Manuals and Instructions • http://www.caaspp.org/ web page— administration/instructions/ — • CAASPP Security and Test Administration Incident Procedure Guide -guide.2018- 19.pdf http://www.caaspp.org/rsc/pdfs/CAASPP.stairs -appeals • CAASPP Security and Test Admin istration Incident Reporting System (STAIRS) http://www.caaspp.org/stairs/ Process for Summative Assessments web page— Pupil CDE) California Longitudinal California Department of Education ( • Achievement Data System (CALPADS) web page— https://www.cde.ca.gov/ds/sp/cl/ California Assessment of Student Performance and Progress • CDE Matrix One: web document Accessibility Resources https://www.cde.ca.gov/ta/tg/ai/ — documents/caasppmatrixone0918.docx https://www.cde.ca.gov/ • CDE Student Accessibility Resources web page— ta/tg/ca/accesssupport.asp • Technical Specifications and Configuration Guide for CAASPP Online Testing — guide.2018- http://www.caaspp.org/rsc/pdfs/CAASPP.tech -specs- and- config- 19.pdf -Administration Guide for CAASPP Testing — web document • TOMS Pre 19.pdf guide.2018- -pre -admin- http://www.caaspp.org/rsc/pdfs/CAASPP.TOMS Prior to administering a test, test administrators and test examiners (and any other individuals Online who will be administering any secure CAASPP assessment) will read the CAASPP Test Administration Manual Manuals and Instructions , the Smarter (linked on the w eb page) Balanced Usability, Accessibility, and Accommodations Guidelines (linked on the CDE Resources and view the associated training modules. , w eb page) Student Accessibility Online Test Administration Manual The is designed to complement a variety of other 1. Table resources developed by Smarter Balanced and the CDE listed in  2018– 19 CAASPP Online Test Administration Manual 24 January 2019 by the California Department of Education Customization Copyright © 2019

35 Test Administration Resources | Summative Assessment Administration Documentation Resources Table 1. Manuals Resource Description The CDE resources CALPADS w eb page contains links to CALPADS CALPADS system documents, updates, and other useful information for maintaining student data. The Test Operations Management System Guide for CAASPP -Administration TOMS Pre -Administration Guide for (TOMS) Pre provides instructions for the processes Testing CAASPP Testing necessary to assign local educational agency (LEA) and school users and test administrations , as well as student data for various aspects of CAASPP ondition testing (test assignments, test settings, c codes). CAASPP Security and Test Administration The CAASPP Security and Test Administration Incident Procedure includes information Incident Procedure Guide Guide about how LEA CAASPP coordinators can submit a and enter process /Appeals using the STAIRS report in TOMS appeal s for summative assessments . for Process /Appeals STAIRS Refer also to the Summative Assessments on the w eb page CAASPP Portal for additional information and links to STAIRS resources. Accessibility Guide for CAASPP essibility Guide for CAASPP Online Acc The Testing Online Testing information and instructions is an aggregation of regarding configuring and using various online accessibility including braille. resources Matrix One Matrix One: California Assessment of The CDE web document is an important source of infor mation for determining the Student Performance and Progress designated supports and Accessibility Resources assignment of accommodations to students. Technical Specifications and Technical Specifications and Configuration The contains CAASPP Online Testing Guide for Configuration Guide for CAASPP Online Testing instructions related to making the network infrastructure ready for CAASPP testing such as system requirements, network and system requirements, and secure browser configuration. 201 8– 19 CAASPP Online Test Administration Manual January 2019  25 by the California Department of Education Customization Copyright © 2019

36 | Test Administration Resources Summative Assessment Administration Documentation Resources Description Resource Test Administrator Directions for The Test Administrator Online Directions for Administration (DFA)—Smarter Administration for the Smarter Balanced and CAST Balanced Summative Assessments assessments is a standalone version of Chapter 7: and the California Science Test Using the Test Administer Interface with Summative (CAST) Assessments and Chapter 8: Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students test administrators at all , which provide grade levels with step- by-step instructions for the Test Administrator Interface and student , as well as the test administration script applications for administering Smarter Balanced and CAST tructions are intended for These ins assessments. administration. Scripts must be read the day of test verbatim, but may be adapted for students assigned the Simplified Test Directions designated support. —California Test Administrator DFA The Test Administrator Online Directions for Spanish Assessment (CSA) for the CSA is a standalone version Administration of Chapter 7: Using the Test Administer Interface with Summative Assessments and Chapt er 9: Scripts for Administering the California Spanish Assessment to Students , which provides test administrators at all grade levels with the test administration script for administering the CSA. These instructions are intended for the day of test . tration adminis Scripts, which are in Spanish, must be read verbatim, but may be adapted for students assigned the Simplified Test Directions designated support. Test Examiner DFAs Directions for the administration of the California (CAAs) for English Alternate Assessments language arts/literacy and mathematics are by selecting the TOMS published securely in [ ] TOMS button in the left Secure Materials for each of the CAA for DFAs . navigation bar performance tasks ( Science embedded PTs ) are also published in this manner.  2018– 19 CAASPP Online Test Administration Manual 26 January 2019 by the California Department of Education Customization Copyright © 2019

37 Test Administration Resources | Summative Assessment Administration Documentation Resources Resource Description The Usability, Accessibility, and Usability, Accessibility, and Accommodations Accommodations Guidelines Guidelines focus on universal tools, designated supports, and accommodations for the Smarter are Guidelines The Balanced assessments. -level personnel and decision- intended for school making teams, particularly individualized education program (IEP) and Section 504 teams, as they prepare for and implement CAASPP assessments. room provide information for class Guidelines The teachers, English language development educators, special education teachers, and instructional assistants to use in selecting and providing universal tools, designated supports, and accommodations for those students who need them ation of the assessments. The during the administr are also intended for assessment staff Guidelines and administrators who oversee the decisions that are made in instruction and assessment. The CAST follow similar guidelines. and CSA ations Usability, Accessibility, and Accommod The for Smarter Balanced testing can be Guidelines found on the CDE Student Accessibility Resources web page. 201 8– 19 CAASPP Online Test Administration Manual January 2019  27 by the California Department of Education Customization Copyright © 2019

38 Test Administration Resources | Training Resources Training Resources Training and Videos Resources in This Subsection: web page— • California Alternate Assessment (CAA) Test Examiner Tutorial videos http://www.brainshark.com/ets/vu?pi=zIPz18xuCozJ0cZz0 California Assessment of Student Performance and Progress (CAASPP) • Webcasts w Archived Videos and Summative Assessment — eb page http://www.caaspp.org/training/caaspp/ CAASPP coordinators, CAASPP test site coordinators, LEA) local educational agency ( All and school administrative staff who will be involved in test examiners, test administrators, CAASPP the applicable supplemental videos and tration should review assessment adminis webcasts archived . The LEA CAASPP coordinator, CAASPP test site coordinator, and other staff designated by the state are responsible for ensuring all appropriate trainings have been be limited to, training on item security and completed. Such training should include, but not professional conduct associated with the administration of standardized assessments. English language arts/literacy (ELA) s— , mathematics, Test examiners for the CAA science, or any combination thereof — must receive training by completing an online provided . Supplemental training may be learning module or the CAA Test Examiner Tutorial s are strongly urged to by the LEA. There are three possible tutorials; test examiner complete the one that is the most relevant: • CAAs for ELA and mathematics; • CAAs for ELA, mathematics, and science; or • CAA for science . Trained test examiners receive a certificate of completion, generated automatically by the online training system. Test examiners must be trained each year before administering CAAs for ELA, mathematics, and science. Caution: CAA test examiners are required to participate in training prior to 5 , Title California Code of Regulations s ( administering the CAA [5 CCR], 850[ag]). Section  2018– 19 CAASPP Online Test Administration Manual 28 January 2019 by the California Department of Education Customization Copyright © 2019

39 Test Administration Resources | Training Resources Practice and Training Tests Resources in This Subsection: w eb document • Accessibility Guide for CAASPP Online Testing — http://www.caaspp.org/rsc/pdfs/CAASPP.accessibility -guide.2018- 19.pdf subsection in this manual C: Accessing the Practice and Training Tests • Appendix web page— Practice and Training Tests Portal Online CAASPP • http://www.caaspp.org/practice- and -training/ CAASPP Test Administrator and Test Examiner Resources for the Online Practice • web page— and Training Tests -resources/practice- http://www.caaspp.org/ta training.html , CAAs ice and training tests are available for the Smarter Balanced assessments Online pract , the CAST for ELA and mathematics . The , and the California Spanish Assessment (CSA) CAA for Science has a training test available. Resources Practice Test CAT ) For the Smarter Balanced assessments, practice tests include computer adaptive test ( performance tasks (PTs) items and eleven). for each grade level (three through eight and The practice tests provide a preview of the item types included in the Smarter Balanced assessments. For the CAAs for ELA and mathematics, practice tests include items for each grade level (three through eight and grade eleven). The practice tests provide experience with grade- onal CAAs. level content similar to what appears in the operati For the CAST, practice tests are available for each tested grade level (grades five and eight Each practice test consists of a series of discrete or stand- and high school). alone items content domains. The braille PTs , one from each of the three science followed by three practice test will be available in January 2019. For the CSA, practice tests include items for each grade level (three through eight and level content similar to high school). The practice tests provide experience with grade- what appears in the operational CSA. Item types are listed and described in Appendix B: Online Item Types in this manual. 201 8– 19 CAASPP Online Test Administration Manual January 2019  29 by the California Department of Education Customization Copyright © 2019

40 Test Administration Resources | Training Resources Training Test Training tests are for test administrators, test examiners, and students to become familiar with the format and functionality of the online test. For the Smarter Balanced assessments, and eleven) this resource is available by grade band (three through five, six through eight, and has approximately six to nine mathematics items and six to seven ELA items per grade band. For the CAAs for ELA and mathematics, there is one training test for all grade levels. For the PT ava ilable for all grade levels. CAA for Science, there is one training Directions for are available on caaspp.org. Administration The CAST offers grade-specific training tests in grades five and eight and high school that can be taken by students in all tested grades. All unique item types available on the operational test are covered in the training tests. For the CSA, there are training test available in three grade bands: grades three through five, grades six through eight, and high school. Access Public The practice and training tests can be used as a “guest” without logon credentials and using a supported not a supported web browser. The web browser; note that Internet Explorer is practice and training tests do not require use of the secure browser, but some accessibility (i.e., are only available through the secure browser. Braille -to-speech, resources, such as text web browser. can be accessed using a , where available, refreshable or embossed) Access Secure or test If users want to access the practice and training test s as a test administrator -to- —required if they want to administer a practice or training test that uses the text examiner can —a logon will be required. Test administrators resource speech and test examiners contact their CAASPP test site coordinator for logon credentials.  2018– 19 CAASPP Online Test Administration Manual 30 January 2019 by the California Department of Education Customization Copyright © 2019

41 Test Administration Resources | Technology Resources Technology Resources Resources in This Section: • California Assessment of Student Performance and Progress (CAASPP) Bandwidth Checker web page— http://www.caaspp.org/about/bandwidth- checker.html • Calif ornia Department of Education (CDE) Smarter Balanced Technology https://www.cde.ca.gov/ta/tg/s Readiness Resources -itr - a/sbac web page— index.asp web Smarter Balanced Student Device and Secure Browser Requirements • - http://www.smarterbalanced.org/assessments/testing -technology/devices page— and- browsers/ • — Smarter Balanced Guide to Technology Readiness w eb document https://portal.smarterbalanced.org/library/en/guide- -readiness.pdf to-technology Technical Specifications and Configuration Guide for CAASPP Online Testing • -specs http://www.caaspp.org/rsc/pdfs/CAASPP.tech — web document -and- config- guide.2018- 19.pdf for Guide Technical Specifications CAASPP and Configuration The w eb Online Testing document provides technology coordinators information about supported technology and technology requirements and can be used to confirm that your school meets the minimum requirements for online testing with the technical specifications for online testing, including the following: • internet and network requirements I nformation about H ardware and software requirements • • S ecure browser installation • S upported operating systems for student testing web browsers • S upported S upported peripheral equipment for testing • w eb page on the The bandwidth checker, linked on the Bandwidth Checker CAASPP Portal , coordinators to assess network readiness by performing a real -time can assist technology check of a sc hool’s network bandwidth. Note that technology coordinators may want to run this test more than once and at different times of the day because estimates change as the network conditions change and can vary from run to run. w eb page, which Smarter Balanced Technology Readiness Resources The CDE also hosts a local educational agencies includes links to tools, requirements, and topics that will find useful in planning for the 2018–19 CAA SPP testing. online 201 8– 19 CAASPP Online Test Administration Manual January 2019  31 by the California Department of Education Customization Copyright © 2019

42 Test Administration Resources | Technology Resources Finally, t Smarter Balanced Guide to Technology Readiness is intended to help school he leaders better understand, plan for, and manage the technology necessary for successful It is intended to help school leaders administration of Smarter Balanced assessments. address key questions about technology readiness for the Smarter Balanced assessment system, including what it means to be “technology -ready” for the Smarter Balanced assessments. January 2019 Manual 19 CAASPP Online Test Administration 2018–  32 Copyright © by the California Department of Education Customization 2019

43 Chapter 3. Test Security

44 Test Security | Security of the Test Environment of the Test Environment Security in This Section: Resources California Assessment of Student Performance and Progress (CAASPP) Security • and Test Administration and Incident Reporting System Process for Summative — eb page Assessments w http://www.caaspp.org/stairs/ CAASPP Manuals and Instructions web page— http://www.caaspp.org/ • administration/instructions/ • web document — Security Incidents and Appeals Procedure Guide 19.pdf -guide.2018- -appeals http://www.caaspp.org/rsc/pdfs/CAASPP.stairs A secure online testing environment is a state in which a device is restricted from accessing -based), or copying or internet prohibited computer applications (local or otherwise sharing test data. The purpose are to maintain test security and provide a stable s of this environment The security of assessment xperience for students across multiple platforms. testing e instruments and the confidentiality of student information are vital to maintaining the validity, reliability, and fairness of the results. All summative test items and test materials are secure and must be appropriately handled. Secure handling protects the integrity, validity, and confidentiality of assessment items, prompts, and student information. Any deviation in test administration must be reported as a test security incident to ensure the validity of the assessment results. any of It is the responsibility of each person participating in the administration of the CAASPP summative assessments to immediately report any violation or suspected violation of test security or confidentiality. The CAASPP test site coordinator is responsible for immediately reporting any security violation to the local educational agency ( LEA ) CAASPP coordinator. dministrator must stop the cheating; however , the test a In the case of a student cheating, the test student may be allowed to complete the remainder of the test. After testing, the Do not call administrator the California must notify the CAASPP test site coordinator . Department of Education or the California Technical Assistance Center to report student must , instead, file a The LEA CAASPP coordinator or CAASPP test site coordinator cheating. Incident Reporting System (STAIRS) Administration report using the Security and Test / process. Appeals  2018– 19 CAASPP Online Test Administration Manual 34 January 2019 by the California Department of Education Customization Copyright © 2019

45 Test Security | Security of the Test Environment Requirements Note Due to the nature of the California Alternate Assessments (CAAs) for : English language arts/literacy (ELA), mathematics, and science, test examiners are permitted exposure to test questions and student responses. Additionally, in some cases, test examiners will enter student responses into the test delivery system as indicated by the student’s individualized education program. Test administrators, test examiners, and CAASPP test site coordinators or other individuals who have witnessed, been informed of, or suspect the possibility of a test security incident that could potentially affect the integrity of the assessments or the data should review the Identifying Testing ections information in the subs Improprieties, Irregularities, and Breaches and Security Incidents and (as necessary) of this manual; and then refer to the Appeals w eb document for additional instructions. Note that only LEA Procedure Guide Appeals CAASPP coordinators and CAASPP test site coordinators may report the incident using the and, if directed, an process STAIRS/Appeals Appeal. Table 5 describe security requirements for the test environment during Table 2 through testing situation various stages of testing. The test environment refers to all aspects of the while students are testing and includes what a student can see, hear, or access (including access via technology). Before Testing 2. Requirements of the Test Environment Before Testing Table Description Requirement Instructional materials Instructional materials removed or must be removed or covered covered, including but not limited to information that might assist students in answering questions that is displayed on bulletin boards, chalkboards or wall charts that dry -erase boards, or on charts (e.g., , maps, mathematics contain literary definitions formulas, etc.). Student seating Students must be seated so there is enough space between them to minimize opportunities to look at —for example, students may be each other’s work assigned staggered seating or be seated in every other chair or workstation position— or they should top partitions. be provided with table- 201 8– 19 CAASPP Online Test Administration Manual January 2019  35 by the California Department of Education Customization Copyright © 2019

46 Test Security | Security of the Test Environment Description Requirement —DO NOT DISTURB” If helpful, place a “TESTING Signage and sign on the door or post signs in halls entrances rerouting hallway traffic in order to promote optimum testing conditions. s or test CAASPP test site coordinator s should post the “Unauthorized administrator Electronic Devices May Not Be Used at Any Time During the Testing Session” signs so that they are clearly visible to all students. A master of this sign can be downloaded from the Manuals and w eb page . on the CAASPP Portal Instructions During Testing During Testing 3. Requirements of the Test Environment Table Requirement Description Provide a quiet environment void of talking or other Quiet environment distractions that might interfere with a student’s might compromise the ability to concentrate or testing situation. Students are actively supervised Student supervision by a trained test administrator or test examiner and are prohibited from access to unauthorized electronic devices that allow availability to outside information, or with other communication among students , or individuals outside the testing environment photographing or copying test content. This includes any device with cellular, messaging, or wireless capabilities, but is not limited to cell , personal digital assistants, smart watches phones, iPods, cameras, and electronic translation tablets, devices. Students must only have access to and use of Access to allowable resources only those allowable resources ( section the sub refer to for Establishing Appropriate Testing Conditions examples) that are permitted for each specific test test). This includes access to (or portion of a medical devices, which may be integrated into other technology devices. Use of such devices may require additional monitoring to maintain test security.  2018– 19 CAASPP Online Test Administration Manual 36 January 2019 by the California Department of Education Customization Copyright © 2019

47 Test Security | Secur ity of the Test Environment Description Requirement Unauthorized staff or other adults must not be in the Access to assessments room during testing. Only students who are testing can view items. Based on the item type (i.e., ks [PTs] ), trained performance tas test s may also have limited exposure to administrator items in the course of properly administering the s assessments; however, even test administrator and other trained staff may not actively review or analyze any test items. rough secure browser Testing th CAASPP assessments is Administration of the permitted only through the student interface via a secure browser or a method of securing the student device. During and After Testing 4. Requirements of the Test Environment Table During and After Testing Requirement Description LEA CAASPP coordinators, CAASPP test site No access to responses coordinators, test administrators, and other staff are not permitted to review student responses to the Smarter Balanced, California Science Test or in the California Spanish Assessment assessments testing interface or students’ notes on scratch paper. No copies of test materials -on- demand or braille Unless needed as a print accommodation, no copies of the test items, stimuli, reading passages, PT materials, or writing prompts may be made or otherwise retained. No digital, electronic, or manual device may be No access to digital, electronic, or used to record or retain test items, reading manual devices ompts. Similarly, these passages, or writing pr materials must not be discussed with or released to text anyone via any media, including fax, email, social media message, websites, etc. printed reading Descriptions of test items, stimuli, No retaining, discussing, or releasing test materials passages, or writing prompts must not be retained, discussed, or released to anyone. 201 8– 19 CAASPP Online Test Administration Manual January 2019  37 by the California Department of Education Customization Copyright © 2019

48 Test Security | Security of the Test Environment Description Requirement LEA CAASPP coordinators, CAASPP test site No reviewing, discussing, or analyzing s, test administrators, and other staff test materials coordinator review, discuss, or analyze test items, may not stimuli, reading passages, or writing prompts at any time, including before, during, or after testing. Student interaction with a test administrator or test during a test is limited to necessary examiner communicati on (such as permission to leave the room) or to respond during any CAA . Students may not discuss or share test items, stimuli, reading passages, or writing prompts with anyone during or after testing. -on- demand Printed materials from the print Keeping all test materials secure at all Directions the CAA accommodation, scratch paper, times and documents with student for Administration, information must be kept in a securely locked room or locked cabinet that can be opened only with a staff responsible for test key or keycard by administration. No retaining of test “tickets” or any All students’ ID information must be collected at the end of each test session, stored securely, and then materials created to assist students . with logging on to the summative destroyed securely assessments After Testing After Testing 5. Requirements of the Test Environment Table Requirement Description No test materials used for instruction Test items, stimuli, reading passages, or writing prompts must not be used for instruction. Destroy test materials securely Printed test items or passages, including embossed braille printouts, scratch paper, notecards or paper that include student logon information, and printed for the CAAs Directions for Administration must be collected and inventoried and then immediately shredded upon a student’s completion of the test. Handling Secure sub section, the next Refer to Printed Materials , for details.  2018– 19 CAASPP Online Test Administration Manual 38 January 2019 by the California Department of Education Customization Copyright © 2019

49 Test Security | Handling Secure Printed Materials ing Secure Printed Materials Handl Secure Handling of Printed Materials Print Using Materials emand -on-D For those students whose individualized education program (IEP) or Section 504 plan permission for the students to passages or items, expresses a need for a paper copy of receive this accommodation must be LEA) by the local educational agency ( requested coordinator California Assessment of Student Performance and Progress ( at least CAASPP) two weeks prior to testing . by contacting the California Technical Assistance Center (CalTAC) for students with this accommodation will require that the LEA Printing individual test items CAASPP coordinator make a request to CalTAC to have the accommodation set for each in addition to assigning this resource for the student in the Test Operations student . (TOMS) Management System Note the following about print on demand: test administrators Print requests must be approved and processed by the • and test during test administration. examiners • The decision to allow students to use print on demand must be made on an individual student basis and is available only for students with an IEP or Section 504 plan. individually, utilizing the print -on-demand functionality does • B ecause items are printed not allow a printed version of the online test to be created prior to testing, especially given the adaptive nature of the Smarter Balanced assessments . • A very small percentage of students should need this accommodation. The use of this accommodation may result in the student needing additional time to • complete the assessment. for Smarter Once a student is approved to receive the printing of test items or passages CAST Test ( California Science Balanced, ), or California Spanish Assessment (CSA) during testing by assessments, that student may send a print request to the test administrator selecting the print icon on the screen. For the California Alternate Assessments ( ), the CAAs test examiner may select this icon. This request needs to be made for each individual item. Follow these guidelines when using the print -on- demand accommodation: 1. Before the or test examiner approves the student’s request to print a test administrator must ensure that the printer test item or test examiner test administrator or stimulus, the is on and is monitored by staff who have been trained using the or test administrator test examiner training modules for the test. -on- demand 2. Immediately after printing a print request, the file should be securely deleted from the in such a way that the file does device ’s or test examiner’s test administrator 201 8– 19 CAASPP Online Test Administration Manual January 2019  39 by the California Department of Education Customization Copyright © 2019

50 Test Security | Handling Secure Printed Materials not remain in a temporary storage file where it can be undeleted. Refer to the Destroying Electronic Files subsection for additional instructions. must collect the previously printed item from the or test examiner 3. The test administrator student after the next item ’s print request. Printed items must be securely stored and then securely destroyed after the test session. oying Destr Secure Materials Printed Directions for Printed materials from the print -on- demand accommodation, CAA Administration (DFA) , and scratch paper must be kept in a securely locked room or locked only with a key or keycard by staff responsible for test cabinet that can be opened . All test materials must CAASPP Test Security Affidavit administration who have signed a remain secure at all times. including embossed braille printouts and scratch paper, passages, or Printed test items must be collected and inventoried at the end of each test session and then immediately procedures. securely destroyed according to LEA and California policies or CAA that were printed for test examiners after being downloaded from the password- DFAs must be kept in a securely locked room or locked cabinet when not in use. protected TOMS Once testing is completed, these must be immediately securely destr according to LEA oyed , California policies and procedures, or policies and procedures from policies and procedures . both sources Files Destr lectronic oying E for the Immediately after printing a print , making a printed copy of a DFA -on- demand request CAAs test , the file produced by the process should be securely deleted from the device. It must be deleted in such a way that the file does ’s or test examiner’s administrator location such as Windows’ Recycle Bin, where it can be not remain in a temporary storage should and CAASPP test site coordinators s, test examiners, Test administrator undeleted. use the school’s or LEA’s preferred method of secure file deletion. While there are many ways to permanently delete a file, including using a “shredding” tool that might be part of a virus scanning tool, what follows are basic ways to remove a file from a Windows or Macintosh system: Windows Hold the key when deleting the file or empty the Recycle Bin after • — deleting. —Press the Macintosh and Macintosh equivalent devices using OS X • + keys with any file or folder selected to send a file to the Trash and then or press the + + keys open the Finder menu and then select “Secure Empty Trash” to immediately empty the Trash.  2018– 19 CAASPP Online Test Administration Manual 40 January 2019 by the California Department of Education Customization Copyright © 2019

51 | Test Security Handling Secure Printed Materials Tasks for Performance Paper and Securely Destroying Scratch Using : Use • The only exception to the requirement governing the immediate destruction of printed materials and scratch paper is when students take notes or draft responses to ELA , , or science performance tasks ( PTs ). mathematics • During the Smarter Balanced ELA PT, the notes on the embedded universal tool, Global Notes, are retained from Part 1 to Part 2 so that the student may return to the notes even though the student is not able to go back to specific items in Part 1. The embedded Global Notes is the preferred mode for note taking during the Smarter Balanced ELA PT. Stude • nts may also use scratch paper to make notes or develop draft responses. To maintain the security of scratch paper used for notes on the ELA or mathematics PTs, or CAST questions, test administrators or test examiners must direct , CAA , or CSA students to write their names (or some appropriate identifying information) on their scratch paper, and then collect and inventory the scratch paper at the end of each test session, as well as upon completion of the test. The retention of scratch paper paper) is allowed for the PTs, the CAST, CAAs . , and CSA (including graph or passages or scratch paper for future test sessions keep printed test items DO NOT • except as noted for PTs. of scratch paper is only allowed for the Smarter retention The Caution: Balanced PTs, CAST, CAAs At the end of each test session, all . , and CSA scratch paper (including graph paper) must be collected, inventoried, and securely for student use in a subsequent test session. All scratch paper must be stored test to securely destroyed immediately upon the student’s completion of the maintain test security. 201 8– 19 CAASPP Online Test Administration Manual January 2019  41 by the California Department of Education Customization Copyright © 2019

52 Test S ecurity | Identifyin g Testing Improprieties, Irregularities, and Breaches Testing Improprieties, Irregularities, and Identifying Breaches : Note The processes described in this section are to be used to report incidents CAASPP) for the California Assessment of Student Performance and Progress ( the Refer to online assessments only. California Assessment of Student ) ncil Testing Test Administration Manual -Pe for Performance and Progress ( Paper the special version (braille or large- being administered for what print) assessment to do in the event of an incident that occurs during this testing. es, and breaches, are behaviors Test security incidents, such as improprieties, irregulariti prohibited either because they give a student an unfair advantage or because they compromise the secure administration of the assessments. Whether intentional or by rules, either by staff or students, and administration accident, failure to comply with security constitutes a test security incident. Improprieties, irregularities, and breaches need to be reported in accordance with the instructions in this section for each severity level. Some incidents may require that an (if a test -open, restore Appeal be submitted to reset, re , or invalidate a test. Local educational agency (LEA) CAASPP had been reset in error) coordinators or CAASPP test site coordinators can make the determination by reporting the incident using the online CAASPP Security and Test Administration Reporting System (STAIRS) /Appeals process in the Test Operations Management System (TOMS) . he details of t he incident, will prompt TOMS of a n Appeal After you have entered t the filing email is the appropriate action. You will receive an if that process, the STAIRS/Appeal during that that t he incident w as filed. confirms Impact and Definitions Subsection: Resources in This • — Security Incidents and Appeals Procedure Guide web document 19.pdf http://www.caaspp.org/rsc/pdfs/CAASPP.stairs -appeals -guide.2018- Definitions for test security incidents that can occur during administration of the summative /Appeals 6. Incidents should be logged using the STAIRS Table assessments are provided in . Security Incidents and Appeals Procedure Guide described in the process  2018– 19 CAASPP Online Test Administration Manual 42 January 2019 by the California Department of Education Customization Copyright © 2019

53 Test Security | Identifying Testing Improprieties, Irregularities, and Breaches 6. Definitions for Test Security Incidents Table Type Definition Impropriety An unusual circumstance that has a low impact on the individual or group of students who are testing, and has a low risk of potentially affecting or of impacting test security or test student performance on the test validity. These circumstances can be corrected and contained at the local level. An impropriety should be reported to the LEA CAASPP coordinator and immediately. The coordinator will report the CAASPP test site coordinator u sing the STAIRS /Appeals process incident . within 24 hours Irregularity An unusual circumstance that impacts an individual or group of students who are testing and may potentially affect student performance on the test test security, or test validity. These circumstances can be or impact corrected and contained at the local level. An irregularity must be reported to the LEA CAASPP coordinator and . T he coordinator will report the CAASPP test site coordinator immediately , using the STAIRS within 24 hours irregularity to both process /Appeals report the incident and file the Appeal . An event that poses a threat to the validity of the test. Examples may Breach or security include such situations as a release of secure materials or a system risk. These circumstances have external implications for the , the Smarter Balanced California Department of Education (CDE) and may result in a Consortium decision Consortium , or both, Assessment to remove the test item(s) from the available secure bank. A breach . incident must be reported to the LEA CAASPP coordinator immediately The LEA CAASPP coordinator must report the breach by immediately calling at (CalTAC) the California Technical Assistance Center either 800- 955 -2954 if the breach is due to social media exposure on the part of -445- 8765 I n for all other breaches. a student or adult or the CDE at 916 , report the incident using the addition, he or she must within 24 hours . process STAIRS/Appeals that the physical conditions to ensure and test examiners administrators It is important for test Refer to in the testing room meet the criteria for a secure test environment. the subsection Requirements for more detail. 201 8– 19 CAASPP Online Test Administration Manual January 2019  43 by the California Department of Education Customization Copyright © 2019

54 Test Security | Using the Security and Test Administration Incident Reporting System Using the Security and Test Administration Incident Reporting System Resources in This Section: • California Assessment of Student Performance and Progress (CAASPP) Security and Test Administration Incident Reporting System (STAIRS) Applicable Tes ting — web document - http://www.caaspp.org/rsc/pdfs/CAASPP.STAIRS Issues Chart 19.pdf issues.2018- • CAASPP Portal website—http://www.caaspp.org/ • Security Incidents and Appeals Procedure Guide web document — http://www.caaspp.org/rsc/pdfs/CAASPP.stairs -appeals -guide.2018- 19.pdf STAIRS , available in the Test Operations Management System /Appeals process The online and CAASPP CAASPP LEA) local educational agency ( must be used by (TOMS), test site coordinators to report a test security incident or other testing issue that interferes with the Testing incidents must be reported within administration and completion of the assessment. the LEA’s selected testing window and should be filed with enough time for students to finish to the by phone testing after an Appeal has been granted. Breach incidents must be reported California Technical Assistance Center (CalTAC) or the California Department of Education ’s selected testing window is still open or has closed. (Refer to the whether the LEA (CDE) for details about the incident web document Security Incidents and Appeals Procedure Guide reporting process.) LEA CAASPP coordinators and CAASPP test site coordinators must ensure that all test process security incidents are documented using the STAIRS /Appeals . After the in TOMS incident immediately prompt the filing of an TOMS will is reported, Appeal if that is the and includes the an email that descr appropriate action. You will receive ibes the submittal that can be used for searches in TOMS case number to the submitter will be sent . This email (and to the LEA CAASPP coordinator, if the form is submitted by the CAASPP test site caaspp @ETS.org coordinator). Ensure that communications generated by the email address are not automatically sent to a junk mail or spam folder. STAIRS case The CDE may review your to determine whether your testing issue requires additional action by the LEA.  2018– 19 CAASPP Online Test Administration Manual 44 January 2019 by the California Department of Education Customization Copyright © 2019

55 Test Security | Using the Security and Test Administration Incident Reporting System Required Action Steps depict the required actions for each test security The Test Security Required Action Steps incident in a process flow diagram format. Impropriety An u nusual circu mstance that has a low impact on the individual or group of students who are testing and has a low risk of potentially affecting student performance on the test or of test security or test validity. (Example: Student[s] leaving the testing room w ithout impacting .) authorization, or related instructional materials were left on the walls in the testing room The CAASPP test site Incident is mitigated coordinator or LEA as necessary by Local administrators CAASPP coordinator school staff, and the or staff take reports LEA CAASPP the impropriety corrective action coordinator is notified online using the and notify the site STAIRS/Appeals for assistance with coordinator. mitigation as process in TOMS necessary. within 24 hours. 201 8– 19 CAASPP Online Test Administration Manual January 2019  45 by the California Department of Education Customization Copyright © 2019

56 Test Security | Using the Security and Test Administration Incident Reporting System Irregularity An unusual circumstance that impacts an individual or group of students who are testing and may potentially affect student performance on t test security or test validity. or impact he test These circumstances can be contained at the local level. (Example: Disruption during the test , or s .) session such as a fire drill tudent(s) cheated or provided answers to each other The CAASPP test site Incident is mitigated coordinator or LEA as necessary by Local administrators CAASPP coordinator school staff, and the or staff take reports the irregularity LEA CAASPP corrective action and using the online notify the site coordinator is notified STAIRS/Appeals for assistance with coordinator. process in TOMS mitigation. within 24 hours. The CDE reviews the The submitter (and STAIRS case and the LEA CAASPP approves the Appeal, if coordinator, if the (Invalidate necessary The coordinator submitter was a or Grace Period submits an Appeal CAASPP test site Extension appeal request, if prompted. coordinator) receives only) . The coordinator an email summarizing retains the STAIR S the submittal. response email for his or her records. Breach A test administration event that poses a threat to the validity of the test. Breaches require attention and escalation via telephone — if the breach is due to social media immediate exposure on the part of a student or adult, the LEA CAASPP coordinator contacts CalTAC; the CDE . Following the for all other breaches, the LEA CAASPP coordinator must contact call, the CAASPP test site coordinator or LEA CAASPP coordinator must report the breach using the within 24 hours. process STAIRS/Appeals Examples may include such situations as exposure of secure materials or a repeatable or security system risk. These circumstances have external implications. (Example: Test s modifying student answers, or test items shared in social media.) administrator  2018– 19 CAASPP Online Test Administration Manual 46 January 2019 by the California Department of Education Customization Copyright © 2019

57 | Test Security Using the Security and Test Administration Incident Reporting System The LEA CAASPP coordinator LEA staff immediately calls investigate the Local administrators the CDE to report security risk and or staff mitigate the the breach. s CalTAC for alert incident as Following the call, social media necessary and the CAASPP test breaches and the immediately report site coordinator or CDE for all other the breach to the LEA CAASPP breaches, and CAASPP test site coordinator reports stand ready to coordinator, LEA the breach using receive further CAASPP the online guidance on the coordinator, or both. /Appeals STAIRS dispensation of in TOMS process . the event within 24 hours. The CDE reviews the STAIRS case and The submitter (and the approves the appeal, LEA CAASPP if necessary The coordinator coordinator, if the (Invalidate or Grace submits an Appeal submitter was a Period Extension request, if CAASPP test site Appeal only). The prompted. coordinator) receives coordinator retains an email summarizing the STAIRS response the submittal. email for his or her records. 47 201 8– 19 CAASPP Online Test Administration Manual  January 2019 Customization Copyright © 2019 by the California Department of Education

58 Test Security | eporting System Using the Security and Test Administration Incident R /Appeals Process The STAIRS Notes : process must be used to report incidents that occur during • The STAIRS /A ppeals the administration of the Smarter Balanced Summative Assessments, the , the California Science Test (CAST) California Alternate Assessments (CAAs), and the California Spanish Assessment (CSA) . • Incidents that occur during the administration of the interim assessments are handled at the local level and should not be reported using the STAIRS /Appeals process . /Appeals Security Incidents process is described in the Information about using the STAIRS and Appeals Procedure Guide . Report Incidents The LEA CAASPP coordinator is responsible for notifying the CDE within 24 hours , using in TOMS , of any incidents that occur before, during, or after process /Appeals the STAIRS testing. The CAASPP test site coordinator is responsible for immediately notifying summative inator of any security breaches or testing irregularities that occur in the LEA CAASPP coord the administration of the test. STAIRS The online be used to provide , must in TOMS , which is available /Appeals process STAIRS /Appeals the required information to the CDE when an incident is confirme d. The process includes the opportunity to securely upload a spreadsheet containing Statewide in cases involving students involved in the irregularity Student Identifiers (SSIDs) of up to 500 only SSID numbers. Do not upload student names, . 11 or more students TOMS will prompt the user if an Appeal is to be filed after the STAIRS case is submitted . When the will first review the STAIRS Appeal type is Invalidate or Grace Period Extension, the CDE case and approve the in TOMS. Appeal before it is filed (with a copy sent to the CAASPP test site coordinator The LEA CAASPP coordinator or submitting the LEA CAASPP coordinator) to confirm the will receive an email STAIRS case submittal. may be sent to the CDE for the following incident types: A copy of the email . There was student cheating • • There was a security breach (where either a student or an adult exposed secure materials) . • interface or Test Administrator Interface was used for practice testing The live student instead of the . (Accidental summative access) e tests training or practic The test administrator provided the student with access to another student’s work • or responses. (Accidental SSID swap)  2018– 19 CAASPP Online Test Administration Manual 48 January 2019 by the California Department of Education Customization Copyright © 2019

59 Test Security | Using the Security and Test Administration Incident Reporting System are searchable in TOMS. Cases with any status —draft, submitted, or processed— Coordinator Procedures The CAASPP test site coordinator: Receives notification of an irregularity • Reviews the information provided and verifies that an irregularity has occurred • • Contacts the LEA CAASPP coordinator and provides all pertinent information or reports the STAIRS/Appeals process , if this is the procedure established for the incident using the LEA, if the incident has not been reported by the CAASPP test site coordinator, and if the incident is not a breach The LEA CAASPP coordinator: Receives notification of an irregularity from the CAASPP test site coordinator • • Reviews the information provided and verifies that the occurrence is an irregularity In the case of a breach, notifies the CDE within 24 hours of the incident • using Reports the incident • , if this is the procedure als process /Appe the STAIRS established for the LEA Responds to and assists the CDE and test security personnel as requested • • Keeps any documentation associated with the irregularity for one year Actions STAIRS provide a series of /Appeals process STAIRS web forms used during the in TOMS The online prompts that will ultimately result in a recommended action for the LEA or test site “ no action required” and “ continue in the form to . Examples of actions include coordinators submit an Appeal” to “ wait for a CDE response.” The Security Incidents and Appeals Procedure Guide and the action to be taken. types lists the incident Notes: LEA CAASPP coordinators should contact CalTAC if the incident does not meet any of the criteria in the STAIRS Applicable Testing Issues w eb document. must SUBMIT You select the [ ] button as the last s tep of the Warning: /Appeals as the final step in the STAIRS web form in TOMS STAIRS/Appeals process. If you do not, your entry will be saved as a draft. 201 8– 19 CAASPP Online Test Administration Manual January 2019  49 by the California Department of Education Customization Copyright © 2019

60 Test Securi ty | Using the Security and Test Administration Incident Reporting System Appeals Notes : file an not Do is ppeals process STAIRS/A Appeal for an interim assessment; the • for use with the summative assessments only. An incident in TOMS • process must first be reported using the STAIRS /Appeals for the LEA CAASPP coordinator or CAASPP test site coordinator. If an Appeal is . to be filed, the web form will provide the appropriate prompts • LEA CAASPP coordinators must contact CalTAC to make a request to restore a This type of request cannot be made using test that has been reset in error. . process /Appeals the STAIRS Process , TOMS will /Appeals process using the STAIRS reported Once the incident has been continue . In some , which is presenting a web for form filing any necessary Appeal to the next step cases, an Appeal may be submitted to address incidents that are not security -related, such as re -opening an assessment for a student who becomes ill and is unable to resume testing until after the assessment availability has expired. When the STAIRS incident results in an Invalidate or Grace Period Extension appeal, the incident details are forwarded to the CDE for approval before t he Appeal can be filed. An Appeal must be filed before the end of the selected testing window and with enough time to retest the student within the selected testing window . 1. Document and submit an irregularity or test security incident for a summative STAIRS online using the assessment in TOMS. process /Appeals 2. Review the instructions on the screen before STAIRS/Appeals > Step 4: Confirm Details you select the [ SUBMIT ] button to submit the incident report . STAIRS/Appeals > Submit the STAIRS Case to the ppeal is required, the 3. If an A screen appears. CDE/File and Appeal 4. Make sure the box in Select column of the table in the “Cases for Appeals” table is ] button SUBMIT checked, enter comments, if any, in the text box, and then select the [ to file the appeal. 5. In cases where the appeal types are Invalidate and Grace Period Extension and the cases are pending the CDE’s approval, you have the option to cancel the appeal Summary ] button on the WITHDRAW request by selecting the [ screen.  2018– 19 CAASPP Online Test Administration Manual 50 January 2019 by the California Department of Education Customization Copyright © 2019

61 Test Security | Using the Security and Test Administration Incident Reporting System he CDE will 6. In cases where the appeal type is Invalidate or Grace Period Extension, t days of its receipt. business within four make a decision on the appeal 7. In all cases, TOMS will send an email summarizing the STAIRS filing that includes a case number to be used for searches and communications. Appeals with any status are searchable in TOMS. Manual 51  19 CAASPP Online Test Administration 8– 201 January 2019 Copyright © Customization by the California Department of Education 2019

62 | Test Security Using the Security and Test Administration Incident Reporting System This page is left blank intentionally. Manual January 2019 19 CAASPP Online Test Administration 52  2018– by the California Department of Education Copyright © Customization 2019

63 Chapter 4. Administration Preparation and Planning

64 ation and Planning | Administration Prepar Technology Infrastructure Technology Infrastructure in This Section: Resources Appendix D: Secure Browser for Testing • website—http://ca.browsers.airast.org/ Secure Browsers • Technical Specifications and Configuration Guide for California Assessment of • Student Performance and Progress (CAASPP) Online Testing — web document http://www.caaspp.org/rsc/pdfs/CAASPP.tech guide.2018- and- config- -specs- 19.pdf , CAASPP coordinators LEA) local educational agency ( administration, assessment Prior to , technology coordinators CAASPP test site coordinators , and test , test administrators examiners should review the technology infrastructure at their schools to ensure it meets the minimum requirements for administering the Smarter Balanced assessments. The Secure Browser All students must use a secure browser to access operational assessments. Most d evices prior to of the version 10.3 secure browser that will be used for testing must be equipped with the assessment. browser to secure the device. secure CAASPP can use the devices Many that will be used for testing must have the correct secure browser installed devices All prior to assessment. The secure browser is designed to support test security by prohibiting access to external applications or navigation away from the ass essment. CAASPP administration, the updated version of the secure Note: For the 201 8–19 browser, version be downloaded and installed in order for students to must 10.3, test in 2018–19. are responsible for ensuring that each device to be used for technology coordinators School by installing the most current secure browser is properly secured the school testing at . w ebsite . Secure Browsers Secure browsers are available for download on the Manual  54 2018– 19 CAASPP Online Test Administration January 2019 Customization Copyright © by the California Department of Education 2019

65 Administration Preparation and Planning | Student Data Student Data in This Section: Resources • California Department of Education (CDE) California Longitudinal Pupil web page— Achievement Data System (CALPADS) https://www.cde.ca.gov/ds/sp/cl/ is the authoritative source for student enrollment, demographic, and program CALPADS TOMS -level data ). The student the Test Operations Management System ( information for from CALPADS will be used for the Smarter Balanced assessments (summative and interim), Calif ornia Alternate Assessments (CAAs), California Science Test (CAST) , as well as the -pencil primary language assessment. The use of CALPADS data for these paper assessments underscores the importance of keeping CALPADS up to date and accurate. is as to be correct in CALPADS for a student to start testing The minimum data that needs follows: Name • • Grade School and local educational agency information • • CALPADS enrollment status of 10 -term) (short or 30 (primary) • U.S. school entry data (if the student is an English learner) to be printed on Student Score Reports Parent/Guardian address • • Fields 3.13 (education program) and 3.21 (primary disability) (if the student is to take or receive designated supports, accommodations, the California Alternate Assessment , or any combination of these) unlisted resources All other demographic fields (if the LEA wants to view these fields in the final student • data file that is downloadable from TOMS) CALPADS documentation, including field names and field codes, and information about CALPADS w CALPADS support are available on the CDE eb page. 201 8– 19 CAASPP Online Test Administration Manual January 2019  55 by the California Department of Education Customization Copyright © 2019

66 Administration Preparatio | n and Planning General Test Administration Information Administration Information Test General in This Section: Resources School personnel should follow the California policies and regulations regarding student participation. More information can be found at the following locations: • California Department of Education (CDE) California Assessment of Student – CalEdFacts e— Performance and Progress (CAASPP) Description web pag https://www.cde.ca.gov/ta/tg/ai/cefcaaspp.asp • California Code of Regulations CAASPP Regulations web document — http://www.cde.ca.gov/ta/tg/ca/documents/caasppresubregs.docx , California Assessment of Academic Achievement California Education Code web pages: • web page— http://leginfo.legislature.ca.gov/faces/ Article 1 General Provisions codes_displayText.xhtml?lawCode=EDC&division=4.&title=2.&part=33.&chapter= 5.&article=1 Article 2 Program Provisions • http://leginfo.legislature.ca.gov/faces/ web page— codes_displayText.xhtml?lawCode=EDC&division=4.&title=2.&part=33.&chapter= 5.&article=2 web Article 4 California Assessment of Student Performance and Progress • http://leginfo.legislature.ca.gov/faces/codes_displayText.xhtml? page— lawCode=EDC&division=4.&title=2.&part=33.&chapter=5.&article=4 This section provides an overview of the online testing environment and guidelines for test administration. Use this section to become familiar with what students will experience in accessing the assessments, how to prepare for the assessments, and to review general rules the practice and training tests, test pauses, and test for online testing. Information about should and test examiners resumptions is also included in this section. Test administrators become familiar with this section well in advance of the start of testing so materials for logon, ons, and exemptions described below can be assembled. accommodati  2018– 19 CAASPP Online Test Administration Manual 56 January 2019 by the California Department of Education Customization Copyright © 2019

67 Administration Preparation and Planning | General Test Administration Information and Test General Rules of Online Testing for Test Administrators Examiners This sub section provides a brief overview of the general test administration rules for different . accessibility resources student portions of the assessment as well as information about Basic Online Testing Parameters : in This Subsection Resource • Appendix B: Online Item Types Online Tests : Students may not return to a test once it has been completed and submitted unless an • open the test has been approved. (Note that an Appeal cannot be Appeal to re- CAASPP coordinator or CAASPP ( LEA) local educational agency requested unless the Security and Test incident using the test site coordinator has submitted the Administration Incident Reporting System in the Test Operations /Appeals process Management System (TOMS); TOMS makes the determination whether to file an Appeal immediately, defer until an Appeal has been approved by the CDE, or that an Appeal is not necessary .) • Within certain tests, there may be segments. A student may not return to a segment once it has been completed and submitted; during a grace period extension, the student may only return to prior pages (i.e., screens) within the existing segment. A grace period extension will only be granted in cases where there was a disruption to a test session, such as a technical difficulty, fire drill, schoolwide power outage, earthquake, or other act beyond the control of the test administrator. Calif ornia Science Test ( ), and the CAST assessments, the For Smarter Balanced • California Spanish Assessment (CSA), students must enter an answer for all item(s) on a page before going to the next page. Students may need to use the vertical scroll bar to view all items on a page. The system will permit students taking a California Alternate CAA ) to navigate through unanswered items. Assessment ( Students may mark items for review and use the Past/Marked Questions drop -down list • If this to return to those items that have already been answered within a segment. or option is selected, students need to make sure they review their past marked o nce a test session is questions before they sign out of the test session, because ) CAT computer adaptive test ( closed, questions from the session, including tems with partial responses, writing i can no longer be accessed in subsequent sessions. (This functionality does not apply to the CAAs.) 201 8– 19 CAASPP Online Test Administration Manual January 2019  57 by the California Department of Education Customization Copyright © 2019

68 Administration Preparation and Planning | General Test Administration Information A constructed response item is considered answered if the student has taken any action • within the response area. This includes random keystrokes (e.g., sdkjfdlkdjfo), one or more spaces using the spacebar, selecting anywhere on a Grid Item – Hot Spot Item, etc. The mark -items -for -review feature does not influence the adaptive nature of the CAT portion of the test —the response a student provides for each CAT item is used in the adaptive algorithm regardless of whether the student has marked the item for review. Students should be directed to provide their best answer to each item regardless of whether they want to mark the item for review later. Smarter Balanced, CAA for Science, and CAST: Smarter Balanced ks ( PTs ) are • performance tas In the assessments, CAT items and presented as separate tests. choice is a single test that includes items ranging from traditional multiple- • The CAST and constructed response to new technology , including PTs . A student -enhanced items directly follows within the same testing survey consisting of three to four questions session. CAA for Science The • . are entered into the test delivery system responses ) and Mathematics: CAAs for English language arts/literacy ( ELA assigns CAAs for ELA and mathematics item sets of use a The test design that multistaged varying complexity, based on how well students perform on the initial set of items. Some students may be presented with fewer items than others, depending on how students perform on the items they receive. The goal of the CAA design is to provide students the best opportunity to demonstrate what they know and can do while minimizing exposure to items with an inappropriate level of complexity. end testing after Stage 1. However, most students Note that some students will automatically will complete Stage 1 and proceed . When testing is two Stage 2 sections to one of completed, the test examiner submits the test. Tier 1 items are considered the most accessible and contain more images , and Tier 3 items . provides more answer choices, more complicated text, and the fewest images Pause Rules during the Smarter Balanced and CAST discrete item blocks : During the CAT portion of the If a test 20 minutes is paused for more than , the student • on to the student interface is r equired to log back − using his or her logon information (name, Statewide Student Identifier, and test session) ;  2018– 19 CAASPP Online Test Administration Manual 58 January 2019 by the California Department of Education Customization Copyright © 2019

69 Administration Preparation and Planning | General Test Administration Information is p resented with the page containing the item(s) he or she was working on when the − was paused (if the page contains at least one item assessment to which there is not with the next page (if all items on the previous page were OR a complete response) answered); and − will n ot be permitted to review or change any previously answered items , even if on a page that contains at (with the exception of items they are marked for review least one item to which there is not a complete response) (refer to appendix E , . scenario 2, item c for additional information) test is paused regardless of how long the test Any highlighted text will be saved when a • is paused. on the digital notepad will not be saved. entered Notes In the event of a technical issue (e.g., power outage or network failure), students will be • on test will automatically be paused. The students will need to log off and the logged test . Highlighted text will be available when the student has again upon resuming the logged back on and resumed testing; notepad—the tool on the entered notes digital used to make notes about an item —will no longer be avail able. Refer to to review the rules that govern • Appendix E: CAT Pause Rules Scenarios pausing during the test. During the portion of the Smarter Balanced and CAST assessments: PT more than There are no pause restrictions. If a PT is paused for 20 minutes, the • student can return to the section and continue entering his or her responses . • For the mathematics PT, any highlighted text and notes on the digital notepad will not be saved when a test is paused regardless of how long the assessment is paused. Notes are retained for both parts 1 and 2. PT, the Global For the ELA • • the Global test is Notes will be saved when a within Any highlighted text and notes is paused. paused regardless of how long the assessment comments In the event of a technical issue (e.g., power outage or network failure), • entered PTs in which students complete Notes —the tool used during ELA Global on the , as well as for any other test items —will be available when the a full write within the PT . student has logged back on and resumed 8. Assessment Sequence Table — Please note that there are recommendations for breaks in 9. Assessment Sequence— ELA and Table the CAST is a single test . Although Mathematics , because each PT two hours, there are break recommendations that is estimated to take should be completed in a single session. the pause rules that follow apply and science, , mathematics, CAAs For the for ELA regardless of whether the student or the test examiner pauses the test or there was a technical issue (e.g., power outage or network failure) that resulted in the student being logged off. 201 8– 19 CAASPP Online Test Administration Manual January 2019  59 by the California Department of Education Customization Copyright © 2019

70 Administration Preparation and Planning | General Test Administration Information The CA • As for ELA and mathematics can be paused and resumed as many times as necessary to allow the student to show what he or she knows. The student also may or days throughout the testing choose to pause and resume over the course of a day window. • The test examiner can make the decision to pause and resume the test administration if the student is no longer engaged, is not actively participating, or is showing signs of behavioral or functional concerns related to the test. • student , on behalf of the test examiner When a test is paused, the , must log back on to to the first page resume testing. Upon resumption, the student is directed automatically unanswered that has an item. Previously answered items can be revisited within the current test segment, but not in prior segments. Stopping a Test Only the CAAs may be stopped before the test is complete. Students typically take approximately 95 cumulative minutes or less to successfully complete a single content area of a CAA. Test examiners may end a test if the student’s productivity and engagement have significantly declined, even after allowing the student breaks over multiple days. , students should be given as many breaks as needed to perform well, including cases In all testing over multiple days. aminer determines it is in the best interest of the student to end the test early, the If the test ex will need to advance through the remaining test items until he or she reaches test examiner s the test. the end and then submit Test Timeout (Due to Inactivity) As a security measure, students , test administrators, and test examiners are automatically is defined as selecting activity logged off the test after 30 minutes of inactivity. For students, assessm ent (e.g., selecting an answer or navigation option in the ] or [ ] or using Back Next [ item ). Moving the mouse or the Past/Marked Questions drop -down list to navigate to another selecting an empty space on the screen is not considered activity. This timeout also results in the test being paused automatically. For test administrators means that a student or students are activity , and test examiners . As long as students are testing, the test administrator or test registering test activity will not be logged off. examiner Before the system logs the student off assessment the , a warning message will be Figure 30 [Ok] within 1) . If the student does not select displayed on the screen ( . Selecting seconds after this message appears, he or she will be logged off [Ok] will inactivity timer minute restart the 30 .  2018– 19 CAASPP Online Test Administration Manual 60 January 2019 by the California Department of Education Customization Copyright © 2019

71 Administration Preparation and Planning | General Test Administration Information Figure 1. Test timeout warning message As a security measure, test administrators and test examiners are Caution: logged off the Test Administrator Interface after 30 minutes of user automatically inactivity in the session, regardless of whether or not the test administrator is actively monitoring the test session away from his or her device. The inactivity will result in the closing of the test session. Test Expiration Rules Opportunities refer to the number of times a student can take a test within a range of dates. A student’s test opportunity remains active until the student submits the test or until the opportunity expires. Once a test opportunity expires, the student cannot complete or review Students have one opportunity per CAASPP online assessment. Only interim the test. assessments offer students multiple opportunities. Smarter Balanced Computer Adaptive Test (CAT) 45 test or CAT remains active until the student completes and submits the A student’s test (but before the end of the selected after the student has begun the calendar days students testing window), whichever occurs sooner. However, it is recommended that five days CAT items portion of the complete the test within of starting the designated content area. s CAST and CAA The CAST assessment and the CAAs for ELA and mathematics remain active until the after the student has begun the student completes and submits the test or 45 calendar days test (but before the end of the selected testing window), whichever occurs sooner. H owever, it is recommended that that students complete these assessments within of starting five days the designated content area. Note that each of the three embedded PTs in the CAA for Science are treated as separate tests. All three must be completed and submitted no later than the last day of the LEA’s instructional calendar or July 15, 2019, whichever comes first. CSA no later than July The CSA remains active until the student completes and submits the test 15, 2019. 201 8– 19 CAASPP Online Test Administration Manual January 2019  61 by the California Department of Education Customization Copyright © 2019

72 Administration Preparation and Planning | General Test Administration Information Smarter Balanced Performance Task (PT) after the The PT is a separate test that remains active for no more than 10 calendar days Smarter Balanced student has begun the PT (with the approval of the CDE) . However, he PT that students complete t recommends in each content of starting three days within area. The ELA PT will submit automatically if the 10 -day window expires and the A summary of recommendations for the system has registered any response to the PT. in the subsection number of sessions and session durations is provided Testing Time and Recommended Order of Administration . If a student starts a Smarter Balanced, CAA for ELA or mathematics, or Note: CAST assessment near the end of the selected testing window, the student must finish before the test administration window officially closes. The assessment will automatically end on the last day of the selected testing window , the last day of or July 15, 2019, even if the student has not finished. instruction, and Recommended Order of Administration Time ing Test Smarter Balanced assessments All students participating in the PT and a will receive a CAT has and eleven (if that student Students in grades five, eight, in both ELA and mathematics. Otherwise, students in grade twelve who are also receive the CAST. been assigned) will required to take the CAST who students in grade ten , as will those the CAST will take only are assigned to take the CAST . Eligible students taking the online CAAs will receive both ELA and mathematics assessments. Students in grades five, eight, and eleven (if the high school has been assigned that grade or that is the grade calculated for students in ungraded programs) will also rece ive the CAA for Science. Otherwise, eligible students in grade twelve who are the CAA for Science, as will those required to take the CAA for Science will take only students in grade ten who are assigned to take the CAA for Science. Testing Time And Scheduling Resources in This Subsection: • web document California Code of Regulations CAASPP Regulations — http://www.cde.ca.gov/ta/tg/ca/documents/caasppresubregs.docx eb document Chapter 3: Test Administration Setup — w • -pre -admin- http://www.caaspp.org/rsc/pdfs/CAASPP.TOMS guide.2018- -3.pdf 19.Chapter TOMS Pre • eb document w Guide for CAASPP Testing — -Administration 19.pdf guide.2018- -pre -admin- http://www.caaspp.org/rsc/pdfs/CAASPP.TOMS  2018– 19 CAASPP Online Test Administration Manual 62 January 2019 by the California Department of Education Customization Copyright © 2019

73 Administration Preparation and Planning | General Test Administration Information : Testing Windows coordinators set up test dates in the TOMS Test Administration Setup module. LEA CAASPP Testing windows can be viewed in TOMS by LEA CAASPP coordinators by following the instructions to “View the Details of the Windows Summary” in Chapter 3: Test Administration Setup of the TOMS Pre -Administration Guide for CAASPP Testing . All CAASPP testing must take place within this window, including any make- . up testing Scheduling Time for Testing: Estimated testing times do not account for any time needed to start devices, load secure browsers, and log students on; nor do they account for breaks. Test administrators and test examiners should work with CAASPP test site coordinator s to determine precise testing schedules. Smarter Balanced Summative Assessments for ELA and Mathematics time it will take most students to complete the s of the estimate Table 7 contains rough Smarter Balanced based on the time it took students to complete the Smarter assessments Summative Assessments in prior years . This information is for scheduling Balanced purposes only, as the assessments are not timed. Table 7. Estimated Testing Times for Smarter Balanced Online Assessments Total in CAT items in PT in Grade Assessment - hrs:mins Level hrs:mins hrs:mins 3:30 ELA 3 – 5 1:30 2:00 8 – 6 ELA 3:30 2:00 1:30 2:00 2:00 4:00 ELA 11 1:00 3 – 5 1:30 2:30 Mathematics 2:00 Mathematics – 8 6 1:00 3:00 Mathematics 11 2:00 1:30 3:30 5 – ELA and mathematics 6:00 3 3:00 3:00 6:30 3:00 3:30 8 – ELA and Mathematics 6 3:30 4:00 11 7:30 ELA and Mathematics When developing a testing schedule, use the estimated testing times to calculate the number in each content area of days and the amount of time it will take to complete an assessment and grade level. Smarter Balanced recommends that students take the Also consider that CAT and PT items on separate days to minimize the effect of student fatigue. California Alternate Assessments for ELA , Mathematics, and Science 60 to 100 t esting should take approximately and mathematics, CAAs for ELA For the online minutes for each content area, although the assessments are untimed, and the amount of time each student needs can vary. Tests may be administered to a student over as ma ny testing sessions and days as required to meet the needs of that student. 201 8– 19 CAASPP Online Test Administration Manual January 2019  63 by the California Department of Education Customization Copyright © 2019

74 Administration Preparatio n and Planning | General Test Administration Information For the CAA for Science, which is administered one on one during regular classroom 60 minutes approximately instruction, testing should take per embedded PT , although the assessme nts are untimed, and the amount of time each student needs can vary. Tests may be administered to a student over as many testing sessions and days as required to meet the needs of that student. California Science Test Administration of the CAST assessment is estimated to take approximately two hours. Note that the CAST is an untimed test. The CAST is composed of five blocks of test questions: two or three blocks of discrete (stand- alone) questions followed by three or two PTs where each PT is a block. It is strongly recommended that a PT be started and completed in a single test session, wi th a break after either the second or third block of test questions. California Spanish Assessment Administration of the CSA is estimated to take approximately two hours. Note that the CSA is y need to complete this ime as the an untimed test and students should be given as much t assessment. Order of Online Administration of the Smarter Balanced Recommended Summative Assessments for ELA and The summative comprised of two components (tests) assessments are : a CAT and a mathematics PT. PT items on separate days Smarter Balanced recommends that students take the CAT and . For each content area, Smarter Balanced also to minimize the effect of student fatigue recommends that students begin with the CAT items followed by the PT. LEAs or s chools may opt to administer in a different order if needed. Recommended Order of Test Administration Computer Adaptive Test Performance Task Duration and Timing Information recommendations for ELA, mathematics, and science assessments are The scheduling 10. Note that the duration, timing, break Table 8 through Table and pause rules, included in and session recommendations vary for each content area and component.  2018– 19 CAASPP Online Test Administration Manual 64 January 2019 by the California Department of Education Customization Copyright © 2019

75 Administration Preparation and Planning | General Test Administration Information English Language Arts/Literacy Assessment Sequence—ELA 8. Table CAT Items ELA PT CAA Recommendations: The PT is presented in Recommendations: Number and two parts. Duration of As many testing • • T wo sessions Sessions Recommendations: sessions and days (recommended) and required to meet the no more than six Administer in two • needs of the student. sessions (rare or sessions extreme). corresponding to • The test examiner Parts 1 and 2 of can make the • Session durations the PT. decision to pause range from 40 –60 and resume the test minutes. • Session durations administration if the –120 range from 60 student is no longer Part 2 minutes. engaged, is not should be scheduled actively participating, to allow students or is showing signs of enough time to behavioral or complete the full functional concerns write in one test related to the test. session. he PT is presented in T Breaks Breaks can be provided Breaks can be provided during the test sessions within during the test sessions two parts. Students using the software’s Sessions according to individual may take breaks within pause feature. If the student needs. Parts 1 and 2; however, test is paused for more once a student moves than 20 minutes, the to Part 2, he or she will student will not be able not be able to review or to go back to items on revise items in Part 1. the previous pages • Recommendation: (i.e., screens). Students complete • Recommendation: A Part 1 in one test single test session session and Part 2 should not include a the next school day break longer than 20 in a single test minutes. Instead, session. separate test sessions should be scheduled around extended breaks (e.g. , lunch). 201 8– 19 CAASPP Online Test Administration Manual  65 January 2019 by the California Department of Education Customization Copyright © 2019

76 Administration Preparation and Planning | General Test Administration Information ELA PT CAT Items CAA Once a student has Once a student has Once a student has Total started started the PT, it will be a CAA, this test Duration started the CAT items, will be available for 45 available for 10 this test will be or as calendar days or as calendar days available for 45 many days remain many days remain calendar days or as within the LEA’s within the LEA’s many days remain selected testing selected testing within the LEA’s window, whichever window, whichever d testing selecte length of time is shorter length of time is shorter window, whichever (e.g., if there are 15 (e.g., if there are four length of time is shorter days left in the selected days left in the selected (e.g., if there are 15 testing window and testing window and 20 days left in the selected days before the CAA nine days before the testing window and 20 PT expires, the test will expires, the test will days before the CAT become unavailable become unavailable expires, the test will after four days). after 15 days). become unavailable after 15 days). • Recommendation: • Recommendation: • Recommendation: Student completes Student completes Student completes each part of the PT this portion within five this portion withi n five within one day. days of starting. days of starting. : for ELA Reminders Important , students may be best served by sequential, 1. For the Smarter Balanced PTs uninterrupted time that may exceed the time in a student’s schedule. amount of time between beginning and completing each test within a 2. Minimize the content area. Smarter Balanced 3. The number of items will vary on the CAT portion of each student’s assessment . 4. The tests are not timed, so all time estimates are approximate. 5. Students should be allowed extra time if they need it, but test administrators and test examiners need to use their best professional judgment when allowing students extra time. Students should be actively engaged in responding productively to test questions. ssments 6. ELA asse can be spread out over multiple days as needed. 66 19 CAASPP Online Test Administration Manual January 2019 2018–  Customization Copyright © 2019 by the California Department of Education

77 Administration Preparation and Planning | General Test Administration Information Mathematics Table 9. Assessment Sequence—Mathematics Mathematics PT CAT Items CAA Recommendations: Recommendations: Recommendations: Number and Duration of • As many testing Administered in one • • Administer in two Sessions sessions and days session. sessions. required to meet the Session duration • Session durations • needs of the student. –120 ranges from 40 –60 range from 40 The test examiner • min utes. minutes. can make the Most students will decision to pause complete the CAT and resume the test items in two sessions administration if the of 60 minutes or less or student is no longer one long session of engaged, is not more than 60 minutes. actively participating, or is showing signs of behavioral or functional concerns related to the test. Breaks Breaks can be Students may take Breaks can be provided during the test within breaks during PT test provided during the test sessions using the Sessions sessions. Mathematics according to sessions software’s pause PT items are presented individual student feature. If the test is on a single page (i.e., needs. paused for more than screen). Following a 20 minutes, the student break, the student will will not be able to go have access to the back to items on the same items. pages (i.e., previous ). screens • Recommendation: A single test session should not include a break longer than 20 minutes. Instead, separate test sessions should be scheduled around extended breaks (e.g. lunch). Manual 201 19 CAASPP Online Test Administration 8– January 2019  67 by the California Department of Education Customization Copyright © 2019

78 | Administration Preparation and Planning General Test Administration Information CAA PT CAT Items Mathematics Once a student has Once a student has Once a student has Total a CAA, this test started started the PT, it will be started the CAT items, Duration 45 will be available for 10 available for they will be available calendar days or as or as calendar days for 45 calendar days many days remain many days remain or as many days within the LEA’s within the LEA’s remain within the LEA’s selected testing selected testing selected testing window, whichever window, whichever window, whichever length of time is shorter length of time is shorter length of time is shorter (e. g., if there are 15 (e.g., if there are four (e.g., if there are 15 days left in the selected days left in the selected days left in the selected testing window and 20 testing window and testing window and 20 days before the CAA nine days before the days before the CAT expires, the test will PT expires, the test will expires, the test will become unavailable become unavailable become unavailable after 15 days). aft er four days). after 15 days). • Recommendation: • Recommendation: • Recommendation: Student completes Student completes Student completes this portion within the PT in one day. this portion within five five days of starting. days of starting it. athematics: endations for M Additional Administration Recomm 1. For the Smarter Balanced PTs , students may be best served by sequential, uninterrupted time that may exceed the time in a student’s schedule. 2. Minimize the amount of time between beginning and completing each test within a content area. Smarter of each student’s portions 3. The number of items will vary on the CAT and PT . Balanced assessment time estimates are approximate. not timed, so all 4. The tests are 5. Students should be allowed extra time if they need it, but test administrators and test need to use their best professional judgment when allowing students extra examiners time. Students should be actively engaged in responding productively to test questions. can be spread out over multiple day assessments 6. Mathematics s as needed. 2018–  68 Manual January 2019 19 CAASPP Online Test Administration Customization Copyright © 2019 by the California Department of Education

79 Administration Preparation and Planning | General Test Administration Information Science Science 10. Assessment Sequence— Table Science CAA for Science CAST Recommendations for each Recommendations: Number and embedded PT : Duration of Administered in as many • Sessions session s as needed. As many testing sessions and • days required to meet the needs • Session duration should take of the student. minutes. approximately 120 • The test examiner can make the A p ost- testing survey should • decision to pause and resume the take an additional five minutes. test administration if the student is no longer engaged, is not actively participating, or is showing signs of behavioral or functional concerns related to the test. Breaks can be provided during the Breaks Breaks can be provided during the test sessions using the software’s within test sessions according to individual pause feature. If the test is paused Sessions student needs. for more than 20 minutes, the student will not be able to go back to items on the previous pages (i.e., screens). If a break is needed, it is recommended that the break occur after either the second or third block of te st questions. Once a student has started the Total a CAA Once a student has started CAST, this test will be available for for Science embedded PT , the Duration 45 calendar days or as many days particular embedded PT will be remain within the LEA’s selected or available for 45 calendar days test ing window, whichever length of . comes first July 15, whichever time is shorter (e.g., if there are 15 • Recommendation: Student days left in the selected testing completes this portion within five window and 20 days before the days of starting. CAST expires, the test will become unavailable after 15 days). Recommendation: Student • completes this portion within five days of starting. 69 January 2019 201 8– 19 CAASPP Online Test Administration Manual  by the California Department of Education Customization Copyright © 2019

80 Administration Preparation and Planning | General Test Administration Information : Science for ecommendations Administration R Additional 1. For the CAST, students may be best served by sequential, uninterrupted time that may exceed the time in a student’s schedule. 2. Minimize the amount of time between beginning and completing the test. 3. The tests are not timed, so all time estimates are approximate. 4. Students should be allowed extra time if they need it, but test administrators and test examiners need to use their best professional judgment when allowing students extra be actively engaged in responding productively to test questions. time. Students should 5. T ests can be spread out over multiple days as needed. Sensitive Responses Appropriate Action with Student Actions or Taking Student Responses That Cause Concern Throughout the test administration process, student safety is always the primary consideration. may encounter student actions that s or test examiners test administrator During testing, disrupt the assessment administration and may endanger the student or others. In addition, it will encounter student responses to is possible that test administrator s or test examiners paper that necessitate some action to ensure student safety. scratch questions or notes on test administrator security protocols make it clear that For test administrators, CAASPP s are not permitted to review student responses in the testing interface or students’ notes on CAASPP assessments , a test administrator might scratch paper. However, during or after unexpectedly encounter a student response that raises sufficient concern to warrant adult action, including action as a mandated reporter. Topics that may require the test student references to: but are not limited to, to take action include, administrator 1. Suicide activity 2. Criminal 3. Alcohol or drug use 4. Extreme depression or threats of violence 5. Extreme violence 6. Sexual assault or physical abuse 7. Self -harm or intent to harm others 8. Neglect 9. Bullying or a CAA test examiner, such a discovery may come during the course of one on Note that, f one administration.  2018– 19 CAASPP Online Test Administration Manual 70 January 2019 by the California Department of Education Customization Copyright © 2019

81 Administration Preparation and Planning | General Test Administration Information Collecting information and test examiner Prior to administration, each test administrator should have a thorough understanding of school, , or any combination of these LEA , California policies for the regarding documentation of student actions or concerning responses during a secure test should document as much information as or test examiner event. The test administrator possible in accordance with . policies for the school, LEA , CDE, or any combination of these Escalating ation inform Should the test administrator or test examiner encounter a sensitive situation while supervising the test session, the should immediately or test examiner test administrator escalate school, this concern in accordance with policies and procedures for the LEA , CDE, or any combination of these. Early Assessment Program (EAP) The California State The Early Assessment Program (EAP) is a joint program of the CDE, California Community Colleges (CCC). The EAP provides participating University (CSU), and level coursework students with an early indicator of their readiness for college- in written communication and mathematics prior to starting their senior year. The /quantitative reasoning results are used to determine a student’s placement in appropriate coursework once the student has been admitted to the CSU. The release of CAASPP results will not affect a student’s application for admission. All students participate in EAP by virtue of completing the Smarter Balanced Summati ve to Assessments for ELA and mathematics. A student will be asked if he or she wishes results to the CSU and CCCs. his or her To authorize the release of their results, release select students should r CAASPP/EAP the circle that indicates their understanding that thei This question is asked at the end , CCC , or both. results will be shared directly with the CSU of each test . must be authorized individually (e.g., The release of ELA and mathematics results authorization for the ELA results does not automatically confer authorization for the mathematics results). Students may voluntarily share results of one or both assessments. Students who choose not to release their results to the CSU and CCC will need to provide upon request. to a CSU or CCC their results 201 8– 19 CAASPP Online Test Administration Manual January 2019  71 by the California Department of Education Customization Copyright © 2019

82 Administ ration Preparation and Planning | Universal Tools, Designated Supports, and Accommodations Universal Tools, Designated Supports, and Accommodations What’s New in 2018–19 General or All . designated support edded has been reassigned as an emb Streamline • non- embedded designated support for all assessments. device ” is a new “ Medical • • The button used to clear unlisted resources in the Test Operations Management System (TOMS) is now called [ MAKE INACTIVE ]. Smarter Balanced Burmese is now among the embedded translation glossaries available as a designated • support for the mathematics assessment. CAST) California Science Test ( on April 1, 2019. The braille version of the CAST will be available • • Hmong is available as a translation glossary. CSA) Operational California Spanish Assessment ( Unlisted resources are available starting with the operational CSA. • • The following accessibility resources will be available in Spanish: – Audio transcript – -captioning Closed Braille – Accessibility Guidelines understanding, assigning There are a number of sources of information available to assist in , and using accessibility resources during CAASPP testing. Appendix — embedded mathematics accommodation) 100s Number Table (non- • G: 100s Number Table California Assessment of Student Performance and Progress • Accessibility Guide for — Online Testing CAASPP) eb document ( w http://www.caaspp.org/rsc/pdfs/CAASPP.accessibility 19.pdf -guide.2018- ns webcast CAASPP Accessibility and Accommodatio • —linked at http://www.caaspp.org/training/caaspp/  2018– 19 CAASPP Online Test Administration Manual 72 January 2019 the California Department of Education Customization Copyright © 2019 by

83 Administration Preparation and Planning | Universal Tools, Designated Supports, and Accommodations CAASPP Manuals and Instructions web page— • http://www.caaspp.org/ administration/instructions/ CAASPP Student Accessibility Resources and Test Settings web page— • http://www.caaspp.org/administration/accessibility Test Administrator Resources for Summative Assessments web page— CAASPP • http://www.caaspp.org/ta -resources/summative.html Resources web page— (TOMS) Test Operations Management System CAASPP • http://www.caaspp.org/administration/toms/ CDE) California Longitudinal Pupil Achievement California Department of Education ( • w eb page—https://www.cde.ca.gov/ds/sp/cl/ Data System • California Spanish Assessment Accessibility Supports for Operational Testing web —http://www.caaspp.org/rsc/pdfs/CSA.accessibility document -considerations.2018.pdf Matrix One: CDE Matrix One: California Assessment of Student Performance and • CDE — Progress Accessibil ity Resources web document http://www.cde.ca.gov/ta/tg/ai/documents/caasppmatrixone0918.docx https://www.cde.ca.gov/ web page— CDE Student Accessibility Resources • ta/tg/ca/accesssupport.asp • Individual Student Assessment Accessibility Profile Tool — http://www.caaspp.org/rsc/pdfs/CAASPP_ISAAP_Tool_2018- 2019.xlsm embedded mathematics accommodation) Multiplication Table (non- — • F: Appendix Multiplication Table s/ http://www.caaspp.org/rsc/pdf Online Student Test Settings Template— • 2019_v1.xlsx CA_Upload_Stu_Accom_Template_2018- Web document • Smarter Balanced Resources and Practices Comparison Crosswalk — w eb page at Resources linked on the CDE Student Accessibility https://www.cde.ca.gov/ta/tg/ca/accesssupport.asp w eb Smarter Balanced Usability, Accessibility, and Accommodations Guidelines • document —linked on the CAASPP Student Accessibility Resources and Test Settings web page at http://www.caaspp.org/administration/accessibility/ eb document TOMS Pre -Administration Guide for CAASPP Testing — w • guide.2018- http://www.caaspp.org/rsc/pdfs/CAASPP.TOMS -pre -admin- 19.pdf Manual 201 8– 19 CAASPP Online Test Administration January 2019  73 2019 Customization Copyright © by the California Department of Education

84 | Administration Preparation and Planning Universal Tools, Designated Supports, and Accommodations nk intentionally. This page is left bla January 2019 74  2018– Manual 19 CAASPP Online Test Administration 2019 by Copyright © Customization the California Department of Education

85 Chapter 5. Science Assessments

86 Sci | ence Assessments Administration Information for the California Science Test (CAST) Administration Information for the California Science Test (CAST) i Resources n This Section: • California Assessment of Student Performance and Progress (CAASPP) http://www.caaspp.org/ ) web page— California Science Test (CAST administration/about/science/ • CAASPP Practice and Training Tests website —linked on the CAASPP Online http://www.caaspp.org/practice- and- training/ Practice and Training Tests Portal at • CAASPP Test Administrator and Test Examiner Resources for the Online Practice and Training Tests web page— http://www.caaspp.org/ta -resources/practice- training.html Science California Test w eb page— • California Department of Education (CDE) https://www.cde.ca.gov/ta/tg/ca/caasppscience.asp CDE • w eb page— Accessibili Student ty Resources https://www.cde.ca.gov/ta/tg/ca/accesssupport.asp Assessments ed Summative Balanc Smarter dministering • Chapter for A 8: Scripts California n this document i subsection Test to Students and the Science -Administration Guide Test Operations Management System (TOMS) TOMS Pre • for CAASPP Testing w eb document — http://www.caaspp.org/rsc/pdfs/ 19.pdf pre -admin -guide.2018- CAASPP.TOMS- Overview of the Assessment ) is an online based on the , summative assessment CAST The California Science Test ( California Next Generation Science Standards (CA NGSS) . All local educational agencies are required to the administer eight , and twelve (LEAs) with eligible students in grades five, ligible students in grades ten with e whom the LEA recommends Schools CAST. and eleven . Students who take the CAST while to take a science assessment also may take the CAST twelve. retake the CAST in grade eleven or cannot their testing grade is grade ten or eleven All students will receive their CAST scores in a Student Score Report after they have tested. Scores for students in grades ten and eleven who take the CAST will be saved and reported for accountability purposes when those students are in grade twelve.  2018– 19 CAASPP Online Test Administration Manual 76 January 2019 2019 Customization Copyright © by the California Department of Education

87 Sci ence Assessments | Information for the California Science Test (CAST) Administration Survey three- Students in grades five and eight survey question will complete a that appears at the end of their test in the test delivery system. Students in high school will complete a four - question survey. ts intent is to five minutes. I The survey is estimated to take an additional gather more information about the student’s experience with the CAST and science in general. Resources Test Administrator Materials Directions for CAST administration, including instructions on approving tests and the script Chapter 8: Scripts for that must be read prior to test administration, can be found in Administering Smarter Balanced Summative Assessments and the California Science Test to Students . Student Accessibility Resources of embedded The complete list designated and non-e mbedded universal tools, supports, Accessibility Student n the CDE o for the CAST available and accommodations are listed Resources web page. embedded universal tools, designated supports, and will include embedded and non- Tests accommodations. Practice and Training Tests CAASPP Practice and training tests for the CAST are linked on the Pra ctice and Training . Practice tests can be accessed either through the secure browser or through a Tests Portal internet browser. Test Administrator and Test standard Scoring guides are available on the Examiner Resources for the Online Practice and Training Tests web page. Manual 201 8– 19 CAASPP Online Test Administration January 2019  77 2019 Customization Copyright © by the California Department of Education

88 Science Assessments | Administration Information for the California Science Test (CAST) User Responsibilities CAASPP users perform for the CAST: 11 shows the tasks Table 11. User Table Role Participation in the CAST Role Task LEA CAASPP • Create the users at schools involved in the CAST coordinator • Set up test administrations • , or , accommodations Assign student designated supports unlisted resources • Provide training to CAASPP test site coordinators and test administrators CAASPP test site Work with the California Longitudinal Pupil Achievement • coordinator Data System coordinator to ensure that students are in the correct grades Assign student designated supports, accommodations, or • unli sted resources Participate in training provided by the LEA • Test administrator Participate in training • ite test s or provided by the LEA coordinator Administer the CAST •  2018– 19 CAASPP Online Test Administration Manual 78 January 2019 the California Department of Education Customization Copyright © 2019 by

89 Science Assessments | Administration Information for the California Alternate Assessment (CAA) for Science Administration Information for the California Alternate Assessment (CAA) for Science in This Section: Resources • CAA for Science Administration Planning Guide for Test Examiners web documents —linked on the CAA web page at http://www.caaspp.org/ administration/about/caa/ • CAA CAASPP) California Assessment of Student Performance and Progress ( web page— http://www.caaspp.org/administration/about/caa/ • —linked on the CAASPP Online CAASPP Practice and Training Tests website Practice and Training Tests Portal at http://www.caaspp.org/practice- and- training/ CAASPP Test Administrator and Test Examiner Resources for the Online Practice • -resources/practice- and Training Tests web page— http://www.caaspp.org/ta training.html website— CAASPP Test Operations Management System (TOMS) • / https://caaspp.ets.org • Test w eb page— Science California California Department of Education (CDE) https://www.cde.ca.gov/ta/tg/ca/caasppscience.asp web page— • CDE California Alternate Assessments (CAA) https://www.cde.ca.gov/ta/tg/ca/altassessment.asp Accessibility w eb page— Resources https://www.cde.ca.gov/ta/tg/ca/ • CDE Student accesssupport.asp Test Examiner Post -Testing Survey for the CAA for Science— • http://www.caaspp.org/caa-science- survey.html w -Administration Guide for CAASPP Testing — eb document • TOMS Pre http://www.caaspp.org/rsc/pdfs/CAASPP.TOMS -pre -admin- guide.2018- 19.pdf Overview of the Assessment summative assessment The California Alternate Assessment (CAA) for Science is a n online, based on the California Next Generation Science Standards (CA NGSS) for students with the most significant cognitive disabilities. This assessment offers a developmentally appropriate opportunity for these students to be assessed on their science knowledge, skills, and abilities while providing meaningful information about academic performance to both students and teachers. All local educational agencies (LEAs) with eligible students in grades five, eight , and twelve field test will administer the who m Students in grades ten and eleven for the CAA for Science. Manual 201 8– 19 CAASPP Online Test Administration January 2019  79 2019 Customization Copyright © by the California Department of Education

90 Scie nce Assessments | Administration Information for the California Alternate Assessment (CAA) for Science the LEA recommends to take a science assessment and whose individualized education program (IEP) indicate s an alternate assessment may be assigned to take the C AA for Science. Students in grades five, eight, twelve, or ten or eleven who meet the following eligibility requirements will take the CAA for Science: disability that is described in the student’s cognitive IEP; • the student has a significant the student is learning content derived from the California content standards; and • • the student requires extensive direct individualized instruction and substantial resources to achieve measurable gains in the grade and age- appropriate curriculum. Science The CAA for embedded performance tasks ( PTs) may be administered between January 8, 2019—the date on which the embedded PTs become available—through the final day of the LEA’s instructional calendar or July 15, 2019, whichever comes first . Purpose of the Field Test Embedded PTs xaminer three as The CAA for Science field test i s administered one on one by a test e . A embedded PTs as o be considered PTs t embedded n to all three ign o must s student a PDF that on of each embedde ticipating. D irections for administrati d PT is availabl e as par can be downloade d from the Test Operations Management System (TOMS) . The fiel d test oped of n ewly devel e tw o Core the performance d PTs that measur embedde will assess re deriv ed from the CA NGSS . that a onnectors Content C ted embedded PTs and any other paper materials that have been used for transcribing Prin field test should be collected from test examiners student responses to the CAA for Science . and destroyed securely s Survey , online survey, n optional, Test examiners will be asked to respond to a found on a general CAASPP assessment systems, which they may complete at any time website outside of the after administering the CAA for Science to students. Because the test examiner survey asks general questions and is not student -specific, the test examiner responds to the survey only 15 , 201 9. once. The test examiner survey must be completed before July online. is available The test examiner survey Test Window Test e xaminers may administer all three required CAA for Science performance tasks within the test delivery system at any time during the normal course of instruction between January 8, 2019, and the final day of the LEA’s instructional calendar or July 15, whic hever comes first.  2018– 19 CAASPP Online Test Administration Manual 80 January 2019 the California Department of Education Customization Copyright © 2019 by

91 Science Assessment s | Administration Information for the California Alternate Assessment (CAA) for Science Test Examiner Resources DFA Alert: PDFs when needed to administer an Only download individual following DFA or destroy the embedded PT to a student. Permanently delete DFAs for extended periods. iple administration. Do not download and retain mult Directions for Administration level secure three grade- are found in the administration Directions for CAA for Science PTs that are to be downloaded from TOMS. CAASPP test site coordinators or test embedded examiners should download the CAA for Science embedded PT s by first selecting the Secure Materials [ button in TOMS and then downloading the files for the appropriate grade- ] level assessment. Practice and Training Tests Practice and Training Tests CAASPP Training PTs for the CAA for Science are linked on the Portal . Students can take a practice test using a web browser. Planning Guides Planning guides are available for grade- level CAA for Science assessments in grades five and eight and high school. The guides, which do not include test content, can be used to plan and schedule CAA for Science testing. ndards identify the science sta The guides that are assessed by the CAA for Science during the 2018– 19 school year and provide information about how the embedded performance tasks are to be delivered. The planning guides are linked on the CAASPP CAA web page. User Responsibilities : Table 12 shows the tasks CAASPP users perform for the CAA for Science field test in the CAA for Science Field Test Role Participation 12. User Table Role Task LEA CAASPP • Create the users at schools involved in the CAA for coordinator field test Science • Set up test administrations • Assign student designated supports, accommodations, or unlisted resources Provide training to CAASPP test site coordinators and • test examiners the Review • CAA for Science Administration Planning Guides Manual 201 8– 19 CAASPP Online Test Administration January 2019  81 2019 Customization Copyright © by the California Department of Education

92 | Science Assessments Administration Information for the California Alternate Assessment (CAA) for Science Task Role CAASPP test site • Work with the California Longitudinal Pupil Achievement coordinator Data System coordinator to ensure that students are in the correct grades Assign student designated supports, accommodations, or • unlisted resources • Participate in training provided by the LEA Test examiner • Receive training by completing the CAA Test Administration Tutorial online learning module • Administer each embedded PT at the appropriate time for each student • Take the test examiner survey  2018– 19 CAASPP Online Test Administration Manual 82 January 2019 Copyright © the California Department of Education 2019 by Customization

93 Chapter 6. California Spanish Assessment

94 California Spanish Assessment | Administration Information for the California Spanish Assessment (CSA) Administration Information for the California SA) Spanish Assessment (C in This Section: Resources California Assessment of Student Performance and Progress (CAASPP) • Practice and Training Tests website—linked on the CAASPP Online Practice and Training http://www.caaspp.org/practice- and- training/ Tests Portal at CAASPP Test Administrator and Test Examiner Resources for the Online Practice • -resources/practice- http://www.caaspp.org/ta and Training Tests web page— training.html w eb Spanish Assessment California California Department of Education (CDE) • https://www.cde.ca.gov/ta/tg/ca/csa.asp page— https://www.cde.ca.gov/ta/tg/ca/ w eb page— Resources Accessibility Student • CDE accesssupport.asp • Chapter 9: Scripts for Administering the California Spanish Assessment to Students subsection in this document Overview of the Assessment The California Spanish Assessment (CSA) is an online, linear (nonadaptive) , summative , level assessment for students in grades three through eight and high school who are grade- seeking a measure that recognizes their Spanish reading, writing mechanics, and listening skills. The CSA is a part of the Standards the CAASPP system and replaces -based Tests in Spanish. The CSA is aligned to the Common Core State Standards (CCSS) en Español, which were developed as a joint effort between the San Diego County Office of Education, the Council of a translated and Chief State School Officers, and the CDE. The CCSS en Español are language CCSS for English Language Arts & linguistically augmented version of the English- Literacy. Tests were developed for each grade level from three through eight and one test for all high school grade levels. Test Window The CSA can be administered during a fixed testing window that falls between April 1 and the final day of the local educational agency’s (LEA’s) instructional calendar or July 15, 2019, whichever comes first. The CSA may be given to students in grades three through high school.  2018– 19 CAASPP Online Test Administration Manual 84 January 2019 by the California Department of Education Customization Copyright © 2019

95 California Spanish Assessment | Administration Information for the California Spanish Assessment (CSA) Student Survey assessment. student survey in the The CSA will include a comprise The student survey will assessment -specific demographic questions. asking student the first three questions on each should guide students through this survey The test administrator , as accuracy is paramount. Survey data will be analyzed and summarized once all CAASPP testing windows have closed. Questions Each grade- level test will present the following three demographic -related questions regarding the student at the beginning of the test form. For the first survey question, students should indicate whether or not they received instruction in Spanish, inclusive of content area courses, in the previous school year. 1. ¿Recibiste school year? –19 Did you receive instruction in Spanish in the 2018 educación en español en el año escolar 2018–19? Yes (S í)  No (No)  Which program were you enrolled in? ¿En qué tipo de programa escolar estuviste 2. matriculado/inscrito? de español) Inmersión únicamente para hablantes  One -Way Immersion ( Dual -Language  Inmersión para hablantes de español y de inglés) Immersion (  Developmental (Programas de desarrollo del idioma) Bilingual  (Programas para hispanohablantes Heritage Language or Indigenous Language [hablantes de español]) Español como e., Spanish I, Spanish II, etc.) ( Spanish as  a foreign language (i. ir, Español I, Español II, etc.]) lengua extranjera [es dec (Ninguno de los anteriores)  None of the above What percentage of your school day instruction was provided in Spanish? ¿Qué 3. porcentaje de tu educación diaria recibíste en español?  0– 25% 26– 50%  51– 75%  76– 100%  Test administrators are responsible for knowing this information about the students in their test session prior to administering the assessment. rators Additionally, test administ must guide students to input the appropriate responses for the questions. Manual 201 8– 19 CAASPP Online Test Administration January 2019  85 2019 Customization Copyright © by the California Department of Education

96 California Spanish Assessment | Administration Information for the California Spanish Assessment (CSA) Resources Test Administrator Materials Directions for CSA administration, including instructions on approving tests and the script that must be read prior to test administration, can be found in Chapter 9: Scripts for Administering . These instructions are in Spanish and should the California Spanish Assessment to Students only. Using these instructions to administer a different be used when administering the CSA assessment is a test security incident and must be reported in the Security and Test Administration Incident Reporting System. Student Accessibility Resources designated supports, and The complete list of embedded and non- embedded universal tools, CAASPP Accessibility CSA are listed on the CDE accommodations available for the w eb page. Resources embedded universal tools, Tests will include embedded and non- designated supports, and accommodations. Practice and Training Tests CAASPP Practice and training tests for the CSA are linked on the Practice and Training . Practice tests can be accessed either through the secure browser or through a Tests Portal There is one practice test for each of grades three through eight internet browser. standard and one for all high school grade levels. Scoring guides in English and Spanish are available on the Test Administrator and Test web page. Examiner Resources for the Online Practice and Training Tests  2018– 19 CAASPP Online Test Administration Manual 86 January 2019 the California Department of Education Customization Copyright © 2019 by

97 California Spanish A | ssessment Administration Information for the California Spanish Assessment (CSA) User Responsibilities CSA : 13 shows the tasks CAASPP users perform for the Table 13. User Role Participation in the CSA Table Role Task LEA CAASPP CSA • Create the users at schools involved in the coordinator • Set up test administrations • Assign student designated supports, accommodations, or unlisted resources Assign students to take the CSA • Provide training to CAASPP test site coordinators and test • administrators Watch the operational CSA training video • CAASPP test site Work with the California Longitudinal Pupil Achievement • coordinator Data System coordinator to ensure that students are in the correct grades Assign student designated supports, accommodations, or • unlisted resources the CSA • Assign students to take • Participate in training provided by the LEA Test administrator • Participate in training provided by the LEA • survey questions demographic Review the Guide students through the demographic survey questions • Administer the • CSA Manual 201 8– 19 CAASPP Online Test Administration January 2019  87 2019 Customization Copyright © by the California Department of Education

98 | California Spanish Assessment Administration Information for the California Spanish Assessment (CSA) blank intentionally. This page is left January 2019 88  2018– Manual 19 CAASPP Online Test Administration 2019 by Copyright © Customization the California Department of Education

99 Chapter 7. Using the Test Administ rato r Interface with Summative Assessments

100 | Using the Test Administrator Interface with Summative Assessments ering Summative Assessments General Steps to Take When Administ When Administering General Steps to Take Assessments Summative This chapter describes the steps to take before and after administering the Smarter Balanced Summative Assessments, California Science Test (CAST), and California Spanish Assessment (CSA). • The scripts that are to be read to students taking the Smarter Balanced and CAST are found in Chapter 8: Scripts for Administering Smarter Balanced Summative . These scripts, which are in Assessments and the California Science Test to Students English, are to be read after you have logged on to the Test Administrator Interface. The scripts for administering the CSA are in Chapter 9: Scripts for Administering the • . These scripts, which are California Spanish Assessment to Students in Spanish, are to be read after you have logged on to the Test Administrator Interface. for the Smarter only are to be used chapter 8 The English scripts in Warning: chapter 9 Balanced and CAST. The Spanish scripts in for the only are to be used Do not use the Spanish scripts to administer the Smarter Balanced or CSA. CAST to Spanish speaking English lear ners. Establishing Appropriate Testing Conditions , and test examiners oordinator Test site c s, test administrators work together to should determine the most appropriate testing option(s) and testing environment based on the estimated number of devices available, the number of students in each tested grade, and the and , CAST, time needed to complete each test. For the Smarter Balanced assessments -sized groups is preferable; the California Alternate t esting students in classroom CSA, Assessment sized classroom- (CAA) is delivered one on one. Establishing groups reduces the test test fear and anxiety for the students and facilitates monitoring and control for administrator . However, this also includes setting up testing rooms for students whose ind ividualized education programs (IEPs) or Section 504 plans specify universal tools, designated supports, accommodations, or any combination of these that necessitate testing the students in a separate setting (that is, reading test questions aloud, extended testing time, additional breaks, and so forth). refer to The test administration should be conducted in a secure environment ( the subsection ). Security of the Test Environment Establish procedures to maintain a quiet testing environment throughout the test session, recognizing that some students will finish more quickly than others. If students are allowed to leave the testing room when they finish, explain the procedures for leaving without disrupting others and where they are expected to report once they leave. If students are expected to remain in the testing room until the end of the session, instruct them on what activities they  2018– 19 CAASPP Online Test Administration Manual 90 January 2019 the California Department of Education Customization Copyright © 2019 by

101 Using the Test Administrator Interface with Summative Assessments | stering Summative Assessments General Steps to Take When Admini may engage in after they finish the test. Acce ss to a student’s device should be monitored strictly for types of activities that may be done without violating the security of the tests if other students in the room are still testing. Additional Required Resources ELA ) Arts/Literacy ( Smarter Balanced for English Language During administration of the Smarter Balanced for ELA, students may have access to and adaptive test (CAT) items: additional required resources for computer the following use of Headphones are required for the listening portion of the ELA assessment and for • -to-speech. students requiring text • Scratch paper should be provided for note taking if necessary. Only plain paper or lined paper is appropriate for ELA. to and of the Smarter Balanced for ELA, students may have access During administration additional required resources for performance tasks (PTs): the following use of Headphones are required for some performance tasks and for students requiring text • - to-speech. Scratch paper should be provided for note taking if necessary. Only plain paper or lined • paper is appropriate for ELA. Smarter Balanced for Mathematics of the Smarter Balanced for Mathematics, students may have access to During administration for CAT items: and use of these additional required resources • -to-speech and for students Headphones are required for students requiring text requiring Audio Glossaries. • An embedded calculator is available for some mathematics items in grades six and above. A non- embedded calculator may only be used by students with a documented Smarter plan per guidance provided in the in an IEP or accommodation Section 504 . Balanced Usability, Accessibility, and Accommodations Guidelines Scratch paper is required for all grades. • • Graph paper is required for grades six and above and can be used on all mathematics assessments. CAA for ELA the of the CAA for ELA, students may have access to and use of During administration : additional required resources following While headphones are permissible, the CAA for ELA is administered one on one; it is • recommended that the audio component be played on the device’s or external speakers so that the test examiner may listen along with the student. Manual 201 8– 19 CAASPP Online Test Administration January 2019  91 2019 Customization Copyright © by the California Department of Education

102 Using the Test Administrator Interface with Summative Assessments | nistering Summative Assessments General Steps to Take When Admi CAA for Mathematics of the CAA for Mathematics, students may have access to and use of During administration : additional required resources the following While headphones are permissible, the CAA for Mathematics is administered one on • one; it is recommended that the audio component be played on the device’s or external speakers so that the test examiner may listen along with the student. • Graph paper can be used on all mathematics assessments. CAST of the CAST , students may have access to and use of the following During administration : additional required resources -to-speech, audio glossaries, or Headphones are required for students requiring text • both . An embedded calculator will be available for all items • —students in grade five will use a , ten, eleven, or twelve will use a four -function calculator; and students in grade eight r. scientific calculato Scratch paper (plain, lined, or graph) that is blank on both sides is required for all • as a non -embedded universal tool grades . CSA of the CSA , students may have access to and use of the following During administration : additional required resources Hea dphones are required for the listening • items of the assessment and for students requiring text -to-speech. Scratch paper should be provided for note taking if necessary. Only plain paper or lined • paper is appropriate.  2018– 19 CAASPP Online Test Administration Manual 92 January 2019 the California Department of Education Customization Copyright © 2019 by

103 Using the Test Administrator Interface with Summative Assessments | General Steps to Take When Administering Summative Assessments to Complete Prior to Tasks Summative Test Administration Resources in This Subsection: • California Assessment of Student Performance and Progress (CAASPP) Online Practice and Training Tests Portal web page — http://www.caaspp.org/practice - and- training/ • California Department of Education (CDE) California Longitudinal Pupil Achievement Data System (CALPADS) web page— https://www.cde.ca.gov/ ds/sp/cl/ Test Operations Management System (TOMS) Pre- • Administration Guide for CAASPP Testing web document — http://www.caaspp.org/rsc/pdfs/ pre -admin -guide.2018- 19.pdf CAASPP.TOMS- Local educational agency ( • , CAASPP test site LEA ) CAASPP coordinators coordinators should verify that students s, and test examiners , test administrator are provided the opportunity to practice on the training test and practice test prior to testing. It is highly recommended that – students be provided the opportunity to practice on all the training test and practice test prior to testing. This allows students the opportunity to become familiar with all of the item types, the universal tools, buttons, and any Pra ctice and training tests are allowable designated supports and accommodations. w eb page. on the Practice and Training Tests Portal found Online CAASPP CAASPP test site coordinators should ensure all LEA CAASPP coordinators and • test administrator that can be used n information have logo s and test examiners for the Test Administrator I . nterface step authentication process used when logging on to the – Because there is a two- log systems used in CAASPP testing, test administrators and test examiners should on to the Test Administrator Interface prior to actual test administration using the device and web browser that will be used during testing. The system will send a code, via email, to the username (email address) entered for the test administrator or test examiner user. A new code is sent once for each device and web browser combination. • LEA CAASPP coordinators , CAASPP test site coordinators, test administrator s, student , update , or verify and update should v erify and test examiners . test settings and ation demographic inform 1. Each student must be correctly assigned to his or her LEA, school, and grade in CAASPP test site coordinators will s, and test examiners , test administrator TOMS. demographic student information in CALPADS ensure need to work with LEAs to is current , including Statewide Student Identifiers (SSIDs). Manual 201 8– 19 CAASPP Online Test Administration January 2019  93 2019 Customization Copyright © by the California Department of Education

104 Using the Test Administrator Interface with Summative Assessments | General Steps to Take When Administering Summative Assessments 2. In addition to the correct demographic student information in CALPADS, CAASPP should verify that all s, and test examiners , test admini test site coordinators strator students have accurate test settings configured in TOMS, including designated embedded) for each content supports and accommodations (embedded and non- area prior to testing. , or delete student demographic add , modify coordinators may 3. Only CALPADS information in CALPADS. Note that CALPADS updates may take between 24 and 48 business hours to process in TOMS, and another 24 business hours to process between TOMS and the test delivery system. 4. LEA CAASPP CAASPP test site coordinator s may also set nators and coordi in TOMS for any student for embedded and non- embedded designated supports and accommodations for students who require which the need has been determined and test examiners them as part of an IEP or Section 504 plan. Test administrators test administrator may view student information; however, s and test examiners Test Administrator cannot add, upload, or modify student information. Within the Interface, a default font size and may change the or test examiner test administrator turn off universal tools prior to the start of the test. Any additions IMPORTANT: , or deletions of students and changes , modifications to student test settings in TOMS must be completed before the student can test. made, may take up to 24 business hours to appear in the The update, once Failure to correct test settings before testing could Test Administrator Interface. result in the student’s not being provided with the needed accommodations , at the time , or both designated supports of testing. This is considered a testing irregularity. It is important for anyone with access to student information to remember Note: that student personal information, including the student’s SSID, is confidential. If materials containing student personal information, SSIDs , which includes are distributed to students, these materials must be collected before the students leave the testing room and either securely stored to be used in a subsequent test session or securely destroyed. For additional information about security protocols, refer to the Test Security section of this manual. s should ensure that test administrator s and test CAASPP test site coordinator • examiners have necessary student logo n information. Each student will log , SSID, first name his or her using on to the test delivery system test session s and test , test administrator and a test session ID. Prior to starting a ’s first name must and SSID. This information each student have a record of examiners on process be provided to each student to complete the log must for the Smarter CAST Balanced, . The test examiner completes the logon process for a , and CSA  2018– 19 CAASPP Online Test Administration Manual 94 January 2019 the California Department of Education Customization Copyright © 2019 by

105 Using the Test Administrator Interface with Summative Assessments | General Steps to Take When Administering Summative Assessments student taking the California Alternate Assessment s) for ELA , mathematics , and s (CAA science. It is suggested that the SSID and the student’s first name be printed on a card or piece of paper and distributed to each student just prior to testing to help type it in him or her the device accurately. It is also permissible to include a photo of the student or including the student’s last name with the logon information as additional safeguards to ensure that the students receive the correct logon information. Student information is confidential; therefore, the cards or papers with this information n information is must be kept secure until used during a test session. The loss of logo incident in the at the local level and does not need to be reported considered a security Security and Test Administration Incident Reporting System . Note: When a test administrator or test examiner creates a test session on the Test Administrator Interface, a unique session ID is randomly generated. This session ID must be provided to students before they log on (or entered by the Creating a Test CAA test examiner on behalf of the student). Please refer to the IDs . subsection for more information about how to obtain session Session should ensure that test admin istrators and test CAASPP test site coordinators • Establishing e the additional required resources described in the hav examiners Appropriate Testing Conditions available for student use during test subsection administration. oordinators should ensure CAASPP LEA CAASPP c • test site coordinators understand protocols in the event a student moves to a school within a new LEA . or a school within the same LEA When students move within the state, their data record must be updated with the essary) (if nec student’s new school and district 48 codes in CALPADS at least LEA . hours before the student begins or resumes testing in the new school or , eb page contains links to CALPADS system document CALPADS w The CDE s information for maintaining student data. updates, and other useful CAASPP test site coordinators or test examiners should download the necessary • for ELA and Mathematics Directions for Administration (DFA) versions of the CAA [CAA Secure Materials] and then the button by selecting the [Secure Materials] in button TOMS . Finally, select the [CAA for ELA and Math] button. include the script and prompts for the test examiners to use The DFAs throughout testing, providing administration guidance to test examiners for every routing outcome, based on the staged design of the test. Each DFA possible test can be printed out and DFAs for a grade. contains both ELA and mathematics used as hard copies or accessed as PDFs on the test examiner’s electronic DFAs device. All used for the CAA include secure content and must be stored or destroyed according to appropriate test security procedures. Manual 201 8– 19 CAASPP Online Test Administration January 2019  95 2019 Customization Copyright © by the California Department of Education

106 | Using the Test Administrator Interface with Summative Assessments General Steps to Take When Administering Summative Assessments necessary CAASPP test site coordinators or test examiners should download the • DFA CAA for Science embedded PT versions of the e Secur by first selecting the [ s Materials] . Finally, select then the [CAA Secure Materials] button in TOMS button the [CAA for Science] button. performance task The CAA for Science field test is administered via an online administered after related concepts have been taught that is . Embedded PT DFA s can be downloaded and either accessed on the test examiner’s device or DFA printed out and used as a hard copy. Embedded PT s should be treated as secure materials and must be destroyed securely immediately after use e test security procedures. according to appropriat  2018– 19 CAASPP Online Test Administration Manual 96 January 2019 the California Department of Education Customization Copyright © 2019 by

107 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites Sites or Test Administrat Summative the Use in This Section: Resources • California Assessment of Student Performance and Progress (CAASPP) Portal / http://www.caaspp.org website— Online • Practice and Training Tests Portal web page— CAASPP and -training/ http://www.caaspp.org/practice- CAASPP Test Administrator and Test Examiner Resources for the Online Practice • web page— and Training Tests -resources/practice- http://www.caaspp.org/ta training.html Technical Specifications and Configuration Guide for CAASPP Online Testing • — -and- config- -specs http://www.caaspp.org/rsc/pdfs/CAASPP.tech web document guide.2018- 19.pdf Administration Guide for Test Operations Management System (TOMS) Pre- • Chapter 2: Passwords, Access, and Logon web document — CAASPP Testing -pre -admin- http://www.caaspp.org/rsc/pdfs/CAASPP.TOMS guide.2018- -2.pdf 19.Chapter Overview of the Test Administration Sites Sites for Test Administrators and Test Examiners or The sites for test administrators and test examiners, including the Test Administrat Interface and the Test Administrator Practice and Training Site, are accessed through the CAASPP Portal. To log on to either site, you must have an authorized username and password. If you have not yet received an email with your account information, contact your local educational agency (LEA) CAASPP coordinator or CAASPP test site coordinator (as applicable). This section describes the test administration sites for test administrators and test examiners. Throughout the rest of this user guide, “Test Administrator Site” refers to both the Test Administrator Interface and Test Administrator Training Site. Manual 201 8– 19 CAASPP Online Test Administration January 2019  97 2019 Customization Copyright © by the California Department of Education

108 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites Warning: Do not use the Test Administrator Interface for practice. To practice administering tests, use the Test Administrator Training Site. Both Test Administrator Sites have the same functionality, but the available tests are and different. Tests provided in the Test Administrator Interface are summative, students’ scores on the Smarter Balanced assessments , California Alternate (CAST) Assessments (CAA s), Ca lifornia Science Test , and California Spanish Assessment (CSA) will be transmitted to the California Department of Education (CDE). Test Delivery Application The test delivery application delivers California’s online CAASPP assessments. The following sections describe highlights of online testing in general and the test delivery application in particular. The test delivery application consists of practice sites and summative testing sites. The practice sites function features of the questions in the identically to the summative testing have sites , although the practice and training tests themselves are not adaptive, and students the option of selecting their own designated supports and accommodations . Sites • Practice – Test Adm a llows test administrators and test examiners to inistrator Training Site practice administering tests. a llows students to practice taking tests online and using test Student Training Site – tools. • Testing Sites Operational llows test administrators and test examiners to a Test Administrator Interface – administer summative tests. Student Testing Application – llows students to take CAASPP online assessments. a  2018– 19 CAASPP Online Test Administration Manual 98 January 2019 the California Department of Education Customization Copyright © 2019 by

109 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites Understanding User Roles in This Subsection: Resources • website—http://www.caaspp.org/ CAASPP Portal — / http://www.caaspp.org web document CAASPP User Role Guidance • 17.pdf rsc/pdfs/CAASPP.user- role -guidance.2016- • Technical Specifications and Configuration Guide for CAASPP Online Testing — web document -and- config- http://www.caaspp.org/rsc/pdfs/CAASPP.tech -specs guide.2018- 19.pdf Chapter 2: Passwords, -Administration Guide for CAASPP Testing TOMS Pre • Access, and Logon — web document -pre -admin- guide.2018- http://www.caaspp.org/rsc/pdfs/CAASPP.TOMS 19.Chapter -2.pdf Types of Access web Access to the practice and summative testing sites depends on your user role and browser. • web browser to access Test administrators and test examiners can use any supported either the Test Administrator Training Site or the Test Administrator Interface. Students, test administrators, test examiners, and parents/guardians can use a • web browser or secure browser to access the Student Training Site as supported guests. Students can also sign in to a practice test session created by a test administrator or test examiner. Students use a secure browser to access the student testing application. • the refer to For information about supported oper ating systems and browsers, Technical Specifications and Configuration Guide for CAASPP Online Testing . Using the Single Sign -on System tween Systems Switching Be The Single Sign -On (SSO) system allows you to log on to multiple systems provided by Educational Testing Service and the American Institutes for Research, including TOMS, the Test Administrator Interface, the Test Administrator Practice and Training Site, and the Completion Status reports. After logging on, you can switch between systems without having to log on to and off each system. SSO is designed to ease the logon process and simplify navigation between systems. SSO ng systems: integrates the followi Manual 201 8– 19 CAASPP Online Test Administration January 2019  99 2019 Customization Copyright © by the California Department of Education

110 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites TOMS • Test Administrator Interface • Test Administrator Practice and Training Site • Interim Assessment Hand • Scoring Site Online Reporting System • Completion Status Reports • Reminder: Access to each system and its features is dependent on the access provided by your user role. Warning: Although navigating to another system is easy, it is important to understand how the system operates in order to avoid unintended consequences of switching systems. • If you are administering a test using the Test Administrator Interface or Test Administrator Training Site and you navigate away from it within the same browser tab, your session will stop, and all students in the session will be logged off. You cannot resume your session. You will have to create a new session, and your students will have to log on to the new session to resume testing. Logging On to the Single Sign-On System and select the button representing o to the CAASPP Portal 1. Use an internet browser to g the system you wish to access. manage 2. Select either the [ Test Operations Management System (TOMS) ] button (to administration details of the online Smarter Balanced Summative and Interim All Test Administrator Interface , the [ for Assessments, like student test settings) ] button (to administer and monitor online student assessments), or the Online Tests Practice & Training Tests [ ] button (to practice administering online assessments to students), as shown in Figure 2 . on CAASPP.org ons Figure 2 . Butt —whi 3. Enter your username —in the username field next to the ch is your email address ] person Email Address [ field next to the Password ] icon and your password in the [ in Figure 3), and then select ] lock web form (shown [ Logon ] icon in the [ Password ] button. Secure Logon the [  201 8– 19 CAASPP Online Test Administration Manual 100 January 2019 the California Department of Education Customization Copyright © 2019 by

111 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites The username and password are case sensitive. • • If you have forgotten your password, R efer select the [Forgot Your Password?] link. to the -Administration Guide for CAASPP Testing Chapter 2: Passwords, TOMS Pre for instructions on resetting it. Access, and Logon web form Logon 3. Figure 4. If this is the first time you are logging on using a particular web browser or device, the 4). web form appears ( refer to Figure Enter Code This form appears the first time a particular web browser and device combination is used for logon or if cookies or cache had been deleted. 201 8– 19 CAASPP Online Test Administration Manual January 2019  101 by the California Department of Education 2019 Copyright © Customization

112 ace with Summative Assessments | Using the Test Administrator Interf Use the Summative Test Administrator Sites Enter Code 4. Figure web form a. Retrieve the code included in the system email that was sent. Enter Emailed Code b. Enter the code in the field. This step must be taken within 15 minutes of the email’s receipt. If it is not taken within 15 minutes, skip to step d. c. Select the [ Submi t ] button. ] button for a new code and repeat Resend Code d. If the code expired, select the [ these steps to enter the new code. 5. If you are associated with multiple institutions, an “Important!” message, such as the 5 , appears when you log on. You must select the appropriate institution Figure one in only ] button. You may select Go down list in this message and select the [ from the drop- one institution at a time. to administer tests available for the selected institution. You will only be able • In order to select a different institution, you must log off and then log back on. • Select Institution drop- Figure down list 5 . refer to For information about logging off of the Test Administrator Site, Note: the Logging Off subsection .  201 8– 19 CAASPP Online Test Administration Manual 102 January 2019 the California Department of Education Customization Copyright © 2019 by

113 Using the Test Administrator Interface with Summative Assessments | Use th e Summative Test Administrator Sites About Usernames and Passwords Your username is the email address associated with your account in TOMS. When you are added to TOMS, you receive an email containing a temporary password and a logon link for the CAASPP single sign 30 -on system. To activate your account, you must log on within You do this by entering the code you receive via email after of receiving the email. minutes you enter your username and temporary password and then ing your password. updat Take the following actions if your temporary password has expired or if you have forgotten your password: browser to g internet 1. Use an o to the CAASPP Portal . web Test Operations Management System (TOMS) ] button. The Logon 2. Select the [ form, shown in Figure 6, appears. eb form Figure w 6. Logon 3. Select the [Forgot Your Password?] link if you have forgotten your username or password or the [Request one now] link that answers the question “Do you need a new ” section of the temporary password?” in the Logon web form to reset “First Time User? your temporary password. Figure web form shown in 4. Enter your email address on the Password Reset 7, and then ] button. Submit select the [ 201 8– 19 CAASPP Online Test Administration Manual January 2019  103 2019 Customization Copyright © by the California Department of Education

114 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites w eb form Password Reset 7. Figure to If you did not receive an email containing a temporary password, check your spam folder make sure your email system or program did not categorize it as junk mail. If you still do not an email, contact your CAASPP test site coordinator to make sure you have been receive assigned a TOMS user role. The email you receive expires after 30 minutes. Test Administrator Site Layout 8 displays the layout of the Test Administrator site during an active test session. Figure 2 1 3 4 st Administrator Site layout 8. Te Figure  201 8– 19 CAASPP Online Test Administration Manual 104 January 2019 the California Department of Education 2019 by Copyright © Customization

115 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites Essential Features The following are essential features in the Test Administrator Site: 1. Session ID ] button Select Tests 2. [ ] button Approvals 3. [ table 4. Students in Your Operational Test Session 14 provides an overview of the major features available in the Test Administrator Site. Table 14. Test Administrator Site Features Table Description Feature More Information or How to the subsection Refer to Searches for student information. [ Student Lookup ] . Look Up Students button Approved Displays a list of print requests you approved during the current [ Refer to session. How t o Approve Print Requests the subsection . Requests ] button Refer to Prints your screen. the subsection How to Print Session [ ] Print Session . Information button Help Guide [ Displays an online help guide. ] button the subsection Refer to [ Log Out ] button Logs you off the Test Administrator Site. . How to Stop a Test Session and Log Off Alerts the subsection Refer to Displays alert messages from the CDE. [ ] button . Ale rt Messages Ends the test session. the subsection Stopping a Test Refer to [ Stop Session ] . Session and Logging Off button* Session ID* Displays the unique ID generated for the test session. window. How to the subsection Refer to Test Selection Ope ns the Select Tests ] button [ Start a Test Session . Approvals and Student Test Settings Refer to window. Opens the ] button* [ Approvals to Approve Students for Testing . the subsection How screen information. Updates the on- ] button* Refresh [ [ Displays the testing progress for students in your test session. Students in Your . to Monitor Student Testing How the subsection Refer to ] table** Test Session * Feature appears after you start a test session. ** Feature appears after you approve students for testing. 201 8– 19 CAASPP Online Test Administration Manual January 2019  105 2019 Customization Copyright © by the California Department of Education

116 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites Alert Messages Test up messages on the The CDE can send statewide alerts that appear as pop- Site. To vie Administrator Figure w a record of active alert messages, such as the sample in 9 , select [ ] in the Te Alerts s t Administrator Site banner. Figure Record of alerts 9 . Creating a Test Session e Student Logon Information Provid Each student will log on to the test delivery system using his or her first name, Statewide Student Identifier (SSID), and a test session ID. Prior to starting a test session, test administrators must have a record of each student’s first name and SSID; SSIDs should be checked against what is listed in the Test Administrator Interface or in TOMS before distribution. CAST it is or any combination of these, , CSA, For students taking the Smarter Balanced, the student’s first name be printed on a card or piece of paper suggested that the SSID and and distributed to each student just prior to testing to help him or her type it in the device It is also permissible to include a photo of the student or include the accurately. student’s last name with the logon information as additional safeguards to ensure that This information must be provided to the students receive the correct logon information. each student to complete the logon process. ELA ), mathematics, For students taking the CAAs for English language arts/literacy ( and to the test delivery system to begin. the test examiner must log the student on science, Student information is confidential; therefore, the cards or papers with this information must be kept secure until used during a test session and must be securely shredded (destroyed) when testing has been completed.  201 8– 19 CAASPP Online Test Administration Manual 106 January 2019 the California Department of Education Customization Copyright © 2019 by

117 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites About Test Settings (Universal Tools, Designated Supports, and Accommodations) In the test delivery application, “test settings” include embedded universal tools, designated embedded designated supports and supports, and accommodations, as well as non- accommodations. Thus, “test settings” is used throughout this user guide to refer to all embedded and non- embedded universal tools, designated supports, and accommodati ons, unless otherwise indicated. Test administrators and test examiners may view student test settings in the Test Administrator Interface. Test settings are grouped into categories. The resources displayed differ by content area. Presentation • Literacy Assistance • Resources Integration with Assistive Technology • Visual Assistance Resources • Auditory Assistance Resources • Resources • Concentration Assistance General Testing Resources • Students’ test settings must be reviewed prior to starting a test session. Student test settings must be assigned by the LEA CAASPP coordinator or the CAASPP test site coordinator in TOMS. How to Start a Test Session has logged on to the Test Administrator Interface, After a test administrator or test examiner the ] Select Tests window appears. (If it is not open, select the [ Operational Test Selection button in the upper -right corner of the Test Administrator Interface.) Select a test to create a session. color -codes tests and groups them into Figure 10, , shown in window 1. The Test Selection Summative For example, t Assessments various categories. he Smarter Balanced A test group, such found in the second category and are colored in red. likely are as “Smarter Balanced Summative Assessments,” may include one or more subgroups. . default All test groups and subgroups appear collapsed by 201 8– 19 CAASPP Online Test Administration Manual January 2019  107 2019 Customization Copyright © by the California Department of Education

118 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites w Operational Test Selection 10. Figure indow 2. To select tests for the session, do one of the following: To expand a collapsed test group, select the [Plus] plus ] icon (or [Expand [ -sign • All]) ] icon (or [Collapse All]). [ -sign To collapse a test group, select the [Minus] minus • To s • elect individual tests, mark the checkbox for each test you want to include. ( indicated ] button Start Operational Session the [ 3. Select 11). in Figure  201 8– 19 CAASPP Online Test Administration Manual 108 January 2019 Copyright © the California Department of Education 2019 by Customization

119 | Using the Test Administrator Interface with Summative Assessments Use the Summative Test Administrator Sites window Test Selection in the 11. Expanded tests Figure receive a warning letting you know that you are about to administer a 4. You will in Figure 12), you can either summative assessment. If you select [ OK ] ( indicated continue with the test administration or exit from the Test Administrator Interface if you selected a summative assessment unintentionally. 12. S Figure ummative Assessment confirmation box 109 201 8– 19 CAASPP Online Test Administration Manual January 2019  2019 Copyright © Customization by the California Department of Education

120 Using the Test Administrator Interface with Summative Assessments | Us e the Summative Test Administrator Sites of it . students 5. Make a note of the test session ID and then inform OK ] in the previous step; The session ID is automatically generated upon selecting [ • it is circled in Figure 8. • taking a Smarter Balanced Write the session ID on a place where all students assessment or the CAST can clearly refer to it. If you are administering the CAAs for ELA or mathematics, make a note of it to enter into the test delivery system on behalf of the student. Notes: Write down the session ID in case you accidentally close the browser window or • to transfer your session to another device and must return to the active test need session. If this is the case, you will enter the session ID on the new device, after Transferring Refer to which the session on the original device will be locked out. ( for complete instructions on how to transfer a test session to a a Test Session new device.) • You may have only one session open at a time. You cannot reopen closed sessions, but students can resume a test opportunity • in a new session. Once the LEA’s selected testing window is open, a test administrator or test • examiner with a user role permitting access to all CAASPP summative and interim assessments will have all assessments available for selection. Proceed with caution to ensure that you are selecting the correct assessment type. have • Only users assigned the Test Administrator & Test Examiner role will test category. California Alternate Assessments (CAA) the access to To add tests to an active test session: -rig ht corner of the Test Administrator Site (to the right of the Session ID 1. In the upper ]. Select Tests Figure indicated in 13), select [ you are sure you want to modify the tests in your 2. A confirmation message asks if session. To continue, select [ ]. Yes 3. In the Test Selection window, mark the checkbox for the required test and select [ Add -left corner. ] in the lower to Session Note: You can only add tests individually when the session is active. You cannot remove tests from an active session.  201 8– 19 CAASPP Online Test Administration Manual 110 January 2019 the California Department of Education Customization Copyright © 2019 by

121 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator S ites e Students for Testing How to Approv any designated After students sign in and select tests, you must verify that their settings and and accommodations are correct before approving them for testing. When students supports, Approvals are awaiting approval, the [ ] button next to the Session ID becomes active and appears to bounce until you select it. The number next to this button indicates how many refer to Figure 13). students are awaiting approval ( Students awaiting approval Figure 13. the The Approvals notification updates regularly, but you can also select Note: -right corner to update it manually. ] icon in the upper [ s ] arrow Refresh [ To approve students for testing: Approvals and Student Test Settings ] button. The Approvals (#) 1. Select the [ window appears, displaying a list of students grouped by test ( Figure 14). refer to Appr Figure 14. ovals and Student Test Settings window ails ] icon for that student [ ] eye Det 2. To check a student’s test settings, select the [ (indicated in Figure Test Settings window 14). The student’s information appears in the (refer to Figure 15). This window groups test settings by their area of need. correct test ( or summative a. Review the list to ensure that students are taking the , , English language arts/literacy [ELA] ), the correct content area (mathematics interim of a test (computer ad the correct portion , or Spanish) and science aptive test [CAT] or performance task [PT]). 201 8– 19 CAASPP Online Test Administration Manual January 2019  111 2019 Customization Copyright © by the California Department of Education

122 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites Administering a summative test instead of an interim test is a testing Note: the Security and Test Administration irregularity and needs to be addressed in Incident Reporting System. Administering an interim test instead of a summative test is not a testing irregularity but will require students to retest at a later time to complete summative testing. b. V erify that students have access to and use of the additional required resources in the Establishing Appropriate Testing Conditions subsection specific to each assessment and content area (e.g., scratch paper for all tests, headphones for ELA, six and above). graph paper for mathematics grades c. If any settings are incorrect, report the incorrect test settings to your CAASPP test site coordinator , who will update them as required in TOMS and reschedule the student’s testing. Students should not begin testing until their settings are correct. Figure 15. ; buttons are shown in steps d. Take one of the following ] at the top of the student’s Set To confirm the settings, select [ • Test Setting step 5 refer to ust still approve the student for testing ( . You m ). screen To confirm the settings and approve the student, select the [ • ] Set & Approve button. To return to the Approvals and Student Test Settings window without confirming • Cancel settings, select [ ].  201 8– 19 CAASPP Online Test Administration Manual 112 January 2019 the California Department of Education Customization Copyright © 2019 by

123 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites Figure Test Settings page for a selected student 15. Part of the for each student in the list. 2 3. Repeat step Note: The Approvals and Student Test Settings window does not automatically ] Refresh refresh. To update the list of students awaiting approval, select the [ ). button at the top of the window (shown in Figure 14 4. If you need to deny a student access to testing, do the following (otherwise skip to ): step 5 ] “X” Deny a. Select the [ [ column for that student. Actions ] icon in the student. In the window that appears, enter a brief reason for denying the b. Optional: ] button. The student receives a message explaining the reason for c. Select the [ Deny the denial and is logged off the student testing application. If you deny students entry for a test, they can still request access to that test Note: again. 5. If you want to approve students directly from the Approvals and Student Test Settings window, do one of the following: 201 8– 19 CAASPP Online Test Administration Manual January 2019  113 2019 Customization Copyright © by the California Department of Education

124 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites • ] check mark Approve To approve individual students, select the [ ] icon in the [ Actions column for each student. • To appr displayed in the list, select [ Approve All Students ]. ove all students How to Monitor Student Testing A test administrator may also use the Test Administrator Interface to view the testing progress of any student; because the CAA is administered one on one, it is not necessary for . This a test examiner to monitor student progress in this way will not show test screen questions have been know how many or scores but will let the test administrator questions , although the uestion 4/44) (e.g., q delivered to each student out of the total number possible student will not always receive the number of questions shown. For example, a student might the 44 possible questions. see only 42 of . Student sessions can be sorted by Figure 16 column is called out in Student Status The selecting any of the linked column heads. Figure 16. Moni toring student status in the Test Administrator Interface Table table. To sort the table by a given 15 describes the columns in the dent Status Stu column, select that column header.  201 8– 19 CAASPP Online Test Administration Manual 114 January 2019 the California Department of Education Customization Copyright © 2019 by

125 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites Table Students in Your Operational Test Session 15. Columns in the Table Description Column Student Name the session (as it appears in the The first and last name of the student in California Longitudinal Pupil Achievement Data System [CALPADS] and TOMS). SSID This column displays the SSID associated with the student (in CALPADS and TOMS). Opportunity number for the student’s selected test. Each student has only Opp # summative test. one opportunity for each Test Name of the test the student selected. Current status for each student in the session. The numbers (##/##) listed Status after the status show the student’s progress while he or she is taking the test. The first number is the number of items the student has answered. The second number is the total number of items that will be administered. Note that due to the adaptive nature of CAT assessments, this number may change during testing and may differ between students. This column displays one of the following: Test Settings Default test settings are applied for this test opportunity; there Standard: were no additional test settings assigned in TOMS for this student. One or more of t he student’s test settings or universal tools, Custom: designated supports, or accommodations differ from the default settings. To view the student’s settings for the current test opportunity, select ]. [ [ Details ] perform an available action for an The icons in this column allow you to Actions individual student’s test. ] button to pause a student’s test. When a test pauses, Pause Select the [ this column displays an information button that opens a pop- up message refer to For more information, explaining how the test became paused. section for information on pause time limits and sub the Pause Rules students’ ability to review previously answered items. When a student approved for and assigned the print -on- demand dation requests a printout of a reading passage or other test accommo material, a [ Print ] button will appear in this column. Select the [ Print ] For more button to review and authorize or deny the student’s request. . How to Approve Print Requests information, refer to the subsection 19 CAASPP Online Test Administration Manual January 2019 115 201 8–  Customization Copyright © 2019 by the California Department of Education

126 Using the Test Administrato r Interface with Summative Assessments | Use the Summative Test Administrator Sites Table column of the Status 16 describes the codes in the Students in Your Operational Test table. Session 16. Student Testing Statuses Table Status Description The student started the test and is actively testing. Started The student visited all questions and is currently reviewing answers before Review completing the test. The test passed quality assurance and is undergoing further processing. Reported The student’s test is paused. The time listed indicates how long the test has Paused* been paused. The test was not completed by the end of the testing window and the Expired* tunity expired. oppor The student is awaiting approval for a new test opportunity. Pending* Suspended* The student is awaiting approval to resume a test opportunity. The student started the test and is actively testing. Started Review The student visited all questions and is currently reviewing answers before completing the test. * Statuses marked with an asterisk (*) appear when the student is not actively testing. The student’s row grays out in such cases. table refreshes at regular intervals, but Students in Your Test Session The Note: ] icon in the you can also refresh it manually by selecting the [ Refresh [ ] arrows -right corner. upper How to Pause a Student’s Test You can pause a student’s test via the Actions column in the Students in Your Test Session table ( use Pa refer to Figure 8). For information about pause rules, refer to the subsection Rules . To pause an individual student’s test: column, select the [ Actions 1. In the [ ] parallel line ] icon for that student. Pau se test administrator or test examiner ] to confirm. The Yes [ logs the student off, and 2. Select Actions an information button appears in the column.  201 8– 19 CAASPP Online Test Administration Manual 116 January 2019 the California Department of Education Customization Copyright © 2019 by

127 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites How to Look Up Students You can use the student lookup feature to perform a quick or advanced search for student session cannot remember their information. This is useful if students signing in to your test logon information. first name exactly as it appears with the The student must enter his or her student lookup tool. If the first name contains a space or a special character, it must be . (Refer to the guidelines in the Step 1: Signing Students In entered as it appears subsection for information about entering Unicode characters for special characters such as accented letters.) Warning: Any incorrect student information in the displayed dem ographic fields CALPADS must be updated in by an authorized user. After a student’s updated record appears in TOMS , he or she may begin testing. To perform a quick search: 16), select the Figure at the top of the Test Administrator Interface ( 1. In the banner ] button. Student Lookup [ SSID in the ]. Search results field and select [ SSID Submit SSID 2. Enter a student’s full 17). Figure refer to appear below the search field ( Figure 17. S tudent Lookup: Quick Search 201 8– 19 CAASPP Online Test Administration Manual January 2019  117 2019 Customization Copyright © by the California Department of Education

128 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites To perform an advanced search: ]. Advanced Search ] > [ Student Lookup 1. Select [ down lists. a. Select the appropriate LEA and school from the drop- rade. b. Select the appropriate g c. Optional: Enter all or part of a student’s first or last name. If there are special characters in the student’s first or last name, refer to the guidelines in the Step 1: ion about entering Unicode characters. subsection for informat Signing Students In Figure refer to 2. Select [ Search 18). ]. Search results appear below the search fields ( Figure 18. St udent Lookup: Advanced Search ils column. 3. To view a student’s information, select the [ Deta in the ] icon [ ] ils Deta  118 January 2019 Manual CAASPP Online Test Administration 8– 19 201 Customization Copyright © 2019 by the California Department of Education

129 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites How to Approve Print Requests Before you approve the student’s request to print a test item Warning: or stimulus, ensure that the printer is on and is monitored by staff who have been trained using the test administrator training modules for the test. -on- demand tool can request printouts of test passages and Students using the print questions. When students send print requests, the request notification appears in the 8). The print Students in Your Test Session refer to Figure table ( -on-demand accommodation is available by preapproval only after the LEA CAASPP coordinator contacts the California Technical Assistance Center. To approve print requests: 1. Select the [ Pri column o f the [ Students in Your Test ] printer ] icon in the Actions nt Session Figure 19). window appears ( Student Print Request table. The 19. tudent Print Request S Figure window Student Print 2. Review the print request and take one of the following actions in the Request Figure 19) : window ( ve ] check mark [ ] icon in the Action Appro a. To approve the request, select the [ column. A cover sheet appears in a new browser window. Action the ] icon in [ ] “X” Deny b. To deny the request, select the [ column. In the window that appears, enter a brief reason for denying the request and select the . [ 3 ] button. Do not proceed to step Deny ] to open the printer dialog box. Print 3. In the new window, select [ OK 4. Select [ ] to print the requested test elements. 201 8– 19 CAASPP Online Test Administration Manual January 2019  119 2019 Customization Copyright © by the California Department of Education

130 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites Viewing Approved Requests approved during the current session. You can view a list of every print request you To view approved requests: 1. S elect [ Approved Requests ] from the banner at the top of the Test Administrator refer to window opens ( Print Requests print requests Interface. The Figure 20), listing by student. 2. If you want to print the list of approved requests, select the [ Print ] button (indicated in Figure 20) . rint Requests window Figure 20. P How to Print Test Session Information You can print a snapshot of the Test Administrator Site as it currently appears if you want to . keep a hard- copy record of the session ID or list of approved students To print a snapshot of the page (i.e., screen): 1. In the banner at the top of the Test Administrator Interface, select [ Print Session ]. The device’s print dialog window appears. Print ], ] or [ OK 2. Select the required print settings and then select the approval button ([ web browser). depending on the Tip: Set the print options to landscape mode (horizontal). You can also use your web browser’s “Print Preview” feature to scale content to fit on a single printed page. The Family Educational Rights and Privacy Act policies prohibit the Caution: release of any student’s personally identifiable information. Any printouts must be securely stored and then destroyed when no longer needed.  201 8– 19 CAASPP Online Test Administration Manual 120 January 2019 the California Department of Education Customization Copyright © 2019 by

131 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites Off ging Stopping a Test Session and Log This subsection explains how to stop a test session and log off the Test Administrator Site. How to Stop a Test Session When students finish testing or the current testing period is over, you should stop the test session. Stopping a session automatically logs off all the students in the session and pauses their tests. Once you stop a test session, you cannot resume it. To resume testing students, you must start a new session. Warnings: • If the test administrator or test examiner is using the Test Administrator Interface web browser and navigates to a different or Test Administrator Training Site website, or the Test Administrator Interface is accidentally closed while students are still testing, the session will remain open until it times out after 30 minutes. web browser and navigate The test administrator or test examiner can open the back to the Test Administrator Interface. The test administrator or test examiner will be prompted to enter the active session ID. As a security measure, test administrators and test examiners are automatically • utes of test administrator logged off the Test Administrator Interface after 30 min or test examiner user inactivity and student inactivity in the test session, which will result in closing the test session. If this occurs, the test administrator or test examiner will have to create a new session and the students will have to log on to the new session to resume testing. When starting a new session, the test administrator or test examiner should give the students the new session ID so that they can log on and resume testing. To stop a test session: Students Awaiting Approval corner of the Stop screen, select the [ ] 1. In the upper -right 13). A confirmation message appears. Figure refer to ] icon ( stop sign [ 2. Select ]. The test session stops. OK [ How to Log Off the Test Administrator Site You should log off the Test Administrator Site only after stopping a test session. To log off the Site: Test Administrator 1. In the banner, select [ Log out as Name ]. A warning message appears. CAASPP Portal 2. In the warning message, select [ Yes ]. The front page of the w ebsite appears. 201 8– 19 CAASPP Online Test Administration Manual January 2019  121 2019 Customization Copyright © by the California Department of Education

132 Using the Test Administrator Interface with Summative Assessments | Use the Summative Test Administrator Sites Navigating away from the Test Administrator Site will also log you off. Alert: o access Logging off while a session is in progress stops the session. If you need t online another application while administering tests, open it in a separate web browser tab or window. Accidentally Closing the Browser Window If you accidentally close the browser while students are testing, your session remains open until it tim es out in 30 minutes. To return to the test session in the Test Administrator Site, you must enter the active session ID. If you do not return to the active session within 30 minutes, the test delivery application logs ts. you off and pauses the students’ tes Testing Over Multiple Sessions or Days the Duration and Timing Information for estimated testing times and subsection Refer to estimated test durations. Smarter Balanced Assessments, CAST, and CSA For some tests, particularly the Smarter Balanced PTs, students may be best served by sequential, uninterrupted time that may exceed the time in a student’s schedule. Smarter Balanced recommends that the ELA PT be administered in two sessions, corresponding with Part 1 and Part 2. Students can be provided breaks within each part; however, once a student moves on to Part 2, he or she will not be able to review or revise items in Part 1. For this reason, it is recommended that students complete Part 1 in one test session; Part 2 would ideally be delivered the next school day. For the mathematics PT, Smarter Balanced –120 minutes. recommends that it be administered in one test session of 40 If the test administrator intends to administer the test over the course of multiple days for a student or group of students, he or she may ask students to pause at a designated point. For most tests, there is nothing built into the system to prevent students from progressing from one section of the test to another. In those cases, the test administrator should give the students clear directions on when to pause. For example, test administrators may designate a certain amount of time for testing. Likewise, the end of Part 1 of the ELA PT might be a -erase board, chalkboard, or logical stopping point. This guidance may be written on a dry students can easily another place to which refer . Students will receive a notification when . Figure 21 they reach the end of the segment, like the notification shown in  201 8– 19 CAASPP Online Test Administration Manual 122 January 2019 the California Department of Education Customization Copyright © 2019 by

133 | Using the Test Administ rator Interface with Summative Assessments Use the Summative Test Administrator Sites 21. Sample Figure screen End Segment When testing is resumed on a subsequent day, the test administrator will need to start a new session ID. When instructing the students to log on, test test session and provide a new administrators should read the unitalicized sections of the general script (SAY boxes) to the students from the beginning. CAAs Students typically take approximately 95 cumulative minutes or less to successfully complete a single content area of a CAA. If at any time the test examiner administering the test feels the student is no longer engaged in the test, is not actively participating, or is showing signs of behavioral or functional concerns related to the test, the test examiner can make the the test, the student can pause decision to pause or end the test. If the choice is made to reenter and complete testing once settled, or when the test examiner feels it is appropriate. If the test based on the best interests of the student, the test end the decision is made to examiner will need to advance through the remaining test items until he or she reaches the [ ] button and then submits the test. Stop Transferring a Test Session web browser to another without You can transfer an active test session from one device or progress tests. This is useful in scenarios when your stopping the session or interrupting in- device malfunctions while a session is in progress. If you do not know the active Session ID, you cannot transfer the Warning: session. ensures that you can only administer a test session from one The test delivery application web browser at a time. If you move a test session to a new device, you cannot web browser or device. simultaneously administer the session from the original These instructions apply to both the Test Administrator Interface and Test Administrator Additionally Training Site. , you cannot transfer a session from the Test Administrator to the Test Administrator Training Site or vice versa. Interface 201 8– 19 CAASPP Online Test Administration Manual January 2019  123 2019 Customization Copyright © by the California Department of Education

134 Using the Test Administrator Interface with Summative Asses | sments Use the Summative Test Administrator Sites browser: web To transfer a test session to a new device or 1. While the session is still active on the original device or w eb browser, log on to the Test Administrator Site on the new device or web browser. A Session ID prompt appears. 2. Enter the active Session ID in the text box and press [Enter]. The Test Administrator Site appears, allowing you to continue monitoring your students’ progress. The test web browser automatically closes. session on the previous device or Note: The Session ID prompt appears any time you access the Test Administrator Site during an active session. If you do not wish to return to the active session, ] to create a new session or Start a Different Session you can select [ ] to Logout [ close the active session and log off the Test Administrator Site. Test Expiration CAT Items 45 A student’s CAT remains active until the student completes and submits the test or after the student has begun the test, whichever occurs first. However, it is calendar days five days of recommended that students complete the CAT items portion of the test within starting the designated content area. PT The PT is a separate test that remains active for only 10 calendar days after the student has in . However, Smarter Balanced recommends that students complete the PT begun the PT each content area within three days of starting. A summary of recommendations for the Duration and Timing sub section number of sess ions and session durations is provided in . Information If a student starts the test near the end of the testing window, the student Note: must finish before the administration window officially closes. The test will automatically end on the last day of the scheduled administration window, even if the student has not finished.  201 8– 19 CAASPP Online Test Administration Manual 124 January 2019 the California Department of Education Customization Copyright © 2019 by

135 Using the Test Administrator Interface with Summative Assessments | Following Test Administration Following Test Administration Destroying Test Materials Alert: —the Family Educational Rights and Privacy Act —prohibits the Federal law releas e of any student’s personally identifiable information. Any printed materials must be securely stored and then shredded. Test Security section As a reminder, those printed and paper test materials identified in the must be securely destroyed immediately following each test session and may not be retained from one test session to the next. The only exception to this is scratch paper and graph paper used during the performance task, which should be handled according Handling Secure Printed Materials subsection. to the guidance provided in the Reporting Testing Improprieties, Irregularities, and Breaches Resources in This Subsection: • Security Incidents and Appeals Procedure Guide web document — -appeals http://www.caaspp.org/rsc/pdfs/CAASPP.stairs 19.pdf -guide.2018- • erformance and Progress (CAASPP) Security California Assessment of Student P for Summative Process and Test Administration and Incident Reporting System w.caaspp.org/stairs/ http://ww eb page— Assessments w Throughout testing, ensure that all test security incidents were reported in accordance with Test Security section in this manual (that is, local educational agency the guidelines in the Security the CAASPP dinators or CAASPP test site coordinators must CAASPP coor follow process in the Test Operations and Test Administration Incident Reporting System . Management System 201 8– 19 CAASPP Online Test Administration Manual January 2019  125 2019 Customization Copyright © by the California Department of Education

136 | Using the Test Administrator Interface with Summative Assessments Following Test Administration This page is left blank intentionally. CAASPP Online Test Administration 8– 19 January 2019 126  Manual 201 the California Department of Education Copyright © Customization 2019 by

137 Chapter 8. Scripts for Administering Smarter Balanced Summative Assessments the and California Science Test to Students

138 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Test Directions Overview Test Directions Overview Note s: These instructions on how to begin a test session apply to administration • of the Smarter Balanced Summative Assessments for English language the California Science Test (CAST). arts/literacy (ELA) and mathematics, The scripts that are read to students are in English for the Smarter • Balanced and CAST. You must read the correct script for the test you are administering. • Directions for Administration of the California Alternate Assessments The (CAAs) for ELA and Mathematics and the embedded performance tasks (PTs) for the CAA for Science, which include directions, can be downloaded from the password- protected Test Operations Management System (TOMS). Tasks RECOMMENDATION: Consider printing this section to be used on the day of testing for both the computer adaptive ) and PT portions of each content area test. test (CAT Remember that the CAT and PT portions are considered two unique tests and, as . such, adherence to the process that follows is needed when initiating both tests verify that Before you administer a test session, tasks the following have been completed: Refer to Verify the security of the testing environment prior to beginning a test session. (  . ) Security of the Test Environment the subsection − Student seats are arranged in a way so they cannot see each other’s answers. − All displayed instructional materials (e.g., vocabulary charts, periodic tables, etc.) are covered or taken down. − Post “TESTING IN PROGRESS—DO NOT DISTURB” signs outside of the testing room.  Ensure that students do not have access to digital, electronic, or manual devices (e.g., cellphones, smart watches) during testing. Make sure each testing device or workstation has headphones.  These instructions apply to administration of the Smarter Balanced Summative Assessments mathematics and CAST only . Do not use these instructions for for ELA and Directions for Administration of the CAA administration of the CSA. s for ELA and The Mathematics and the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected TOMS . Manual 128  201 8– 19 January 2019 CAASPP Online Test Administration Copyright © Customization 2019 by the California Department of Education

139 Sc ripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Test Directions Overview Verify that students have access to and use of the additional required resources  specific area (e.g., scr nd content atc h paper for all tests, to each assessment a paper headphones to Refer six and above). grades for mathematics graph for ELA, Resources Required Additional list. the subsection for a complete Recommended: Launch secure browsers on all testing devices before students sit  down to test. Note: W ith the exception of students in grad es six and above with a documented embedded calculator plan to use a non- Section 504 accommodation in an IEP or on a mathematics assessment or students in grades five and eight and high school taking a science assessment, students are expected to use the e mbedded and science calculator for calculator -allowed questions on the mathematics test s. the test administrator To ensure that all students are tested under the same conditions, unless a student is assigned the should adhere strictly to the script administering the test for . The script can be found in non- embedded designated support for Simplified Test Directions wer the test administrator . When asked, should ans in chapter 8 the shaded boxes on pages questions raised by students but should never help the class or individual students with No test items can be read to any student for any content area, unless specific test items. the student is assigned a Read -Aloud non -embedded designated support or accommodation as listed in the Smarter Balanced Usability, Accessibility, and . Accommodations Guidelines must be followed exactly and used each time a test is Please remember that the script administered , except for students who are assigned the Simplified Test Directions non- Smarter Balanced Usability, embedded designated support as described in the . Accessibility, and Accommodations Guidelines resuming a test and the test administrator If the class is is sure that all students are able to on directions again, the test administrator log on without hearing the log may skip the italicized portions of the directions. All directions that to read to students are indicated by the word needs a test administrator “SAY” and are in boxes so they stand out from the regular text. They should be read exactly as they are written, using a natural tone and manner (except for students assigned the s make test administrator . If the -embedded designated support) Simplified Test Directions non made a should a mistake in reading a direction, the test administrator stop and say, “I mistake. Listen again.” Then the direction should be reread. These instructions apply to administration of the Smarter Balanced Summative Assessments and CAST only . Do not use these instructions for mathematics for ELA and The Directions for Administration ; of the CAA s for ELA and administration of the CSA. ics and the embedded performance tasks for the CAA for Science, which include Mathemat directions, can be downloaded from the password- protected TOMS . January 2019 201 8– 19 CAASPP Online Test Administration Manual  129 California Department of Education Customization Copyright © 2019 by the

140 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Test Directions Overview The test administrator should try to maintain a natural classroom atmosphere during the test encourage students to do their administration. Before each test begins, he or she should best. should follow this Any time a student logs on to the testing system, the test administrator on to complete the CAT items or the script. This includes logging PT. These instructions apply to administration of the Smarter Balanced Summative Assessments for ELA and Do not use these instructions for mathematics and CAST only . s for ELA and Directions for Administration of the CAA The administration of the CSA. Mathematics and the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected . TOMS 8– 19 CAASPP Online Test Administration Manual January 2019 130  201 by the California Department of Education 2019 Customization Copyright ©

141 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session a n Online Test Session Administer WARNING The California Department of Education (CDE) recommends that test administrators exercise extreme caution when selecting an assessment for a test session. To help have a differently colored with differentiating the tests, the assessments each -text label. background with a white Online Assessments: —Smarter Balanced Summative Assessments • Red • Indigo—California Alternate Assessments (CAA) —California Science Test (CAST) Brown • Green • —Smarter Balanced Interim Assessments Mint—California Spanish Assessment (CSA) • Online Practice and Training Tests: • Pink —Smarter Balanced practice tests • —Smarter Balanced training tests Purple training s for English language arts/literacy (ELA) and mathematics —CAA Teal • tests practice tests mathematics Blue • —CAA s for ELA and —CAST training tests • Gray • Orange —CAST practice test —CSA training tests Green • If a test administrator has mistakenly selected and administered the summative assessment when intending to administer an interim assessment or practice or training test, the local educational agency (LEA) California Assessment of Student Performance and Progress (CAASPP) coordinator or CAASPP test site coordinator report the incident using the must CAASPP Security and Test Administration Incident process )/Appeals ( STAIRS ng System Reporti . These instructions apply to administration of the Smarter Balanced Summative Assessments mathematics and CAST only . Do not use these instructions for for ELA and The Directions for Administration ; of the CAA s for ELA and administration of the CSA. ics Mathemat and the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected TOMS . January 2019 201 8– 19 CAASPP Online Test Administration Manual  131 by the Customization Copyright © California Department of Education 2019

142 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Adm inister an Online Test Session Open the Test Administrator Interface and Approve Students for Testing— All Assessments You must create a test session before students can log on to the Student Testing Site. In order for a student to take a specific test, it must be included in your test session. This section contains information on how to start a test session, add tests to the session, verify students’ test settings, approve students for testing, and monitor their progress. Warning: Check students’ information and test settings before test sessions. Students who require test settings other than the default must have their settings • updated in the Test Operations Management System (TOMS) before testing begins. For information about test settings, including accommodations, refer to -Administration Guide for TOMS Pre “Chapter 5. Student Test Settings” of the CAASPP Testing and the Smarter Balanced Usability, Accessibility, and Accommodations Guidelines . Both documents are linked on the Student Accessibility Resources and Test Settings w eb page on the CAASPP Portal. If you have a student whose test settings are incorrect, do not approve him or her • for testing. Contact your LEA CAASPP coordinator or CAASPP test site coordinator (as appropriate) to have the student’s information updated in TOMS . and reschedule the student’s testing Beginning an Assessment Follow these instructions to administer the Smarter Balanced Online Summative embedded designated unless a student is assigned the non- and the Assessments CAST support for Simplified Test Directions must create a test session . The test administrator before students can log on to the Student Testing System (but no more than 30 minutes prior or the system will time out). When a test administrator creates a test session, a unique session ID is randomly generated. This session ID must be provided to the students before they log on and should be written down. The basic workflow for administering online tests is as follows: 1. The test administrator selects tests and starts a test session. 2. Students sign in and request approval for tests. 3. The test administrator reviews students’ requests and approves them for testing. nd submit their tests. 4. Students complete a These instructions apply to administration of the Smarter Balanced Summative Assessments mathematics and CAST only . Do not use these instructions for for ELA and The Directions for Administration of the CAA s for ELA and administration of the CSA. Mathematics and the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected TOMS . Manual 132  201 8– 19 January 2019 CAASPP Online Test Administration Copyright © Customization 2019 by the California Department of Education

143 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session 5. The test administrator stops the test session and logs off. For information about the testing process from a student’s perspective, the refer to and Signing In to the Student Testing Site subsections Features of the Student Testing . Application These instructions are for the administration of the Smarter Balanced Warning: Summative Assessments and the CAST only. Using these instructions to administer a different a ssessment is a security incident that must be reported . using the STAIRS /Appeals process Portal on a web browser. 1. Test Administrator CAASPP Navigate to the 2. Test Administrator Select the [ Test Administrator Interface ] button , as shown in Figure 22. Test Administrator Interface for All Online Tests] button Figure 22. [ 3. Test Administrator Log on to the Test Administrator Interface using your sign- in , as shown credentials in Figure 23. These instructions apply to administration of the Smarter Balanced Summative Assessments Do not use these instructions for for ELA and mathematics and CAST only . The Directions for Administration ; of the CAA s for ELA and administration of the CSA. Mathemat ics and the embedded performance tasks for the CAA for Science, which include protected directions, can be downloaded from the password- . TOMS January 2019 Manual 19 CAASPP Online Test Administration 8– 201  133 by the Customization Copyright © 2019 California Department of Education

144 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session Figure Logon screen 23. Test Administrator Interface 4. Test Administrator institutions , an “Important!” If you are associated with multiple message appears when you log on. You must select the appropriate institution from the drop- down list in this message and in Figure , as shown ] button Go select the [ 24. You may only select one institution at a time. You will only be able to administer tests available for the selected institution. In order to select a different institution, you must log off and then log back on. Figure 24. M essage from the Test Administrator Interface These instructions apply to administration of the Smarter Balanced Summative Assessments for ELA and mathematics and CAST only . Do not use these instructions for administration of the CSA. The Directions for Administration of the CAA s for ELA and and the embedded performance tasks for the CAA for Science, which include Mathematics protected TOMS . directions, can be downloaded from the password- 134  8– 19 CAASPP Online Test Administration Manual January 2019 201 Copyright © 2019 Customization by the California Department of Education

145 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session , color -codes in Figure 25 , as shown window Test Selection The 5. Test Administrator test group, such tests and groups them into various categories. A as “Smarter Balanced Summative Assessments,” may include one or more subgroups. All test groups and subgroups appear default The summative assessments are always . collapsed by . found in the second category window perational Test Selection Figure 25. O 6. Test Administrator To select test s for the session, do one of the following: Plus ] a. To expand a collapsed test group, select the [ plus - sign ]) [ ] icon (or [ Expand All Minus b. To collapse a test group, select the [ ] minus -sign [ ] icon (or [ Collapse All ]). ect individual tests, mark the checkbox for each test c. To sel you want to include. These instructions apply to administration of the Smarter Balanced Summative Assessments for ELA and mathematics and CAST only . Do not use these instructions for Directions for Administration administration of the CSA. ; of the CAA s for ELA and The ics Mathemat and the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- . TOMS protected Manual January 2019 19 CAASPP Online Test Administration 8– 201  135 Copyright © by the Customization California Department of Education 2019

146 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session d. To select all the tests in a test group, mark the checkbox for that group. ] button Select the [ Start Operational Session 7. Test Administrator , as shown in Figure 26. Figure perational Test Selection O 26. screen 8. Test Administrator If you are administering a Smarter Balanced assessment, t here will be a warning letting you know that you are about to administer in OK a summative assessment. If you select [ ], as shown Figure 27, you can either continue with the test administration or exit from the Test Administrator Interface if you selected a summative assessment unintentionally. These instructions apply to administration of the Smarter Balanced Summative Assessments for ELA and mathematics and CAST only . Do not use these instructions for administration of the CSA. The Directions for Administration of the CAA s for ELA and and the embedded performance tasks for the CAA for Science, which include Mathematics protected TOMS . directions, can be downloaded from the password- 136  8– 19 CAASPP Online Test Administration Manual January 2019 201 Copyright © 2019 Customization by the California Department of Education

147 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session 27. Smarter Balanced Summative Assessment confirmation box Figure The session ID is Inform students of the test session ID. 9. Test Administrator ] in the previous step. OK automatically generated upon selecting [ , as shown Write the session ID to which on a place in Figure 28, refer . all students can clearly ession ID on the Test Administrator Interface 28. S Figure 10. Test Administrator Read the following SAY box. SAY: ke the [ Smarter Balanced —insert grade, ELA/mathematics, and Today, you will ta CAT/PT; or California Science Test —insert grade five, eight, or high school] test. You will be give n a test session ID that is required to start the test. Before logging on, let’s go over some te st rules. You must answer each question on the screen before selecting NEXT. If you are unsure of an answer, provide what you think is the best answer. If you would like to review that answer at a later time, mark the question for review before going on to the question. You may go back and change the answer during this test session. next These instructions apply to administration of the Smarter Balanced Summative Assessments for ELA and mathematics and CAST only . Do not use these instructions for Directions for Administration administration of the CSA. ; of the CAA s for ELA and The ics Mathemat and the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- . TOMS protected Manual January 2019 19 CAASPP Online Test Administration 8– 201  137 Copyright © by the Customization California Department of Education 2019

148 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session You may pause at any point in the test by selecting PAUSE rather than NEXT after answering a question. Please raise your hand if you need a break and ask permission PAUSE. before selecting Read the following SAY box for the CAST 11. Test Administrator or the CAT portion only. SAY: If you pause your test for more than 20 minutes, you will not be able to go back and change your answers to any questions, even the ones you marked for review. You may check you r answers to any questions before you pause your test. computer 12. Test Administrator Read the following SAY box for the mathematics adaptive test (CAT) in grades six through eleven, the California Science Test (CAST), and the English language arts/literacy (ELA) performance task (PT) only. SAY: Please keep in mind that this test is divided into segments. When you get to the end of a segment, you will be told to review your answers before moving on. Once you submit any of your answers and move on to the next segment, you will not be able to return to the previous segment. the questions in 13. Test Administrator Read the following SAY box and all subsequent SAY boxes to everyone. SAY: Your answers need to be your own work. Please keep your eyes on your own test and remember, there should be no talking. If you have a cell phone, smartwatch, or other approved electronic devices, please turn off the device and put it away. non- If you finish your test early, please raise your hand and sit quietly. 14. Test Administrator ickets Logon tickets may be provided to each student. The logon t should provide the students’ Statewide Student Identifier (SSID). Note that logon tickets are secure testing materials and should be securely destroyed after testing. Log on to the Student Testing Site through the secure browser. 14. Student These instructions apply to administration of the Smarter Balanced Summative Assessments for ELA and mathematics and CAST only . Do not use these instructions for administration of the CSA. The Directions for Administration of the CAA s for ELA and Mathematics and the embedded performance tasks for the CAA for Science, which include protected directions, can be downloaded from the password- . TOMS 138  201 8– 19 January 2019 CAASPP Online Test Administration Manual by the California Department of Education Customization Copyright © 2019

149 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session Direct students to sign in using the Student Sign In w eb form. You 15. Test Administrator do not need to read the italicized sentences to students testing over multiple days who have already heard these instructions at least once. SAY: Now we are ready to log on. Once you have logged on, you will have to wait for me to approve the test before you start. I’ll be checking that you have correctly entered the test session ID and other information. Enter your legal first name, not your nickname, followed by your SSID number. Then enter the test session ID. Raise your hand if you need help typing this information on your keyboard. SAY: Now select SIGN IN. Once you have successfully logged on, you will see a screen with your first name and other information about you. If all of the information on your screen is correct, select YES to continue. If any of the information is incorrect, please raise your hand and show me what is incorrect. These instructions apply to administration of the Smarter Balanced Summative Assessments only . for ELA and mathematics and CAST Do not use these instructions for The Directions for Administration ; of the CAA s for ELA and administration of the CSA. and the embedded performance tasks for the CAA for Science, which include ics Mathemat directions, can be downloaded from the password- TOMS protected . January 2019 201 8– 19 CAASPP Online Test Administration Manual 139  California Department of Education by the 2019 Copyright © Customization

150 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students inister an Online Test Session | Adm Sign in using the Student Sign In 15. Student shown in Figure 29. web form, as 29. Student Sign In web form Figure 16. Test Administrator Ensure that all students have successfully entered their information. These instructions apply to administration of the Smarter Balanced Summative Assessments only . mathematics and CAST Do not use these instructions for for ELA and s for ELA and Directions for Administration of the CAA The administration of the CSA. Mathematics and the embedded performance tasks for the CAA for Science, which include TOMS protected . directions, can be downloaded from the password- 8– 19 201  140 Manual CAASPP Online Test Administration January 2019 by the California Department of Education 2019 Copyright © Customization

151 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session in Figure 30. ], as shown Yes ] or [ No Verify identity by selecting [ 16. Student 30. Is This You? screen Figure 17. Test Administrator Inform students of the test type (for example, ELA CAT, Mathematics PT, science) in which they are participating today. 17. Student Select the test to take. SAY: On the next screen, select the [INSERT NAME OF TEST (i.e., ELA Grade 4 CAT)], and then select [START TEST]. After you have selected your test, you will see a screen with a moving bar and message saying that you are waiting for test administrator approval. Please wait quietly while I check and approve each of your tests. Note: Only the tests that the test administrator selected for the test session for which stude nts are eligible are selectable by students. The sample shown in Figure 31 is from the practice and training test interface. These instructions apply to administration of the Smarter Balanced Summative Assessments mathematics and CAST only . Do not use these instructions for for ELA and ; of the CAA administration of the CSA. The s for ELA and Directions for Administration ics and the embedded performance tasks for the CAA for Science, which include Mathemat protected directions, can be downloaded from the password- . TOMS Manual January 2019 19 CAASPP Online Test Administration 201 8– 141  2019 California Department of Education Customization Copyright © by the

152 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session . in Figure shown Select the test to take, as 18. Student 31 Figure selection screen Your Tests 31. These instructions apply to administration of the Smarter Balanced Summative Assessments mathematics Do not use these instructions for and CAST only . for ELA and s for ELA and Directions for Administration of the CAA The administration of the CSA. Mathematics and the embedded performance tasks for the CAA for Science, which include protected TOMS . directions, can be downloaded from the password- CAASPP Online Test Administration Manual January 2019 142  201 8– 19 by the California Department of Education Copyright © Customization 2019

153 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session . in Figure 32 , as shown Wait for the test administrator’s approval 19. Student dialog box Waiting for TA Approval 32. Figure 20. Test Administrator Approve students to test by selecting the [ Approve ] check mark [ ] icon in the Actions column for individual students or the Approve in Figure 33, [ All Student s for each ] button , as shown in ] icon , as shown [ of tests. Select the [ Details ] eye group Figure 34 , to view the student’s settings for the current test. “Custom” in the Details column indicates the student has been assig ned test settings. Note: If a student’s test settings are incorrect, deny the student, contact the LEA CAASPP coordinator or CAASPP test site coordinator to correct the test settings in TOMS, and test the student on another day. These instructions apply to administration of the Smarter Balanced Summative Assessments Do not use these instructions for for ELA and mathematics and CAST only . The Directions for Administration ; of the CAA s for ELA and administration of the CSA. Mathemat ics and the embedded performance tasks for the CAA for Science, which include . directions, can be downloaded from the password- protected TOMS 8– 201 January 2019 Manual 19 CAASPP Online Test Administration  143 Copyright © 2019 by the California Department of Education Customization

154 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session Figure 33 . screen Approvals and Student Test Settings Figure screen ovals and Student Test Settings Appr . 34 SAY: You will now see a screen asking you to check your test content area and settings. If all the information is correct, you may select YES, START MY TEST. If any of it is incorrect, please raise your hand. These instructions apply to administration of the Smarter Balanced Summative Assessments only . mathematics and CAST Do not use these instructions for for ELA and s for ELA and Directions for Administration of the CAA The administration of the CSA. Mathematics and the embedded performance tasks for the CAA for Science, which include TOMS protected . directions, can be downloaded from the password- CAASPP Online Test Administration 201  144 8– 19 January 2019 Manual by the California Department of Education 2019 Copyright © Customization

155 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session Verify test information and settings , as shown in Figure 35 . 20. Student 35. Figure Is This Your Test? screen Select [ . 21. Student Figure 36 ] to begin testing, as indicated in Yes Figure 36. Is This Your Test? screen 21. Test Administrator If you are administering a Smarter Balanced ELA test, have students run the sound check. These instructions apply to administration of the Smarter Balanced Summative Assessments for ELA and mathematics and CAST only . Do not use these instructions for administration of the CSA. The Directions for Administration ; of the CAA s for ELA and and the embedded performance tasks for the CAA for Science, which include Mathemat ics protected TOMS . directions, can be downloaded from the password- January 2019 201 8– 19 CAASPP Online Test Administration Manual  145 Copyright © Customization California Department of Education by the 2019

156 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session SAY (only for ELA test): Next you should see a screen that prompts you to check that the sound on your computer is working. Put your headsets on and select the icon of the speaker in the circle to hear the sound. If you hear the chime, select [YES]. If not, raise your hand. checks with to-speech, complete the audio 22. Student If beginning a test with text- headphones . Test with text -to-speech audio check , as shown in Figure 37. 37. Figure screen -to-Speech Sound Check Text These instructions apply to administration of the Smarter Balanced Summative Assessments for ELA and mathematics and CAST only . Do not use these instructions for administration of the CSA. The Directions for Administration of the CAA s for ELA and and the embedded performance tasks for the CAA for Science, which include Mathematics protected TOMS . directions, can be downloaded from the password- 146  8– 19 CAASPP Online Test Administration Manual January 2019 201 by the California Department of Education 2019 Copyright © Customization

157 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session complete the audio checks with a test with listening items, If beginning 23. Student T est with the listening headphones. items audio and video check , as shown in Figure 38 . screen Figure 38. Sound and Video Playback Check 22. Test Administrator If audio issues occur, do the following: Ensure headphones are securely plugged in to the correct • jack or USB por t. If the headphones have a volume control, ensure the • volume is not muted. • Ensure that the audio on the device is not muted (often via a control panel or settings window). If the student is still experiencing issues, contact your CAASPP test site coordinator or school technology coordinator. These instructions apply to administration of the Smarter Balanced Summative Assessments Do not use these instructions for for ELA and mathematics and CAST only . The Directions for Administration ; of the CAA s for ELA and administration of the CSA. Mathemat ics and the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- . TOMS protected January 2019 Manual 19 CAASPP Online Test Administration 8– 201  147 by the Customization Copyright © 2019 California Department of Education

158 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Adm inister an Online Test Session Tell students how to take the test. 23. Test Administrator SAY: Before your test appears, you will see a tutorial page listing the test tools and buttons that you may use during the test or that will appear on the test. You can also find this information during your test by selecting the HELP button in the top right corner. When you are ready to begin your test, select BEGIN TEST NOW at the bottom of the page. Begin Test Now Figure 39, 24. Student to begin testing. ], as shown in Select [ Instructions and Help Figure 39. screen Monitoring 24. Test Administrator Continue with the instructions in the next subsections, . Ending a Test Session and Student Progress These instructions apply to administration of the Smarter Balanced Summative Assessments only . for ELA and mathematics Do not use these instructions for and CAST administration of the CSA. The Directions for Administration of the CAA s for ELA and and the embedded performance tasks for the CAA for Science, which include Mathematics . TOMS protected directions, can be downloaded from the password-  148 January 2019 Manual CAASPP Online Test Administration 8– 19 201 Copyright © by the California Department of Education Customization 2019

159 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session Student Progress Monitoring Test Selection It is very important that test administrators monitor student progress throughout the test students are participating in the appropriate content area session. This includes verifying that and type of test (CAT , CAST, or PT). The test administrator monitors the test each student is taking by referring to the table in the Test Students in Your Operational Test Session Administrator Interface, shown in . Note that the list of student names can be sorted Figure 40 by linked (underlined) column headings. In the event a student is taking an incorrect test, the test administrator should pause the student’s test. The test administrator should then instruct the student to log off and log on again to select the correct test. The Test column is called out in Figure 40. 40. Monitoring student progress in the Test Administrator Interface Figure These instructions apply to administration of the Smarter Balanced Summative Assessments for ELA and mathematics and CAST only . Do not use these instructions for administration of the CSA. The Directions for Administration ; of the CAA s for ELA and and the embedded performance tasks for the CAA for Science, which include Mathemat ics protected TOMS . directions, can be downloaded from the password- January 2019 201 8– 19 CAASPP Online Test Administration Manual  149 Copyright © Customization California Department of Education by the 2019

160 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session she logged off If a student is unable to return to and complete the test that he or before it expires in 10 calendar days (PT) or 45 calendar days (CAT or CAST ), the LEA CAASPP coordinator or CAASPP test site coordinator must use the Security and Test Administration Incident Reporting System (STAIRS)/Appeals process to fir st, report the incident, and then, to submit an Appeal to re- open the test. Warning: If the student has already begun to test with incorrect test settings, the TOMS test settings would have to be corrected in by the CAASPP test site coordinator or LEA CA ASPP coordinator. To reset the test, the LEA CAASPP using report the incident coordinator or CAASPP test site coordinator must the STAIRS/Appeals . Then, if warranted, the coordinator would file an process Appeal . The CDE will determine the impact of resetting a test due to incorrect test settings and will either approve or deny a request to reset within two business days of receiving the request. In the rare event that a student starts a test unintentionally (for example, selected a PT instead of a CAT, or selected mathematics instead of ELA), the test’s expiration timeline will be activated. If a student is unable to return to and complete the test before it expires in 10 days (PT) or 45 days, the CAASPP test site coordinator or LEA CAASPP coordinator must /Appeals process to first, report the incident, and then, to submit an Appeal to use the STAIRS re-open the test. Test Security Once students have started the Smarter Balanced assessment or CAST, the test administrator should monitor the room to ensure that all conditions of test security are maintained. If the test administrator or test examiner witnesses or suspects the possibility of a should test security incident, the CAASPP test site coordinator and LEA CAASPP coordinator be contacted immediately in accordance with the security guidance provided in this manual. Student Directions During Testing While the Test Administrator Interface is designed to refresh automatically every minute, the test administrator can refresh it manually at any time by selecting the [ Refresh Now ] button at the top left corner of the page. Warning: ] button to refresh the Test not use the web browser’s [ Refresh Do Administrator Interface. These instructions apply to administration of the Smarter Balanced Summative Assessments mathematics and CAST only . Do not use these instructions for for ELA and The Directions for Administration of the CAA s for ELA and administration of the CSA. Mathematics and the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected TOMS . 150  201 8– 19 CAASPP Online Test Administration Manual January 2019 by the California Department of Education 2019 Copyright © Customization

161 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session If the test administrator notices that a student is off task, the test administrator may say the to keep him or her focused. verbatim, following statement to the student, SAY: break? It is important that you do your best. Do you need to pause the test and take a If a student is concerned about an item, you may direct the student to review a tutorial by following . verbatim script reading the SAY: Try your best and choose the answer that makes the most sense to you. If you are unsure about how a question works, you can review a tutorial by selecting the “i” button on the right side of the screen . Allowing the students to practice on the training test and practice test prior to testing is strongly encouraged to ensure that students are able to manipulate each item type and use the various tools and resources during testing. Always write down the session ID for possible future use: Warnings: • If the test administrator is using the Test Administrator Interface and navigates to website, the session will TOMS or the Test Administrator Practice or Training stop, and all students in the session will be logged off. The session cannot be resumed. A new session will have to be created, and the students will have to log on to the new session to resume testing. When starting a new session, give the new session ID to the students so they can log on and resume testing. • If the Test Administrator Interface or Test Administrator Practice Site web browser is accidentally closed while students are still testing, the session will remain open until it times out after 30 minutes. The test administrator can open the web browser and navigate back to the Test Administrator Int erface. The test administrator will be prompted to enter the active session ID. These instructions apply to administration of the Smarter Balanced Summative Assessments for ELA and mathematics and CAST only . Do not use these instructions for The Directions for Administration ; of the CAA s for ELA and administration of the CSA. and the embedded performance tasks for the CAA for Science, which include Mathemat ics . TOMS protected directions, can be downloaded from the password- Manual 19 CAASPP Online Test Administration 8– 201 January 2019 151  Customization 2019 by the California Department of Education Copyright ©

162 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session As a security measure, test administrators are automatically logged off of the • Test Administrator Interface after 30 minutes of test administrator user inactivity and student inactivity in the test session, which will result in closing the test session. If this occurs, the test administrator will have to create a new session and the students will have to log on to the new session to resume testing. When starting a new session, the test administrators should give the students the new Please note that students will session ID so they can log on and resume testing. not be able to return to CAT or science items from previous sessions, even if the responses were marked for review. Ending a Test Session When there are approximately 10 minutes left in the test session, the test administrator should give students a brief warning. SAY: We are nearing the end of this test session. Please review your answers, including any questions you marked for review now . Do not submit your test unless you have answered all of the questions. [The following should be read for the ELA CAT portion only] If you are working on a set of questions for a reading passage, please finish all of the questions in that set. SAY: If you need additional time let me know. These instructions apply to administration of the Smarter Balanced Summative Assessments for ELA and mathematics and CAST only . Do not use these instructions for administration of the CSA. The Directions for Administration of the CAA s for ELA and and the embedded performance tasks for the CAA for Science, which include Mathematics protected TOMS . directions, can be downloaded from the password- 152  8– 19 CAASPP Online Test Administration Manual January 2019 201 Copyright © 2019 Customization by the California Department of Education

163 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session Taking Smarter Balanced Summative to Students in Grade Eleven ONLY Read Assessments: Alert: Students in grade eleven taking a computer adaptive test (CAT) will get an additional question at the end of their test sessions for both English language arts/literacy (ELA) and mathematics, such as is shown in Figure 41 . This question appears where students are reminded of any test questions flagged for review. • This question is not part of the assessment, but is presented to allow students the option of selecting whether or not they will share their scores on the CAASPP Smarter Balanced Summative Assessments with the California State University (CSU) system and participating California Community Colleges (CCC) as part of you are administering a test to students the Early Assessment Program (EAP). If in grade eleven, please read the text in the next box. Otherwise, skip the text in that box and continue with the test administration. -area • Students must answer this question after each of the content assessments to have the results of that test reported to the CSU and participating CCCs. Agreeing to release the results of one content -area assessment to the EAP is not agreement to release the results of the other content -area assessment; the student must agree individually to both to have both sets of results reported to the EAP. These instructions apply to administration of the Smarter Balanced Summative Assessments only . for ELA and mathematics Do not use these instructions for and CAST The Directions for Administration ; of the CAA s for ELA and administration of the CSA. Mathemat ics and the embedded performance tasks for the CAA for Science, which include . TOMS protected directions, can be downloaded from the password- January 2019 Manual 19 CAASPP Online Test Administration 8– 201  153 2019 California Department of Education Customization Copyright © by the

164 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session Figure 41. Sample EAP question for the CAASPP Smarter Balanced for ELA SAY: EAP SEC TION —READ TO STUDENTS IN GRADE ELEVEN ONLY The Early Assessment Program (EAP) will assist the California State University (CSU) system and the California Community Colleges (CCC) system in providing you information on your readiness for college -level writt en communication and quantitative reasoning prior to starting your senior year. The results are mathematics/ used to determine a student’s placement in appropriate coursework once you have These instructions apply to administration of the Smarter Balanced Summative Assessments only . mathematics and CAST Do not use these instructions for for ELA and s for ELA and Directions for Administration of the CAA The administration of the CSA. Mathematics and the embedded performance tasks for the CAA for Science, which include TOMS protected . directions, can be downloaded from the password- 8– 19 CAASPP Online Test Administration 154 January 2019 201  Manual by the California Department of Education 2019 Copyright © Customization

165 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Administer an Online Test Session been admitted. The release of CAASPP results will not affect a student’s application for admission. Please carefully read the statement presented as the last question in this test session. If you do not wish your results to be sent to the CSU and CCC, select “Do Not or CCC, select “Release” and Release.” If you are considering or plan to enroll at CSU Test then select the [Submit ] button. Your Smarter Balanced results for this test will be provided to both institutions by selecting the Release circle and then submitting. If you be requested to provide a copy of your do not select to release your results, you may results to the campus at a later time. Even if you have already answered this question at the end of an ELA or mathematics test you have already taken, you need to answer it for this test to have the EAP results of b oth tests reported. Your CAASPP Student Report will provide a website, where additional information is available on what your EAP results mean. END OF EAP SECTION Continue Reading to ALL Students : After answering the last item in each segment, each student is presented with a screen prompting him or her to review answers (marked and unmarked) for all items available to the student or prior to submitting the test. Mark for Review is provided as a reminder to a student that he or she had a question or concern about a particular item, but he or she is permitted to review all items —marked or unmarked—within the constraints of the pause rule. After answering the last question, students must submit their tests. If students would like to REVIEW MY review their answers before submitting their test, they should select [ ] and then [ SUBMIT TEST ] after they finish reviewing. Once a student selects ANSWERS [ SUBMIT TEST ], the student will not be able to review answers. SAY: This test session is now over. If you have not finished, select PAUSE, and you will be able to finish at another session. [For the CAT portion and CAST only if the length of time pausing the test is greater than 20 minutes, e.g., the student will continue testing on another day] SAY: Remember, if you are not finished and need to pause your test for more than 20 minutes, you will not be able to go back to the questions from this test session, These instructions apply to administration of the Smarter Balanced Summative Assessments for ELA and mathematics and CAST only . Do not use these instructions for s for ELA and administration of the CSA. The Directions for Administration ; of the CAA ics and the embedded performance tasks for the CAA for Science, which include Mathemat TOMS directions, can be downloaded from the password- protected . 8– Manual January 2019 201 19 CAASPP Online Test Administration 155  by the Customization Copyright © 2019 California Department of Education

166 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Adm inister an Online Test Session including questions marked for review. You will also not have access to the notes you entered in the Digital Not epad. SAY: If you have answered all the questions on your test and have finished reviewing your answers, select SUBMIT TEST. I will now collect any scratch paper or other materials. Stop Session ] to end the test session and pause any Test administrators should select [ student test in the session that is still in progress. When finished, test administrators can log Logout off the Test Administrator Interface by selecting the [ ] button at the top right. Test administrators should also collect any scratch paper (and graph paper for mathematics in up). grades six and Logging Off Interface as this will log you off of other Use caution when logging off the Test Administrator related systems (e.g., Completion Status, Interim Assessment Hand Scoring, and TOMS). To Test Administrator Interface, select the [ log off the right corner of ] button in the top- ut Logo the screen on the Single S ign -On system banner (shown in 42). Figure -On system banner le Sign Figure 42. Sing Your session will be closed, and you will be directed to the CAASPP Portal after you log off. be able to resume the test session. You will not Alert: This scenario also occurs when a test administrator or test examiner navigates to another site from the Test Administrator Interface. If you need to access TOMS or another application, you are encouraged to open a separate web browser window and use that window for other applications. • If a test examiner or test administrator unintentionally logs off the Test Administrator Interface while students are still testing, all in- progress tests will be paused and the students will be logged off. You cannot resume the original session. You will need to log back on, start a new session, and provide the new session ID to students who need to log back on and resume testing. These instructions apply to administration of the Smarter Balanced Summative Assessments for ELA and mathematics and CAST only . Do not use these instructions for administration of the CSA. The Directions for Administration of the CAA s for ELA and Mathematics and the embedded performance tasks for the CAA for Science, which include protected directions, can be downloaded from the password- . TOMS 156  201 8– 19 January 2019 CAASPP Online Test Administration Manual by the California Department of Education Customization Copyright © 2019

167 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Troubleshoot Issues During Testing Troubleshoot Issues During Testing : in This Subsection Resource Technical Specifications and Configuration Guide for CAASPP Online Testing • web document -and- config- -specs http://www.caaspp.org/rsc/pdfs/CAASPP.tech — guide.2018- 19.pdf This section describes how to troubleshoot some situations in which a student cannot connect to a test. Resolving Secure Browser Error Messages This sub section provides possible resolutions for the following messages that students may receive when signing in. The system automatically detects whether a device is Secure Browser Not Detected: • online using the secure browser to access the testi ng system. The system will not permit access to a test other than through the secure browser; under no condition may a student access a test using a nonsecure browser. This message occurs when the online testing • You Cannot Login with This Browser: system cannot determine if the student is taking the test through the correct secure browser. To resolve this issue, ensure the latest version of the secure browser is installed and that the student launched the secure browser instead of a standard web the latest version of the secure browser is already running, then you should browser. If log the student off, restart the device, and try again. • Looking for an Internet Connection: This message occurs when the secure browser cannot connect to the test delivery system. This is most likely to occur if there is a network -related problem. The easiest thing to check is if the network cable is plugged in (for wired connections ) or if the Wi -Fi connection is live (for wireless connections). Also check if the secure browser must use specific proxy settings; if so, those settings must be part of the command that launches the secure browser. These instructions apply to administration of the Smarter Balanced Summative Assessments for ELA and mathematics and CAST only . Do not use these instructions for administration of the CSA. The Directions for Administration ; of the CAA s for ELA and Mathemat ics and the embedded performance tasks for the CAA for Science, which include protected TOMS directions, can be downloaded from the password- . 8– Manual 19 CAASPP Online Test Administration 201 January 2019 157  Customization Copyright © 2019 California Department of Education by the

168 Scripts for Administering Smarter Balanced Summative Assessments and the California Science Test to Students | Troubleshoot Issues During Testing Test Environment Is Not Secure: This message can occur when the secure browser • application running on the device ( refer to the sub section detects a forbidden Security of the Test Environment ). If this message appears on an iPad, ensure that either is or Automatic Assessment Configuration Autonomous Single App Mode (ASAM) Technical Specifications and Configuration Guide for CAASPP enabled. Refer to the Online Testing or c ontact your technology coordinator to determine if you are testing with ASAM . These instructions apply to administration of the Smarter Balanced Summative Assessments only . mathematics and CAST Do not use these instructions for for ELA and s for ELA and Directions for Administration of the CAA The administration of the CSA. Mathematics and the embedded performance tasks for the CAA for Science, which include protected . TOMS directions, can be downloaded from the password- 8– 19 201  158 January 2019 Manual CAASPP Online Test Administration Customization by the California Department of Education 2019 Copyright ©

169 Chapter 9. Scripts for Administering the California Spanish Assessment to Students

170 Scripts for Administering the California Spanish Assessment to Students | Test Directions Overview Test Directions Overview Note s: These instructions on how to begin a test session apply to administration • of the California Spanish Assessment ( ). CSA The scripts that are read to students are in Spanish. You must read the • correct script for the test you are administering. Tasks RECOMMENDATION: Consider pr inting this section to be used on the day of testing. have been completed: tasks the following verify that Before you administer a test session,  Verify the security of the testing environment prior to beginning a test session. ( Refer to ) . Security of the Test Environment the subsection − Student seats are arranged in a way so they cannot see each other’s answers. All displayed instructional materials (e.g., vocabulary charts, etc.) are covered − or taken down. − Post “TESTING IN PROGRESS —DO NOT DISTURB” signs outside of the testing room.  Ensure that students do not have access to digital, electronic, or manual devices (e.g., cellphones, smart watches) during testing. Make sure each testing device or workstation has headphones .   Verify that students have access to and use of the additional required resources specific to each assessment and content area (e.g., scratch paper for all tests, six headphones for English language arts/literacy , graph paper for mathematics grades for a complete list. the subsection and above) Additional Required Resources . Refer to  Recommended: Launch secure browsers on all testing devices before students sit down to test. To ensure that all students are tested under the same conditions, the test administrator for should adhere strictly to the script administering the test unless a student is assigned the non- embedded designated support for Simplified Test Directions. The script can be found in . Do not use these instructions CSA only These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California The Directions for Administration of the CAA s for ELA and Mathematics and Science Test. the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected TOMS . 160  201 8– 19 CAASPP Online Test Administration Manual January 2019 Copyright © by the California Department of Education 2019 Customization

171 Scripts for Administering the California Spanish Assessment to Students | Test Directions Overview boxes in chapter 9 the shaded . When asked, the test administrator should answer questions raised by students but should never help the class or individual students with specific test No test items can be read to any student for any content area, unless the student items. embedded designated support or accommodation as -Aloud non- is assigned a Read listed in the Smarter Balanced Usability, Accessibility, and Accommodations Guidelines . must be followed exactly and used each time a test is Please remember that the script administered , except for students who are assigned the Simplified Test Directions Smarter Balanced Usability, non- embedded designated support as described in the Accessibility, and Accommodations Guidelines . If the cla ss is resuming a test and the test administrator is sure that all students are able to may skip the italicized log on without hearing the logon directions again, the test administrator portions of the directions. All directions that a test administrator needs to read to students are indicated by the word “SAY” and are in boxes so they stand out from the regular text. They should be read exactly as they are written, using a natural tone and manner (except for students assigned the non -embedded designated support). If the test administrator Simplified Test Directions makes a mistake in reading a direction, the test administrator should stop and say, “He hecho un error. Eschuchen de nuevo. ( I made a mistake. Listen again. )” Then the direction should be reread. The test administrator should try to maintain a natural classroom atmosphere during the test administration. Before each test begins, he or she should encourage students to do their best. ator should follow this Any time a student logs on to the testing system, the test administr script. CSA only . Do not use these instructions These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California Science Test. The Directions for Administration of the CAA s for ELA and Mathematics and the embedded performance tasks for the CAA for Science, which include directions, can be protected TOMS . downloaded from the password- 8– Manual 19 CAASPP Online Test Administration 201 January 2019 161  Customization 2019 by the California Department of Education Copyright ©

172 Scripts for Administering the California Spanish Assessment to Students | Administer an Online Test Session Administer an Online Test Session WARNING The California Department of Education (CDE) recommends that test administrators exercise extreme caution when selecting an assessment for a test session. To help with differentiating the tests, the assessments each have a differently colored background with a white -text label. Online Assessments: • —Smarter Balanced Summative Assessments Red • Indigo—California Alternate Assessments (CAA) Brown ia Science Test (CAST) • —Californ —Smarter Balanced Interim Assessments Green • • Mint—California Spanish Assessment (CSA) Online Practice and Training Tests: —Smarter Balanced practice tests • Pink • Purple —Smarter Balanced training tests —CAA Teal • training s for English language arts/literacy (ELA) and mathematics tests practice tests s for ELA and mathematics —CAA Blue • —CAST training tests • Gray • Orange —CAST practice test Green —CSA training tests • If a test administrator has mistakenly selected and administered the summative assessment when intending to administer an interim assessment or practice or training test, the local educational agency (LEA) California Assessment of Student Performance and Progress (CAASPP) coordinator or CAASPP test site coordinator the using report the incident CAASPP Security and Test Administration Incident must . process )/Appeals ( STAIRS Reporting System . Do not use these instructions CSA only These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California The Directions for Administration of the CAA s for ELA and Mathematics and Science Test. the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected TOMS . 162  201 8– 19 CAASPP Online Test Administration Manual January 2019 by the California Department of Education Customization Copyright © 2019

173 Scripts for Administering the California Spanish Assessment to Students | Administer an Online Test Session Open the Test Administrator Interface and Approve Students for Testing— All Assessments You must create a test session before students can log on to the Student Testing Site. In order for a student to take a specific test, it must be included in your test session. This section contains information on how to start a test session, add tests to the session, verify students’ test settings, approve students for testing, and monitor their progress. Warning: Check students’ information and test settings before test sessions. Students who require test settings other than the default must have their settings • updated in the Test Operations Management System (TOMS) before testing begins. For information about test settings, including accommodations, refer to “Chapter 5. Student Test Settings” of the -Administration Guide for TOMS Pre CAASPP Testing and the Smarter Balanced Usability, Accessibility, and Accommod ations Guidelines . Both documents are linked on the Student w eb page on the CAASPP Portal. Accessibility Resources and Test Settings • If you have a student whose test settings are incorrect, do not approve him or her for testing. Contact your LEA CAASPP coordinator or CAASPP test site coordinator (as appropriate) to have the student’s information updated in TOMS . and reschedule the student’s testing an Assessment Beginning CSA unless a student is assigned the non- Follow these instructions to administer the embedded designated support for Simplified Test Directions. must The test administrator create a test session before students can log on to the Student Testing System (but no more than 30 minutes prior or the system will time out). creates a test administrator When a test session, a unique session ID is randomly generated. This session ID must be provided to on and should be written down. the students before they log The basic workflow for administering online tests is as follows: 1. The test administrator selects tests and starts a test session. 2. Students sign in and request approval for tests. 3. The test administrator reviews students’ requests and approves them for testing. 4. Students complete and submit their tests. 5. The test administrator stops the test session and logs off. . Do not use these instructions CSA only These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California Directions for Science Test. Administration of the CAA s for ELA and Mathematics and The the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected TOMS . 19 CAASPP Online Test Administration January 2019 201 Manual 8– 163  by the California Department of Education 2019 Copyright © Customization

174 Scripts for Administering the California Spanish Assessment to Students | Administer an Online Test Session refer to For information about the testing process from a student’s perspective, the subsections Signing In to the Student Testing Site and Features of the Student Testing . Application These instructions are for the administration of the CSA only. Using Warning: these instructions to administer a different assessment is a security incident that must be reported using the STAIRS process . /Appeals CAASPP 1. Test Administrator Navigate to the Portal on a web browser. Online Tests Test Administrator Interface for All the [ Select 2. Test Administrator ] button, as in Figure 43. shown All 43. [T est Administrator Interface for Figure Online Tests] button in 3. Test Administrator Log on to the Test Administrator Interface using your sign- credentials in Figure 44. , as shown These instructions apply to administration of the CSA only . Do not use these instructions for administration of the Smarter Balanced Summative Assessments or the California s for ELA and Mathematics Science Test. The and Directions for Administration of the CAA the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected . TOMS 201 Manual CAASPP Online Test Administration 8– 19  164 January 2019 Copyright © by the California Department of Education Customization 2019

175 Scripts for Administering the California Spanish Assessment to Students | Administer an Online Test Session Figure Logon screen 44. Test Administrator Interface , an “Important!” 4. Test Administrator tiple institutions If you are associated with mul message appears when you log on. You must select the and message down list in this appropriate institution from the drop- Go select the [ 45. You may only in Figure , as shown ] button You will only be able to administer select one institution at a time. tests available for the selected institution. In order to select a different institution, you must log off and then log back on. Figure 45. M essage from the Test Administrator Interface CSA only . Do not use these instructions These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California and The Directions for Administration of the CAA s for ELA and Mathematics Science Test. the embedded performance tasks for the CAA for Science, which include directions, can be protected . TOMS downloaded from the password- 19 CAASPP Online Test Administration 201 8– January 2019 Manual  165 Customization 2019 Copyright © by the California Department of Education

176 Scripts for Administering the California Spanish Assessment to Students | Administe r an Online Test Session , color -code s 5. Test Administrator , as seen in window Test Selection The Figure 46 test group, such tests and groups them into various categories. A may include one or Assessments,” Interim as “Smarter Balanced more subgroups. All test groups and subgroups appear collapsed . by default perational Test Selection window O 46. Figure 6. Test Administrator To select tests for the session, do one of the following: plus - ] Plus a. To expand a collapsed test group, select the [ sign [ ]) Expand All ] icon (or [ Minus b. To collapse a test group, select the [ ] minus -sign ]). [ ] icon (or [ Collapse All ect individual tests, mark the checkbox for each test c. To sel you want to include. d. To select all the tests in a test group, mark the checkbox for that group. CSA only . Do not use these instructions These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California Science Test. The Directions for Administration of the CAA s for ELA and Mathematics and the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- . TOMS protected Manual CAASPP Online Test Administration  166 8– 19 January 2019 201 2019 by the California Department of Education Copyright © Customization

177 | Scripts for Administering the California Spanish Assessment to Students Administer an Online Test Session in , as displayed ] button Start Operational Session the [ Select 7. Test Administrator 47. Figure screen ational Test Selection Oper 47. Figure 8. Test Administrator Inform students of the test session ID. The session ID is OK step. ] in the previous automatically generated upon selecting [ , as shown in Figure 48, i n a place to which all Write the session ID students can clearly refer. the Test Administrator Interface Figure 48. Top of These instructions apply to administration of the Do not use these instructions . CSA only for administration of the Smarter Balanced Summative Assessments or the California Administration of the CAA Science Test. The s for ELA and Mathematics and Directions for the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected TOMS . Manual 19 CAASPP Online Test Administration 8– 201 January 2019  167 Customization 2019 by the California Department of Education Copyright ©

178 Scripts for Administering the California Spanish Assessment to Students | Administer an Online Test Session 9. Test Administrator Read the following SAY box . SAY: en español para el grado [grado]. Yo les n la prueba de campo de California Hoy tomará daré el número de identificación de la sesión que se requiere para iniciar la prueba. . la prueba, revisaremos algunas reglas que hay que seguir Antes de iniciar Debe ]. Si NTE n responder a cada pregunta en la pantalla antes de seleccionar [SIGUIE no está de la respuesta, contesten lo que piens en que es la mejor respuesta. n seguros la pregunta revisar la respuesta más adelante, marquen Si desean antes sarla revi para . P de pasar a la siguiente sección odrán regresar y cambiar la respuesta durante esta parte de la prueba. pausa en cualquier punto de la prueba seleccionando [PAUSA] en Podrán hacer una después de contestar una pregunta. Levante Siguiente lugar de mano si necesit an n la n permiso antes de seleccionar [PAUSA]. un descanso y pida Read the following SAY box and all subsequent SAY boxes to 10. Test Administrator everyone. SAY: Por favor, tengan en cuenta que esta prueba está dividida en secciones. Cuando lleguen al final de una sección, se les pedirá que revisen sus respuestas antes de continuar. Una vez que terminen con sus respuestas y pasen a la sección siguiente, no podrán regresar a ninguna de las preguntas de la sección anterior. ojos en su Sus respuestas deben ser su propio trabajo. Por favor, mantenga n los n, no debe prueba y recuerde n hablar durante la prueba. Si tiene propia n su teléfono celular o smartwatch, deben gua rdarlo y mantenerlo apagado. n su prueba temprano, por favor levanten la permanezcan sentados mano y Si termina en silencio. 11. Test Administrator Logon tickets may be provided to each student. The logon tickets should provide the students’ Student Identifier (SSID). Statewide Note that logon tickets are secure testing materials and should be securely destroyed after testing. . Do not use these instructions CSA only These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California The Directions for Administration of the CAA s for ELA and Mathematics and Science Test. the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected TOMS . 168  201 8– 19 CAASPP Online Test Administration Manual January 2019 by the California Department of Education Customization Copyright © 2019

179 Scr ipts for Administering the California Spanish Assessment to Students | Administer an Online Test Session Log on to the Student Testing Site through the secure browser. 11. Student Direct 12. Test Administrator You eb form. students to sign in using the Student Sign In w do not need to read the italicized sentences to students testing over multiple days who have already heard these instructions at least once. SAY: hayan estamos listos para iniciar la sesión. Cuando Ya n la sesión, tendrá empezado que esperar hasta que yo inicie la prueba antes de comenzar. Estaré comprobando sesión de prueba y el correctamente la identificación de la hayan introducido que resto de la información. Incluyan apodos SSID. de estudiante número , seguido de su legal, no sus su nombre i mano s Levanten la an la identificación para la sesión. A continuación, introduzc ne ayuda para escribir esta información en su teclado. cesitan SAY: Ahora seleccionen erán [SIGN IN]. Cuando se haya iniciado la sesión correctamente, v i toda la i nformación e n la una pa ersonal nt alla c . S on su nombre y más información p i l a información es Yes] para c eleccionen [ pantalla está correcta, s tá ontinuar. S correcta, l in tá incorrecto. o que es nme l uéstre no y m la ma evanten These instructions apply to administration of the Do not use these instructions . CSA only for administration of the Smarter Balanced Summative Assessments or the California The Administration of the CAA Science Test. s for ELA and Mathematics and Directions for the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected TOMS . Manual January 2019 201 8– 19 CAASPP Online Test Administration 169  by the California Department of Education 2019 Copyright © Customization

180 Scripts for Administering the California Spanish Assessment to Students | Administer an Online Test Session 12. Student Sign in using the Student Sign In web form, as shown . 49 in Figure eb form w Student Sign In 49. Figure that all students have successfully entered their 13. Test Administrator Ensure information. CSA only . Do not use these instructions These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California Science Test. and s for ELA and Mathematics Directions for Administration of the CAA The the embedded performance tasks for the CAA for Science, which include directions, can be . TOMS protected downloaded from the password- CAASPP Online Test Administration 201  170 8– 19 January 2019 Manual by the California Department of Education 2019 Copyright © Customization

181 fornia Spanish Assessment to Students | Scripts for Administering the Cali Administer an Online Test Session . in Figure 50 ], as shown Yes ] or [ No Verify identity by selecting [ 13. Student Is This You? 50. Figure screen 14. Test Administrator Inform students of the test type (for example, CSA ) in which they are participating today . SAY: y a continuación En la siguiente pantalla, seleccionen CSA [introducir grado] . Cuando ha yan seleccionado su prueba, verán una pantalla seleccionen [START TEST] con una barra en movimiento y un mensaje diciendo que está n esperando la aprobación del administrador de la prueba. Por favor e speren en silencio mientras compruebo y apruebo cada una de sus pruebas. Note: Only the tests that the test administrator selected for the test session for which eligible are selectable by students. students are These instructions apply to administration of the CSA only . Do not use these instructions for administration of the Smarter Balanced Summative Assessments or the California s for ELA and Mathematics Science Test. The Directions for and Administration of the CAA the embedded performance tasks for the CAA for Science, which include directions, can be TOMS downloaded from the password- protected . 201 Manual January 2019 19 CAASPP Online Test Administration 8– 171  Copyright © by the California Department of Education Customization 2019

182 Scripts for Administering the California Spanish Assessment to Students | Admin ister an Online Test Session 14. Student . in Figure 51 displayed Select the test to take, as Your Tests 51. Figure selection screen . 15. Student Wait for the test administrator’s approval, as displayed in Figure 52 Figure Waiting for TA Approval dialog box 52. to test by selecting the [ 15. Test Administrator students Approve Approve ] check mark column for individual students or the Actions ] icon in the [ 53. Select the [ Approve all Students , as shown in Figure ] button [ ] eye Details [ ] icon , as shown in Figure 54, to view and adjust the student’s settings (universal tools) for the current test column indicates the student opportunity. “Custom” in the Details has been assigned test settings. CSA only . Do not use these instructions These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California Science Test. The Directions for Administration of the CAA s for ELA and Mathematics and the embedded performance tasks for the CAA for Science, which include directions, can be protected TOMS . downloaded from the password- 8– 19 January 2019 Manual CAASPP Online Test Administration 201  172 Customization Copyright © by the California Department of Education 2019

183 Scripts for Administering the California Spanish Assessment to Students | Administer an Online Test Session Note: If a student’s test settings are incorrect, deny the student access to the test, contact th e LEA CAASPP coordinator or CAASPP test site coordinator to correct the test settings in the Test Operations Management System, and test the student on another day. ovals and Student Test Settings screen Figure Appr 53. Figure 54. ovals and Student Test Settings scree n Appr SAY: Ahora verán una pantalla donde se les pide que comprueben la asignatura de su prueba y la configuración. Si toda la información está correcta, pueden seleccionar [SÍ, COMENZAR MI PRUEBA ]. Si algo está incorrecto, por favor levanten la mano. CSA only . Do not use these instructions These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California and The Directions for Administration of the CAA s for ELA and Mathematics Science Test. the embedded performance tasks for the CAA for Science, which include directions, can be protected . TOMS downloaded from the password- 19 CAASPP Online Test Administration 201 8– January 2019 Manual  173 2019 Copyright © by the California Department of Education Customization

184 Scripts for Administering the California Spanish Assessment to Students | Administer an Online Test Session Verify test information and settings, as shown in Figure 55 . 16. Student Figure screen This Your Test? Is 55. 17. Student Select [ Yes ] to begin testing as indicated in Figure 56 . screen Is This Your Test? 56. Figure CSA only . Do not use these instructions These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California and The Directions for Administration of the CAA s for ELA and Mathematics Science Test. the embedded performance tasks for the CAA for Science, which include directions, can be protected . TOMS downloaded from the password- 174  201 8– 19 CAASPP Online Test Administration Manual January 2019 Copyright © by the California Department of Education Customization 2019

185 | Scripts for Administering the California Spanish Assessment to Students Administer an Online Test Session run the sound check. Have students 18. Test Administrator SAY: A continuación, verán una pantalla que les pedirá que comprueben que el sonido en óquense y seleccionen el auriculares los sus computadoras está funcionando. Col icono del altavoz para escuchar el sonido. Si oyen el sonido, selecc ionen [SÍ, PUDE tá incorrecto, levanten REPRODUCIR EL VIDEO Y SU SONIDO] . Si algo es la mano. SAY: Si todo est CONTINUAR]. á correcto, haz clic en [ items Test with 18. Student Complete the listening the audio checks with headphones. audio and video check, as shown in Figure 57 . screen Sound and Video Playback Check 57. Figure These instructions apply to administration of the CSA only . Do not use these instructions for administration of the Smarter Balanced Summative Assessments or the California The Directions for Administration of the CAA s for ELA and Mathematics and Science Test. the embedded performance tasks for the CAA for Science, which include directions, can be TOMS downloaded from the password- . protected 8– 201 January 2019 Manual 19 CAASPP Online Test Administration  175 Customization Copyright © 2019 by the California Department of Education

186 Scripts for Administering the California Spanish Assessment to Students | Administer an Online Test Session If audio issues occur, do the following: 19. Test Administrator in to the correct Ensure headphones are securely plugged • jack or USB port. • If the headphones have a volume control, ensure the volume is not muted. • Ensure that the audio on the device is not muted (often via a control panel or settings window). act your CAASPP issues, cont experiencing If the student is still test site coordinator or school technology coordinator. how to take the test. Tell students 20. Test Administrator SAY: en la pantalla n una página de tutorial que les , verá la prueba que aparezca Antes de permitirá ver las herramientas de puede n utilizar la prueba y los botones que se encontrar esta durante la prueba o que aparecerán en la prueba. También pueden seleccionando el botón de ayuda [?] en la esquina información durante la prueba de la pantalla. superior derecha [COMENZAR LA PRUEBA Cuando est én listo s para comenzar su prueba, seleccionen . en la parte inferior de la pantalla AHORA] CSA only . Do not use these instructions These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California Science Test. The Directions for Administration of the CAA s for ELA and Mathematics and the embedded performance tasks for the CAA for Science, which include directions, can be TOMS downloaded from the password- protected . 176  201 8– 19 January 2019 CAASPP Online Test Administration Manual by the California Department of Education Customization Copyright © 2019

187 Scripts for Administering the California Spanish Assessment to Students | Administer an Online Test Session Select [ Comenzar la prueba ahora ], as shown in Figure 58 , to begin testing. 21. Student 58. Figure Instrucci ones y ayuda screen 21. Test Administrator Walk students through the three demographic survey questions. If that they need to input, help students are unsure of the response them provide the correct answer. Do not let any student move ahead when going through the demographic survey questions. and that Make sure all students are on the same survey question, they are providing the appropriate response. The SAY text for the demographic survey questions that follow is provided in both English and Spanish. SAY: This is the first segment of the test. There are three survey questions you will need to answer with my guidance. These questions are very important. Once we are done with question three of the survey, you may continue testing. CSA only . Do not use these instructions These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California and The Directions for Administration of the CAA s for ELA and Mathematics Science Test. the embedded performance tasks for the CAA for Science, which include directions, can be protected . TOMS downloaded from the password- 19 CAASPP Online Test Administration 201 8– January 2019 Manual  177 Customization 2019 Copyright © by the California Department of Education

188 Scripts for Administering the California Spanish Assessment to Students | Administer an Online Test Session Esta es la primera sección de la prueba. Hay tres preguntas de una encuesta que deberán contestar con mi ayuda. Estas preguntas son muy importantes. Una vez que hayan contestado las tres preguntas, podrán continuar con la prueba. Question one asks, “Did you receive instruction in Spanish in the 2017– 18 school year? ” If you do not know which answer to select, please raise your hand and I will help you with the answer. –18? La pregunta uno dice: « ¿Recibiste educación en español en el año escolar 2 017 » Si no saben qué respuesta elegir, por favor levanten la mano y les ayudaré con la respuesta. Now we are all on question two. Question two asks, “Which program were you enrolled in?” If you do not know which answer to select, please raise your hand and I will help you with the answer. Ahora estamos todos en la pregunta dos. La pregunta dos dice: « ¿En qué tipo de » Si no saben qué respues ta elegir, programa escolar estuviste matriculado/inscrito? por favor levanten la mano y les ayudaré con la respuesta. We are now on question three of the survey. The question asks, “What percentage of your school day instruction was provided in Spanish?” If you do not know which answer to select, please raise your hand and I will help you with the answer. Ahora estamos todos en la pregunta tres de la encuesta. ¿Qué La pregunta tres dice: « porcentaje de tu educación diaria recibiste en español? » Si no saben qué respuesta elegir, por favor levanten la mano y les ayudaré con la respuesta. Now that we have completed the survey, you may proceed with the test. Ahora que hemos completado la encuesta, pueden continuar con la prueba. Continue with the instructions in the next subsections, Monitor ing 22. Test Administrator and Ending a Test Session . Student Progress Monitoring Student Progress Test Selection It is very important that test administrators monitor student progress throughout the test session. This includes verifying that students are participating in the appropriate content area and type of test (CSA). The test administrator monitors the test each student is taking by table in the Test Administrator Students in Your Operational Test Session e referring to th . Do not use these instructions CSA only These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California Directions for Administration of the CAA Science Test. s for ELA and Mathematics and The the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected TOMS . CAASPP Online Test Administration 178  201 Manual January 2019 8– 19 Customization Copyright © 2019 by the California Department of Education

189 Scripts for Administering the California Spanish Assessment to Students | Administer an Online Test Session Interface, shown in . Note that the list of student names can be sorted by linked Figure 59 (underlined) column headings. In the event a student is taking an incorrect test, the test administrator should pause the student’s test. The test administrator should then instruct the student to log off and log on in Figure 59. again to select the correct test. The Te indicated column is st onitoring student progress in the Test Administrator Interface 59. M Figure Note: If a student is unable to return to and complete the test that he or she d off before it expires on July 15, logge the LEA CAASPP coordinator or CAASPP test site coordinator must use the Security and Test Administration Incident /Appeals process in TOMS to first, report the incident, Reporting System (STAIRS) . -open the test Ap peal to re and then, to submit an CSA only . Do not use these instructions These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California and The Directions for Administration of the CAA s for ELA and Mathematics Science Test. the embedded performance tasks for the CAA for Science, which include directions, can be protected . TOMS downloaded from the password- 19 CAASPP Online Test Administration 201 8– January 2019 Manual  179 Customization 2019 by the California Department of Education Copyright ©

190 Scripts for Administering the California Spanish Assessment to Students | Administer an Online Test Session Warning: If the student has already begun to test with incorrect test settings, the test settings would have to be corrected in TOMS by the CAASPP test site PP coordinator or LEA CAASPP coordinator. To reset the test, the LEA CAAS using the report the incident coordinator or CAASPP test site coordinator must . Then, if warranted, the coordinator would file an process STAIRS/Appeals Appeal . The CDE will determine the impact of resetting a test due to incorrect test settings and will either approve or deny a request to reset within two business days of receiving the request. Test Security Once students have started the CSA, the test administrator should monitor the room to ensure that all conditions of test security are maintained. If the test administrator witnesses or suspects the possibility of a test security incident, the CAASPP test site coordinator and LEA should be contacted immediately in accordance with the security CAASPP coordinator guidance provided in this manual. Student Directions During Testing While the Test Administrator Interface is designed to refresh automatically every minute, the ] button test administrator can refresh it manually at any time by selecting the [ Refresh Now of the page. corner at the top left not Do Warning: use the web browser’s [ Refresh ] button to refresh the Test Administrator Interface. e test administrator may say the If the test administrator notices that a student is off task, th verbatim, to keep him or her focused. following statement to the student, SAY: Es importante que lo haga s lo mejor que puedas. ¿Necesitas hacer una pausa en la prueba y tomar un descanso? If a student is concerned about an item, you may direct the student to review a tutorial by verbatim script following reading the . . Do not use these instructions CSA only These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California Directions for Administration of the CAA Science Test. s for ELA and Mathematics and The the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected TOMS . 180  201 8– 19 CAASPP Online Test Administration January 2019 Manual 2019 Copyright © Customization by the California Department of Education

191 | Scripts for Administering the California Spanish Assessment to Students Administer an Online Test Session SAY: tiene je la respuesta que más sentido s y eli lo mejor que pueda zlo Há s . Si no está seguro de cómo funciona una pregunta, puedes revisar el tutorial haciendo clic en el botón "i" en el lado derecho de la pantalla. Allowing the students to practice on the training test and practice test prior to testing is attempt to ensure that students are able to familiarize themselves strongly encouraged to with each item type and use the various tools and supports during testing. Always write down the session ID for possible future use: Warnings: • If the Test Administrator Interface is accidentally closed while students are still testing, the session will remain open until it times out after 30 minutes. The test administrator can open the web browser and navigate back to the Test Administrator Interface. The test administrator will be prompted to enter the active session ID. • If the Test Administrator Interface or Test Administrator Practice Site web browser is accidentally closed while students are still testing, the session will remain open until it times out after 30 minutes. The test administrator can open the web browser and navigate back to the Test Administrator Interf ace. The test ID. administrator will be prompted to enter the active session • As a security measure, test administrators are automatically logged off of the Test Administrator Interface after 30 minutes of test administrator user inactivity and student inactivity in the test session, which will result in closing the test session. If this occurs, the test administrator will have to create a new session and the students will have to log on to the new session to resume testing. When starting a new session, the test administrators should give the students the new session ID so they can log on and resume testing. These instructions apply to administration of the CSA only . Do not use these instructions for administration of the Smarter Balanced Summative Assessments or the California and Science Test. The Directions for Administration of the CAA s for ELA and Mathematics the embedded performance tasks for the CAA for Science, which include directions, can be . downloaded from the password- protected TOMS 8– Manual 201 January 2019 19 CAASPP Online Test Administration 181  2019 Customization Copyright © by the California Department of Education

192 Scripts for Administering the California Spanish Assessment to Students | Administer an Online Test Session Ending a Test Session When there are approximately 10 minutes left in the test session, the test administrator should give students a brief warning. SAY: las Nos estamos acercando al final de esta sesión de prueba. Por favor , ahora revisen o para revisar o que han seleccionad que han completado preguntas n su . No envíe a todas las preguntas. prueba a menos de que haya n contestado SAY: Si están trabajando en un grupo de preguntas para un mismo pasaje de lectura, por todas las preguntas de ese grupo. contesten favor SAY: . Avísenme si necesita n más tiempo After answering the last item in each segment, each student is presented with a screen prompting him or her to review answers (marked and unmarked) for all items available to the student or prior to submitting the test. Mark for Review is provided as a reminder to a student that he or she had a question or concern about a particular item, but he or she is permit ted to review all items —marked or unmarked—within the constraints of the pause rule. After answering the last question, students must submit their tests. If students would like to TERMINAR their test, they can do so by selecti review their answers before submitting ng [ PRUEBA ]. Once student s have reviewed their answers, students must select [ FINALIZAR [ ], the PRUEBA ] to submit their tests. Once students have selected FINALIZAR PRUEBA student will not be able to review his or her answers. SAY: ha terminado. Si no ha Esta sesión de prueba se n terminado la prueba, seleccionen en otra sesión. n terminarla y podrá PAUSA [Para la p rueba CSA: podrá n regresar y cambiar sus respuestas cuando regresen a la prueba, siempre y cuando regrese n a la prueba dentro del tiempo permitido para la Prueba de campo CSA]. a todas las preguntas y ha n terminado de revisar sus respuestas, n contestado Si ha [FINALIZAR PRUEBA] seleccionen materiales. sus geré Ahora reco . . Do not use these instructions CSA only These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California The Directions for Administration of the CAA s for ELA and Mathematics and Science Test. the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected TOMS . 182  201 8– 19 CAASPP Online Test Administration Manual January 2019 by the California Department of Education Customization Copyright © 2019

193 | Scripts for Administering the California Spanish Assessment to Students Administer an Online Test Session the test session and pause any ] to end Stop Session Test administrators should select [ student test in the session that is still in progress. When finished, test administrators can log off the Test Administrator Interface by selecting the [ ] button at the top right. Test Logout administrators should also collect any scratch paper. Logging Off Use caution when logging off the Test Administrator Interface as this will log you off of other related systems (e.g., Completion Status, Interim Assessment Hand Scoring, and TOMS). To Logout log off the Test Administrator Interface, select the [ ] button in the top- right corner of the screen on the Single Sign- On system banner (shown in Figure 60). Figure 60. Sing le Sign -On system banner Your session will be closed, and you will be directed to the CAASPP Portal after you log off. You will not be able to resume the test session. Alert: This scenario also occurs when a test administrator navigates to another site from the Test Administrator Interface. If you need to access TOMS or another application, you are encouraged to open a separate browser window and use that window for other applications. • If a test administrator unintentionally logs off the Test Administrator Interface while students are still testing, all in- progress tests will be paused and the students will be logged off. You cannot resume the original session. You will need to log back on, start a new session, and provide the new session ID to students who need to log back on and resume testing. These instructions apply to administration of the CSA only . Do not use these instructions for administration of the Smarter Balanced Summative Assessments or the California Administration of the CAA Science Test. The s for ELA and Mathematics and Directions for the embedded performance tasks for the CAA for Science, which include directions, can be protected downloaded from the password- . TOMS Manual January 2019 19 CAASPP Online Test Administration 8– 201 183  Customization 2019 by the California Department of Education Copyright ©

194 Scripts for Administering the California Spanish Assessment to Students | Troubleshoot Issues During Testing Troubleshoot Issues During Testing : Resource in This Subsection • Technical Specifications and Configuration Guide for California Assessment of Student Performance and Progress web document — Online Testing and- config- -specs- http://www.caaspp.org/rsc/pdfs/CAASPP.tech guide.2018- 19.pdf This sub section describes how to troubleshoot some situations in which a student cannot connect to a test. Resolving Secure Browser Error Messages This section provides possible resolutions for the following messages that students may receive when signing in. • Secure Browser Not Detected: The system automatically detects whether a device is g system. The system will not using the secure browser to access the online testin permit access to a test other than through the secure browser; under no condition may a student access a test using a nonsecure browser. This message occurs when the online testing You Cannot Login with This Browser: • nnot determine if the student is taking the test through the correct secure system ca browser. To resolve this issue, ensure the latest version of the secure browser is and that the student launched the secure browser instead of a standard web installed browser. If the latest version of the secure browser is already running, then you should log the student off, restart the device, and try again. Looking for an Internet Connection: This message occurs when the secure browser • cannot connect to the test delivery system. This is most likely to occur if there is a network -related problem. The easiest thing to check is if the network cable is plugged in (for wired connections ) or if the Wi -Fi connection is live (for wireless connections). Also check if the secure browser must use specific proxy settings; if so, those settings must be part of the command that launches the secure browser. . Do not use these instructions CSA only These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California Directions for Administration of the CAA Science Test. s for ELA and Mathematics and The the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected TOMS . 201 184 8– 19 CAASPP Online Test Administration Manual January 2019  Customization Copyright © 2019 by the California Department of Education

195 Scripts for Administering the California Spanish Assessment to Students | Troubleshoot Issues During Testing Test Environment Is Not Secure: This message can occur when the secure browser • application running on the device ( to the subsection refer detects a forbidden Security of ). If this message appears on an iPad, ensure that either the Test Environment Autonomous Single App Mode (ASAM) or Automatic Assessment Configuration is enabled. Refer to the Technical Specifications and Configuration Guide for CAASPP or contact your technology coordinator to determine if you are testing Online Testing with ASAM. CSA only . Do not use these instructions These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California Science Test. The Administration of the CAA and s for ELA and Mathematics Directions for the embedded performance tasks for the CAA for Science, which include directions, can be downloaded from the password- protected TOMS . January 2019 8– 19 CAASPP Online Test Administration Manual 201 185  by the California Department of Education 2019 Copyright © Customization

196 | Scripts for Administering the California Spanish Assessment to Students Troubleshoot Issues During Testing blank intentionally. This page is left Do not use these instructions . CSA only These instructions apply to administration of the for administration of the Smarter Balanced Summative Assessments or the California The and s for ELA and Mathematics Directions for Administration of the CAA Science Test. the embedded performance tasks for the CAA for Science, which include directions, can be protected TOMS . downloaded from the password- Manual CAASPP Online Test Administration January 2019 186  201 8– 19 2019 Copyright © Customization by the California Department of Education

197 Chapter 10. Overview of the Student Testing Application

198 Overview of the Student Testing Application | Signing In to the Student Testing Site Signing In to the Student Testing Site in This Section: Resources • California Assessment of Student Performance and Progress (CAASPP) website— http://www.caaspp.org Wikipedia Unicode input • web page—https://en.wikipedia.org/wiki/Unicode_input This section describes the student sign- in process for the student testing application. Students follow this procedure when starting a new test or resuming a paused test. Students must sign in to the appropriate testing site: s: Note • For sessions created in the Test Administrator Interface, students sign in to the student testing application using the secure browser. For sessions created in the Test Administrator Training Site, students sign in to • the Student Training Site. Students can access the Student Training Site via the CAASPP Porta web page, or via their l ] button on the Practice & Training Tests [ secure browser by selecting the [Training Test] link. If students do not know their exact information as it appears in the California Longitudinal Pupil Achievement Data System (CALPADS), you can retrieve it in the ). Test Administra How to Look Up Students the subsection tor Site (refer to Step 1: Signing Students In To sign students in to a test session: Student Sign- 1. Launch the secure browser on the student’s testing device. The web In refer to form appears ( Figure 61).  201 8– 19 CAASPP Online Test Administration Manual 188 January 2019 by the California Department of Education Customization Copyright © 2019

199 | Overview of the Student Testing Application Signing In to the Student Testing Site w eb form Student Sign- 61. Figure In 2. Students enter the following information: a. In the First Name fiel d, students enter their first name as it appears in CALPADS. b. In the SS ID field, students enter their Statewide Student Identifier (SSID) as it appears in CALPADS. c. In the session ID as it appears on the Test field, students enter the Session ID Figure 62). Administrator Site (and indicated in 62. Sa ID mple session Figure ] button. The Sign In 3. Students select the [ page appears (shown in Is This You? Figure 63, on the next page). To enter special characters that appear in a student’s name: 1. If there is a special character in the student’s first name, the student must use the Unicode character equivalent for that character. Follow these guidelines. The Wikipedia Unicode input topic provides more information about entering Unicode characters and contains links to additional resources. • ]. For example, press the [ #### ] + number pad [ Alt Alt ] + keypad : Windows Press [ [0201] to create the “É” in “JOSÉ.” 201 8– 19 CAASPP Online Test Administration Manual January 2019  189 by the California Department of Education Customization Copyright © 2019

200 Overview of the Student Testing Application | Signing In to the Student Testing Site ] until an underlined “U” is displayed, and then key U • Chrome: Press [ Ctrl ] + [ Shift ] + [ in the key sequence for the character. For example, after the underlined “U,” type Space ] to create the “É” in “JOSÉ.” [ 00C9 ] + [ Enter ] or [ Hold the standard character key until the macOS and iOS: • Unicode accent characters are displayed. For example, holding down “A” will provide eight accented versions of the “A.” ] + [ ], and then type the hexadecimal digits. U Shift ], type [ • Linux: Press [ Ctrl Common Student Sign-in Errors The test delivery system generates an error message if a student cannot sign in. The following are the most common student sign- in issues: The student entered the Session ID incorrectly or signed in to Sess ion does not exist: • correctly the wrong site. Verify that the student entered the active Session ID. Also, s verify that both you and the student are using the correct sites. For example, student signed in to the Student Training Site Test cannot access sessions created in the . Administrator Interface of eft corner displayed in the bottom-l 61, a message Figure As shown in Note: the on, the practice site which site the student is or the Student Sign-I n page indicates operational site. I f a student is on the wrong site, he or she can select the button included in the message to proceed to the correct site. Verify that the student has entered his entered correctly: • Student information is not name exactly as it appears in the Student Lookup tool. or her Spaces or accented characters must also be included; special characters in names may be added by typing the Unicode character (for example, by pressing the [Alt] + keypad [0201] to create the “É” in “JOSÉ” on Windows devices) How to Look Up Students the subsection . Refer to for additional information about using Unicode char acters. : used a correct • Student information is not entered correctly Verify that the student -” as had been required in previous years preface the SSID with “CA not SSID and did . If this does not resolve the error, use the Student Lookup tool to verify the student’s for additional information. the sub section How to Look Up Students information. Refer to • The Session ID corresponds to a closed session. Ensure that xpired: Session has e ID and verify that your session is open. For more Session the student enters the correct . refer to ting a Test Session Crea the sub section information about test sessions, Student is not associated with the school: • The student is not associated with your school. student’s school, or you are not associated with the Manual  201 8– 19 CAASPP Online Test Administration 190 January 2019 2019 Customization Copyright © by the California Department of Education

201 Overview of the Student Testing Application | Signing In to the Student Testing Site Step 2: Verifying Student Information 63). Students p age (i.e., screen) appears ( Is This You? After students sign in, the Figure verify their personal information on this page. This You? page Figure Is 63. To verify personal information: Your Tests ]. The Yes select [ 1. If all the information is correct, students page appears . on the next page) (Figure 64 2. If any of the information displayed is incorrect, the student must not proceed with testing. CAASPP test site coordinator that ]. You must notify your No The student should select [ the student’s information is incorrect. Incorrect student demographic information must be updated before the Warning: Tell your local educational agency (LEA) CAASPP student begins testing. coordinator or CAASPP test site coordinator (as appropriate) that the student’s Students should not begin testing until their information needs to be updated. information is correct. Step 3: Selecting a Test refer The Your Tests page (i.e., screen) displays all the tests that a student is eligible to take ( California Alternate Assessment [ to Figure 64). Students CAA ]) (or the test examiner for the can only select tests that have been selected by the test administrator or test examiner and still n eed to be completed. 201 8– 19 CAASPP Online Test Administration Manual January 2019  191 by the California Department of Education Customization Copyright © 2019

202 Overview of the Student Testing Application | Signing In to the Student Testing Site Tests are shaded in a light color with an arrow icon pointing at the test name. When starting a new test opportunity, the arrow is solid. When resuming a test opportunity, the arrow is striped. Your Tests page ple m 64. Sa Figure To select an available test: select the required test name. The request is or the test examiner (for a CAA) 1. Students , and the for approval sent to the test administrator or test examiner Waiting for Approval message appears ( Figure 65). Wa Figure 65. message pproval iting for TA a Manual  201 8– 19 CAASPP Online Test Administration 192 January 2019 2019 Customization Copyright © by the California Department of Education

203 Overview of the Student Testing Application | Signing In to the Student Testing Site 2. If a student’s required test is not displayed, the student should select [ ]. Back to Login You should verify the test session includes the correct tests and add additional tests, if necessary. Step 4: Verifying Test Information After you approve the student for testing, the student (or the test examiner, for a CAA) should verify the test information and settings on the refer to page (i.e., screen) ( Your Test Settings Choose Settings ). screen that is available in a practice test for the Figure 66 page Settings hoose 66. C Figure To verify test information: , for a CAA) Select select [ (or the test examiner 1. If the settings are correct, students ]. ]. Go Back select [ , for a CAA) (or the test examiner 2. If the settings are incorrect, students The test administrator or test examiner must report the incorrect test settings to the CAASPP test site coordinator, who will update them as required in the Test Operations Management System and reschedule the student’s testing. After a student’s test settings are corrected, the student must sign in and request approval again. 201 8– 19 CAASPP Online Test Administration Manual January 2019  193 by the California Department of Education Customization Copyright © 2019

204 Overview of the Student Testing Application | Signing In to the Student Testing Site to-Speech Check Step 5a: Text- Text The page (i.e., screen) appears if a student has the text -to-Speech Sound Check -to- speech (TTS) setting ( Figure 67). On this page, students verify that TTS is working properly on their device. Students can only use TTS within a supported secure browser. t-to-Speech Sound Check p age 67. Tex Figure Note: TTS is enabled, students may adjust the volume, pitch, and rate When [ settings once the test begins by selecting the Settings menu (cog wheel icon, ]) -right corner of the screens. They do not have to exit the test to do so. in the upper To check TTS functionality: TTS S 1. Students select the [ peaker [ ] speaker ] icon and listen to the audio. ]. I heard the voice oice is clearly audible, students select [ a. If the v b. If the voice is not clearly audible, students adjust the settings using the sliders and TTS Speaker select the [ ] icon again. ] c. If students still cannot hear the voice clearly, they select [ I did not hear the voice and close the secure browser. You can work with students to adjust their audio or the sub headset settings (for more information, section refer to Troubleshooting Audio ). They can sign in again when the issue is resolved. Issues Skip TTS Check [ -to-speech, students select d. To continue without testing text ]. Manual  201 8– 19 CAASPP Online Test Administration 194 January 2019 2019 Customization Copyright © by the California Department of Education

205 Over view of the Student Testing Application | Signing In to the Student Testing Site Check Step 5b: Sound and Video Sound and Video Playback The Check page (i.e., screen) appears for tests with listening questions ( refer to Figure 68). Students verify that they can see the sample video and hear the sample audio. The screen is in Spanish for the California Spanish Assessment. ideo Playb ack Check page Figure 68. Sound and V settings: and video To check audio by sel listen to the audio play the video and 1. Students [ Play ecting the [ ] ] arrow icon . the sound and video quality, students do one of the following: 2. Depending on I could play a. If the student can see the video and hear the sound, students select [ ]. The the video and sound page appears. Instructions and Help I could not b. If the student cannot see the video and hear the sound, students select [ page appears, giving Video Playback Problem ]. The play the video or sound students two options: ]. They will return Sound and Video • Students can select [ to the Try Again page. Check Playback Log Out ]. You should troubleshoot the device and Student • s can select [ and video. headphones or move the student to another device with working audio 201 8– 19 CAASPP Online Test Administration Manual January 2019  195 by the California Department of Education Customization Copyright © 2019

206 Overview of the Student Testing Application | Signing In to the Student Testing Site Troubleshooting Audio Issues Prior to testing, ensure that audio is enabled on each device and that headsets are functioning correctly. If audio issues occur, do the following: Ensure headphones are securely plugged in to the correct jack or USB port. • • If the headphones have a volume control, ensure the volume is not muted. Ensure that the audio on the device is not muted • (often via a control panel or settings . window) or CAASPP test site coordinator If the student is still experiencing issues, contact your school technology coordinator. Step 6: Viewing Test Instructions and Starting the Test age (i.e., screen) is the last step of the sign- Instructions and Help in process ( refer to The p Figure 69). Students may review this page to understand how to navigate the test and use test tools. nstructions and Help page Figure 69. I CAASPP Online Test Administration Manual  196 January 2019 201 8– 19 2019 Customization Copyright © by the California Department of Education

207 | Overview of the Student Testing Application Signing In to the Student Testing Site To proceed and begin the test: ]. The test opportunity Begin Test Now 1. After reviewing this page, students select [ officially begins or resumes.  197 January 2019 201 8– Manual 19 CAASPP Online Test Administration by the California Department of Education 2019 Copyright © Customization

208 Overview of the Student Testing Application | Features of the Stu dent Testing Application Student Testing Application of the Features Resources in This Section: Department of Education Accessibility web page— Student (CDE) California • https://www.cde.ca.gov/ta/tg/ca/accesssupport.asp Accessibility Guide for California Ass essment of Student Performance and • CAASPP) Online Testing Progress ( — web document -guide.2018- http://www.caaspp.org/rsc/pdfs/CAASPP.accessibility 19.pdf and the available testing This section describes the layout of the student testing application are Note that tools and features vary depending on the test being taken; not all tools tools. available for all tests. Test Layout shows the main sections of the layout for a test page (i.e., screen) that includes a Figure 70 stimulus . Number Stem Stimulus Section Response Area 70. Test lay Figure out A test page can include the following sections: section displays the global navigation and tool buttons. The banner • Global Menu The drop- down list, test information, [ ] Help Questions above the Global Menu displays the System Settings ] cog wheel ] button. [ ] button, and [ question mark [ ? A stimulus • The Stimulus section appears only for questions associated with a stimulus. is a reading passage or other testing material (such as a video or graphic) that students rev iew in order to answer associated questions. This section contains the stimulus content (such as a reading passage or graphic), context menu, and expand passage tool. (also known as “items”) The . section contains one or more test questions Question • Each question includes a number, context menu, stem, and response area. the sub refer to For more information about the global menu and context menus, section . Using Menus and Tools Manual  201 8– 19 CAASPP Online Test Administration 198 January 2019 2019 Customization Copyright © by the California Department of Education

209 Overview of t he Student Testing Application | Features of the Student Testing Application Test Tools test delivery system ’s available tools. This section provides an overview of the shows the primary features and tools available in the Figure 71 . test delivery system Test tools [End Test] button Context menu Navigation buttons [Help] and [Volume] Questions icons (when present) - down list drop 71. Test pa ge Figure ols are available for all tests, while others are only available for a Note: Some to , or type of question. accommodation particular subject, Table application’s available global tools and context list the student testing 17 and Table 18 menu tools, respectively. 201 8– 19 CAASPP Online Test Administration Manual January 2019  199 by the California Department of Education Customization Copyright © 2019

210 Overview of the Student Testing Application | Features of the Student Testing Application Table 17. Global Tools Global Tool Instructions ] Help window, select the [ Guide Help screen - To view the on Help question mark [ ] icon in the upper -right corner. Calculator ] icon. [ ] Calculator [ screen calculator, select the To use the on- - To look up definitions and synonyms in the Merriam Webster Dictionary dictionary or thesaurus, select the [ Dictionary ] open book [ ] icon. screen formula - To view the on science reference (also called ) Formula [ sheet, select ] in the global menu. Formula A student moves an on - screen horizontal line that surrounds each Line Reader line of text with shading after selecting the [ Line Reader ] line icon. To temporarily cover a distracting area of the test page: Masking 1. Select the [ Masking ] square [ ] icon. 2. Select and drag across t he distracting area. 3. Release the mouse button. ] again. 4. To close the Masking tool, select [ Masking To open the Notes ] paper/pencil screen notepad, select the [ - on Notes [ ] icon. ] in the Periodic Table To view the on - screen periodic table, select [ Periodic Table global menu. Demand has been enabled, on Print - on - - To print a test item when Print - Demand ] printer [ ] icon. Print Page select the [ Print Passage Print Passage To print a passage, select the [ ] icon. [ ] printer Manual  201 8– 19 CAASPP Online Test Administration 200 January 2019 2019 Customization Copyright © by the California Department of Education

211 Overview of the Student Testing Application | Features of the Student Testing Application Instructions Global Tool - to - To adjust audio volume, or the rate and pitch of speech for Text System wheel Speech during the test, select the [ ] cog Settings System Settings [ ] icon in the upper -right corner. Transcripts To view a transcript of the audio content for the current test page, select the [ Transcripts ] button in the global menu. The text in transcripts can be read by a screen reader. Zoom buttons ] Zoom In enlarge the text and images on a test page, select the [ To [ magnifying glass (plus) ] icon. You can zoom in up to four ] magnifying glass Zoom Out levels. To undo zooming, select [ [ ] icon. (minus) Table 18. Context Menu Tools and Stimulus Tools Tool Name Instructions American Sign (ASL) via To view audio content translated into American Sign Language Language screen video, select from the context American Sign Language an on- (ASL) menu. To view ASL videos: 1. From the context menu, select Amer ican Sign Language ]. [ If only one • ASL video is available, the video opens automatically. If multiple ASL videos are available, sign language • [ ] icons Select the icon for appear next to the test content for each video. the test content you wish to translate into ASL. Closed Questions and stimuli with audio elements automatically display closed Captioning captions for students testing with the appropriate accommodations. 201 8– 19 CAASPP Online Test Administration Manual January 2019  201 by the California Department of Education Customization Copyright © 2019

212 Overview of the Student Testing Application | Features of the Student Testing Application Tool Name Instructions Expand Item Test questions (items) in the right pane of the testing screen can be expanded to cover the width of the whole screen. This universal tool must be set by the test administrator. When used in conjunction with the —that is, Expand Passage is not turned Expand Passage universal tool —this tool can be used to expand either off by the test administrator (This tool is the default expansion tool in the passages or questions. California Alternate Assessments for English language arts/literacy [ELA] and mathematics.) To expand the passage section, select the right arrow icon • ] [ below the global menu. To collapse the expanded passage section, ] in the upper [ select the left arrow icon -right corner. • ] [ To expand the question section, select the left arrow icon below the global menu. To collapse the expanded question section, -left corner. ] in the upper [ select the right arrow icon By default, students can expand and contract the passage in the left Expand pane to cover the width of the whole screen. Passage To expand the passage section, select the [ ] Expand Passage • double arrow [ ] icon. The section will expand and overlap the question section for easier readability. To collapse the expanded section, select the [ • Expand Pas ] sage [ ] icon again. double arrow Glossary (Word To open the glossary, select a word or phrase that has a border around List) it. Highlight To highlight text, select the text on the screen and then select Highlighter Reset from the context menu. To remove highlighting, select Selection Highlighting from the context menu. Text in images cannot be highlighted. This tool is not available while the Line Reader tool is in use. Highlighting only persists during a single test session. from the context Mark for Review To mark a question for review, select Mark for menu. The question number displays a flap in the upper -right corner, like Review : ] icon [ Flag ] appears next to the number. The ; and a [ this ” drop -down list displays “(marked) Questions for the selected question. Manual  201 8– 19 CAASPP Online Test Administration 202 January 2019 2019 Customization Copyright © by the California Department of Education

213 Overview of the Student Testing Application | Features of the Student Testing Application Instructions Tool Name Notepad Notepad from the context menu. To enter notes for a question, select [ ] note After entering a note, the [ Notepad ] icon appears next to the question number. You can acces s your notes only for a question on that question’s test page. Print Item To send a print request for an individual question, select from Print Item the [ ] the context menu. After sending the request, Printer ] icon [ appears next to the question number. response questions, students can cross out an answer - For selected Strikethrough option to focus on the options you think might be correct. There are two options for using this tool: 1. Option A: a. To activate Strikethrough mode, open the context menu and . Strikethrough select b. Select each answer option to strike out. c. To deactivate Strikethrough mode, press the [Esc] key or select outside the question’s response area. 2. Option B: Strikethrough a. Right -click an answer option and select . - Speech To listen to passages and questions, select a speak option from the - to Text context menu. To view a short video demonstrating how to respond to a particular orial Tut question type, select Tutorial from the context menu. Using Menus and Tools screen tools. This section describes how to use the global and context menus to access on- This section also provides further details for using some of the student testing application tools. Note: Students can access tools using a mouse or keyboard commands. For refer to information about keyboard commands, . 21 Table 201 8– 19 CAASPP Online Test Administration Manual January 2019  203 by the California Department of Education Customization Copyright © 2019

214 Overview of the Student Testing Application | Features of the Student Testing Application About the Global Menu The global menu at the top of the test page contains navigation buttons on the left and tools Figure 72). refer to on the right ( Test tools Navigation buttons Figure al menu 72. Glob To open a test tool in the global menu: 1. Select the button for the tool. The selected test tool activates. About the Context Menus Each test question may include several elements, such as the question number and answer Figure 70). The context menu for each element (including the stimulus) only refer to options ( Figure 73 refer to and Figure 74). contains tools applicable to that element ( ontext menu for questions Figure 73. C ontext menu for answer options 74. C Figure 201 8– 19 CAASPP Online Test Administration  204 January 2019 Manual 2019 Customization Copyright © by the California Department of Education

215 Overview of the Student Testing Application | Features of the Student Testing Application Opening a Context Menu for Passages and Questions and elements or by selecting elements -clicking Students can access context menus by right then selecting the context menu button. To access the context menu for a passage or question: 1. Select the [ Con text Menu -square [ ] icon in the upper -right corner of the ] lined passage or question. The context menu opens. 2. Select a tool to activate or open it. Opening a Context Menu for Answer Options Students can use the context menu to access tools for answer options in a multiple- choice or multiselect question. To access an answer option’s context menu: 1. To open the context menu, do one of the following: If you are using a -click an answer option. , right -button mouse two • -button mouse single • If you are using a , select an answer option while pressing the [Ctrl] key. , select an answer option while pressing the [Alt] key. Chromebook If you are using a • , tap the answer option and then tap the [ Context Menu tablet ] If you a • re using a icon; this selects the answer option until you select a different option. 75 shows a context menu for Figure 2. Select a tool from the context menu. a sample ELA item. ontext menu for ELA item (sample screen) 75. C Figure 201 8– 19 CAASPP Online Test Administration Manual January 2019 205  by the California Department of Education Customization Copyright © 2019

216 Overview of the Student Testing Application | Features of the Student Testing Application About the Masking Tool Students who have masking as a designated support can use the Masking tool to allow them Figure 76). distracting ( to hide sections of the test page they find est page with masked area 76. T Figure To mask an area of a test page: ] in the global menu. The button becomes Masking 1. To activate the Masking tool, select [ orange. 2. Select and drag across the distracting area of the test page using the mouse (desktop or laptop) or your finger (tablet). 3. Release the mouse button or lift your finger. The selected area becomes dark gray. The tool remains active until you deactivate it. To deactivate the masking tool: ] in the global menu again. The button becomes green. Any masked Masking 1. Select [ areas remain on the screen until you remove them. To remove a masked area from a test page: ed area. Note that this does -right corner of a mask ] in the upper X delete 1. Select the [ not any masked areas on the screen. Manual  201 8– 19 CAASPP Online Test Administration 206 January 2019 2019 Customization Copyright © by the California Department of Education

217 Overview of the Student Testing Application | Features of the Student Testing Application er Tool About the Line Read -screen horizontal line that surrounds each line of text with shading A student moves an on Line Reader after selecting the [ 77). To move the line reader, Figure ] line icon (indicated in the student selects (clicks) anywhere on the next line to be shaded. Figure 77. L ine Reader This universal tool applies to both items and passages. • Selecting an answer option with the line reader universal tool also will cause an option • such as a radio button or check box to be selected. If the student selects the “Option B” radio button in a vertical list of answer options, − selecting (clicking) Option B’s text will both shade the line of text in the line reader and select that answer option as the student’s response to the test question (Figure 78). Students must select a line of text away from a radio button answer option—in a passage or the test question, for example—to unselect the selected line as the focus of the line reader universal tool. However, that answer option is still student’s response unless or until the student selects a different selected as the option. Figure 78. Line Reader with a radio button If the student selects the “Option E” check box in a vertical list of answer options, − tion E’s text will both shade the line of text in the line reader selecting (clicking) Op select that answer option as one of the student’s responses to the test question and dents must select a line of text away from a check box answer (Figure 79). Stu option—in a passage or the test question, for example—to unselect the selected line as the focus of the line reader universal tool. However, that answer option is still 201 8– 19 CAASPP Online Test Administration Manual January 2019  207 by the California Department of Education Customization Copyright © 2019

218 Overview of the Student Testing Application | Application Features of the Student Testing udent’s responses unless or until the student selects the selected as one of the st check box to unselect it. a check box e Reader with Figure 79. Lin -to-Speech (TTS) About Text Students testing with TTS can listen to passages, questions, and answer options ( refer to when using the secure browser and for operational testing 80). TTS is only available Figure only when assigned as an embedded accommodation (ELA reading passages) or designated items) . TTS is only available for the support (mathematics , ELA, and California Science Test web browser. practice tests in conjunction with a supported Chrome or Firefox the refer to TTS, configuring For information about Accessibility Guide for CAASPP Online . Testing Figure 80. Speak tool options for questions To listen to content with the TTS tool: • To listen to a passage, students open the passage context menu and select a Speak option. Students can also select a portion of text to listen to, such as a word or phrase. To do this, students select the text, open the passage context menu, and select Speak Selection . Manual  201 8– 19 CAASPP Online Test Administration 208 January 2019 2019 Customization Copyright © by the California Department of Education

219 Overview of the Student Testing Application | Features of the Student Testing Application When listening to passages, students can pause TTS and then resume it at Alert: However, this feature is not available on mobile the point where it was paused. devices. Students testing on mobile devices can resume a paused TTS passage by selecting the remaining text to be read aloud and selecting Speak Selection from the context menu. To listen to a question or answer options, students open the question context menu and • select one of the following Speak options: − To listen only to the question, students select Speak Question . − Speak -choi ce question and all answer options, students select To listen to a multiple . Question and Options To listen only to an answer option, students select the answer option and then select − -click the answer from the context menu. Students could also right Speak Option select option and . Speak Option Text Response Formatting Toolbar , students can use In addition to the standard test tools described in the sub section Test Tools a formatting toolbar for part 2 of the ELA performance task (PT) above the response field for refer to 81). The formatting toolbar allows students to apply text response questions ( Figure processing features. styling to text and use standard word- with Formatting toolbar 81. Text response question Figure Note: -right corner of the response field displays the word count and The lower character count for the student’s response. 201 8– 19 CAASPP Online Test Administration Manual January 2019  209 by the California Department of Education Customization Copyright © 2019

220 Overview of the Student Testing Application | Features of the Student Testing Application 19 provides an overview of the formatting tools available. Table 19. Description of Formatting Tools Table Description of Function Tool italicize , or underline selected text. Bold , Remove formatting that was applied to the selected text. Insert a numbered or bulleted list. a line of selected text. Indent indent of text. Decrease selected text. Cut selected text. Copy Paste copied or cut text. Undo the last edit to text or formatting in the response field. the last undo action. Redo to identify potentially misspelled words in the spell check Use language down list allows you to set a response field. The drop- for this tool. Add special char in the response field. acters response items that require a student to enter Spanish The CSA includes constructed- - and lower -case accented characters such as ¿, ¡ , and upper -case ñ, and upper - and lower characters . To assist the student with entering Spanish characters, the test delivery system display of the necessary Spanish characters, which allows a student includes a shortcut to a display of characters is shown in Figure 82. to accurately provide their response. This January 2019  201 8– 19 CAASPP Online Test Administration Manual 210 by the California Department of Education Customization Copyright © 2019

221 Overview of the Student Testing Application | Features of the Student Testing Application 82. Select Special Character window Figure Spell Check The spell check tool identifies words in the ELA PT response field that may be misspelled (refer to Figure 83). ll Check tool Figure 83. Spe To use spell check: down list, if necessary. 1. Select a language for the spell check tool from the drop- 2. In the toolbar, select the [ ] icon. Potential [ ] a -b- c l Check Spel ly incorrect words change color and become underlined. 3. Select a misspelled word. A list of suggestions appears. 4. Select a replacement word from the list. If none of the replacement words are correct, close the list by selecting anywhere outside it. -b- [ ] icon ] a c again. the [ 5. To exit spell check, select Spell Check The spell check tool does not identify misspelled words in real time (as they Alert: are typed on the screen). In order to check for misspelled words, the student must enable spell check mode. All words that are potentially misspelled will be indicated. The spell check menu will display the most likely alternatives based on the misspelled word. 201 8– 19 CAASPP Online Test Administration Manual January 2019  211 by the California Department of Education Customization Copyright © 2019

222 Overview of the Student Testing Application | Features of the Student Testing Application Special Characters characters , accented characters, and other symbols Students can add mathematical to their ELA performance task responses . To add a special character: 1. In the toolbar, select the [ Spe ] icon. [ ] omega cial Characters refer to Figure 84). 2. In the w indow that pops up, select the required character ( 84. Figure S window Special Character elect Keyboard Navigation for Students Students can use keyboard commands to navigate between test elements, features, and tools. Notes: Keyboard commands require the use of the primary keyboard. Do not use keys in • a numeric keypad. • Some keyboard commands are only available when using a supported desktop secure browser. Manual  201 8– 19 CAASPP Online Test Administration 212 January 2019 2019 Customization Copyright © by the California Department of Education

223 Overview of the Student Testing Application | Features of the Student Testing Application -Test Pop-ups Sign-In Pages and In in pages (i.e., screens) 20 lists keyboard commands for selecting options on the sign- Table up windows that appear during a test. or pop- Up Windows In Pages and Pop- Table 20. Keyboard Commands for Sign- Function Keyboard Command [Tab] Move to the next option [Shift] + [Tab] Move to the previous option Select the active option [Enter] [Spacebar] Mark check box down list options Scroll through drop- Arrow keys up window Close pop- Esc Keyboard Commands for Test Navigation 21 lists keyboard commands for navigating tests and responding to questions. Table Table 21. Keyboard Commands for Test Navigation Description of Function Keyboard Command [↑] (up arrow) Scroll up [↓] (down arrow) Scroll down Scroll to the right [→] (right arrow) [←] (left arrow) Scroll to the left Move to the next element [Tab] [Shift] + [Tab] Move to the previous element Select an answer option [Spacebar ] [Ctrl] + [→] Go to the next test page (right arrow) Go to the previous test page [Ctrl] + [←] (left arrow) [Ctrl] + [G] Open the global menu [Ctrl] + [M] Open a context menu up window Close pop- [Esc] 201 8– 19 CAASPP Online Test Administration Manual January 2019  213 by the California Department of Education Customization Copyright © 2019

224 Overview of the Student Testing Application | Features of the Student Testing Application Keyboard Commands for Global and Context Menus Students can use keyboard commands to access tools in the global and context menus. For more information about tools in the global menu, 17. For more information Table refer to . Table 18 refer to about tools in the context menu, Global Menu To access the global menu tools using keyboard commands: 1. Press [Ctrl] + [G]. The global menu list opens. 2. To move between options in the global menu, use the [Up] or [Down] arrow key. 3. To select an option, press [Enter]. 4. To close the global menu without selecting an option, press [Esc]. Context Menus 1. To navigate to an element, press [Tab]. 2. To navigate in reverse, press [Shift] + [Tab]. To open the context menu for an element: nt opens. 1. Press [Ctrl] + [M]. The context menu for the selected eleme 2. To move between options in the context menu, use the [Up] or [Down] arrow key. 3. To select an option, press [Enter]. 4. To close the context menu without selecting an option, press [Esc]. To select text and open context menu options: element containing the text you want to select. 1. Navigate to the 2. Press [Ctrl] + [M] to open the context menu. 3. If multiple options are available, use the arrow keys to navigate to [Enable Text Selection]. 4. Press [Enter]. A flashing cursor appears at the upper -left corner of the active element. 5. To move the cursor to the beginning of the text you want to select, use the arrow keys. 6. Press [Shift] and an arrow key to select your text. The text you select appears shaded. 7. Press [Ctrl] + [M] again. Choose the tool you want to use for the selected text. Keyboard Commands for Grid Questions Technology -enhanced questions with the grid response area ( Figure 85) may have up to three main sections: • Answer Space: The grid area where students enter the response • Button Row: Action buttons may appear above the answer space. Buttons may include ], [ Add Dashed Line Add Point ], [ ], [ Add Line ], and ], [ Add Arrow Add Circle [ Delete ], [ [ ] Connect Line Manual  201 8– 19 CAASPP Online Test Administration 214 January 2019 2019 Customization Copyright © by the California Department of Education

225 Overview of the Student Testing Application | Features of the Student Testing Application Object Bank: • A panel containing objects you can move to the answer space rid question 85. G Figure To move between the main sections: 1. To move clockwise, press [Tab]. 2. To move counterclockwise, press [Shift] + [Tab]. an object to the answer space: To add 1. With the object bank active, use the arrow keys to move between objects. The active object has a blue background. 2. To add the active object to the answer space, press [Space]. To use the action buttons: 1. With the button row active, use the left and right arrow keys to move between the buttons. The active button is white. 2. To select a button, press [Enter]. 3. Press [Space] to apply the point, arrow, or line to the answer space. To move objects and graph elements in the answer space: 1. With the answer space active, press [Enter] to move between the objects. The active object displays a blue border. 2. Press [Space]. 3. Press an arrow key to move the object. To move the object in smaller increments, hold [Shift] while pressing an arrow key. 201 8– 19 CAASPP Online Test Administration Manual January 2019  215 2019 Customization by the California Department of Education Copyright ©

226 | Overview of the Student Testing Application Features of the Student Testing Application Keyboard Commands for Equation Questions Equation questions allow students to use keyboard commands to open a menu listing the al characters they can insert into the response area. speci To insert special characters in the response area: Special + 1. With the focus in the text field of the response area, press [Alt ] [7] . The Characters window opens. 2. To move between options in the context menu, use the [Up] or [Down ] arrow key. 3. To add the selected option to the response area, press [Enter ]. Manual January 2019  201 8– 19 CAASPP Online Test Administration 216 2019 Copyright © Customization by the California Department of Education

227 Overview of the Student Testing Application | Proceeding Through a Test Proceeding Through a Test Students can respond to questions, pause a test, review previously answered questions, and submit a test. The following sections describe each of these tasks. Viewing Stimuli When a test question is associated with a stimulus, students should review that stimulus before responding to the question. About Reading Passages When the stimulus is a reading passage, the content is read on the left side of the page (i.e., screen) (indicated in Figure 86). Figure 86. Sa mple reading passage Between the passage and the test question (stem) are two arrows. To expand the passage select the [ Expand Passage ] icon. The section will expand and [ -arrow ] right section, overlap the question section for easier readability. To expand the test question section, select the [ Expand Question ] left -arrow [ ] icon. ] icon. Collapse select the [ To Passage ] left -arrow passage, [ To collapse the expanded collapse the expanded test question, select the [ ] icon. [ -arrow ] right Collapse Question 201 8– 19 CAASPP Online Test Administration Manual January 2019  217 by the California Department of Education Customization Copyright © 2019

228 Overview of the Student Testing Application | Proceeding Through a Test About Videos When the stimulus is a video, students can use standard video features to control the Figure 87. These are shown in playback. deo Playback Features Figure 87. Vi To play a video, select the [ -left corner. [ ] triangle Play • ] icon in the lower To jump to a different point in the video, drag the slider to the required location. • Speed To adjust the speed at which the video plays, select the [ • ] icon, and then [ ] 1x select the required speed from the menu that appears. -right ] icon in the lower [ ] speaker Volume • To mute or unmute the video, select the [ corner. To expand the video to full screen mode, select the [ • [ ] icon in ] expand Screen Size Screen Size ] icon again. the l ower -right corner. To exit full screen mode, select the [ Responding to Test Questions Students answer test questions depending on the question’s type. • Multiple -choice questions: Students select a single answer option. Multiselect q Students select one or more answer options. uestions: • Students follow the instructions given for each -enhanced questions: Technology • question. Technology -enhanced questions require students to do one of the following tasks: Manual  201 8– 19 CAASPP Online Test Administration 218 January 2019 2019 Customization Copyright © by the California Department of Education

229 Overview of the Student Testing Application | Proceeding Through a Test a list of answer options. Select one or more choices from – screen keypad to generate an answer. Use an on- – – s or text excerpt s on the screen. object Select graphic on a graph. , lines , or bars points – Place – Drag and drop text or graphic objects around on the screen. – Enter text in a text box . o r table – Match answer options together. Modify a highlighted word or phrase in a reading selection. – screen simulation. Enter input parameters to run an on- – Students can use the Student Training Site to familiarize themselves with Note: the question types that may appear on tests. , and others may have more. Some test pages (i.e., screens) may have only one question Some questions may consist of multiple parts that students must answer. After students ] to proceed to the next page. Next respond to all the questions on a page, they select [ All responses are saved automatically. Students can also manually save their responses to questions by selecting [ Save ] in the global menu. Pausing Tests You may want to remind students taking Smarter Balanced computer Note: ) that if their tests are CAST adaptive tests (CATs) and the California Science Test ( minutes, they may be unable to change answers to paused for more than 20 items. For mo previously answered Pause Rules re information, refer to the subsection. Students can pause the test at any time. Pausing a test logs the student off the test. To pause a test: [ -line ] parallel Pause 1. The student selects the [ ] icon in the global menu. A confirmation message appears. udent selects the [ Yes ] button. This logs the student off. The Student Sign In 2. The st page appears. the sub section 3. To resume testing, the student repeats the sign- in process. Refer to . Signing In to the Student Testing Site  201 8– 19 CAASPP Online Test Administration January 2019 219 Manual Customization Copyright © 2019 by the California Department of Education

230 Overview of the Student Testing Application | Proceeding Through a Test Alert: When students are testing on Chromebooks, make sure that they pause the test before closing the lid of the Chromebook. If the lid is closed before the test pauses, whomever opens the Chromebook next will be able to see the last question that the student was viewing (and any response that was entered). Reviewing Questions in a Test Students may return to a previous question and modify their response if the test was not subsection the for more information. Pause Rules paused for more than 20 minutes. Refer to d rop -down list to return to Questions ] icon or the [ -arrow ] left Back Students can use the [ down list displays “(marked)” for any questions questions they want to review. The drop- 88). Figure marked for review (refer to marked for review stion 88. Que Figure or Reaching the End of a Segment (Smarter Balanced, CSA) Block (CAST) page appears after students complete the last End Segment In a segmented test, the question in the current segment. This page allows students to review questions from the segment or proceed to the next segment. A flag appears for any questions marked for current refer to 89). A warning icon appears for any unanswered questions. Figure review ( 89. Figure End S egment p age Manual  201 8– 19 CAASPP Online Test Administration 220 January 2019 2019 Customization Copyright © by the California Department of Education

231 Overview of the Student Testing Application | Proceeding Through a Test To review questions: 1. Students select a question number. To move to the next segment: ] in the global menu. Next 1. Students select [ If a student has paused a test within a segment and returns to the test after Alert: the 20- minute pause limit has expired, he or she will not be able to review the previously answered items. You may want to remind students that once they complete a segment and Note: move on, they cannot return to the previous segment. For this reason, students ST should review their responses before continuing to the taking a CAT or the CA . or block next segment Submitting a Test This section describes how students submit a test when they are done answering questions. Reaching the End of a Test After students respond to the last test question but before they submit their test, the [ End for global menu Figure 90 refer to ] icon appears in the global menu; [ ] red -square Test options. lobal Menu with [End Test] b utton 90. G Figure To end a test: ] icon. A confirmation message appears. 1. Students select the [ End Test Yes 2. Students select [ ]. 201 8– 19 CAASPP Online Test Administration Manual January 2019  221 by the California Department of Education Customization Copyright © 2019

232 Overview of the Student Testing Application | Proceeding Through a Test End Test Page End Test page appears ( When students end a test, the refer to Figu re 91). This page allows students to review answers from the current test segment or block and submit the test for scoring. A flag icon appears for any questions marked for review. A warning icon appears if there are any unanswered questions. p age nd Test E 91. Figure To review answers: 1. Students select a question number. ] in the global menu. End Test page, students select [ End Test 2. To return to the To submit the test: ]. Submit Test 1. Students select [ Once students select [ Warning: ], they cannot return to the test or Submit Test modify answers. Manual  201 8– 19 CAASPP Online Test Administration 222 January 2019 2019 Customization Copyright © by the California Department of Education

233 Overview of the Student Testing Application | Proceeding Through a Test Your Results Page After students submit the test, the page (i.e., screen) appears, displaying the Your Results student’s name, the test name, and the completion date ( Figure 92). refer to Results page Your Figure 92. Closing the Student Testing Site on Tablets After a test session ends, close the AirSecureTest application on student tablets. To close the student testing application on iOS devices: ] button. The multitasking bar appears. Home tap the [ 1. Double- 2. Locate the AIRSecureTest app preview and slide it upward. on Android tablets: To close the student testing application [ -right corner. ] ] icon in the upper Menu -boxes 1. Tap the [ stacked A confirmation message appears. 2. Tap [ ]. Exit ]. Exit 3. Tap [ To close the Student Testing Site on Chromebooks: -right corner. ] in the upper Close Secure Browser 1. Select [ 201 8– 19 CAASPP Online Test Administration Manual January 2019  223 by the California Department of Education Customization Copyright © 2019

234 | Overview of the Student Testing Application Proceeding Through a Test This page is left blank intentionally. CAASPP Online Test Administration 8– 19 January 2019 224 Manual  201 by the California Department of Education 2019 Customization Copyright ©

235 Chapter 11. Appendices

236 Appendices | Appendix A: Frequently Used Terms : Frequently Used Appendix A Terms Table California Assessment for Student Performance 22 defines terms that are specific to in California and Progress (CAASPP) testing . Table 22. Frequently Used Terms Term Definition Accommodation Change in procedures or materials that increase equitable assessments. Assessment access during the CAASPP accommodations generate valid assessment results for students who need them; they allow these students to show what they know and can do. Accommodations are available for students with documented individualized education plans. Section 504 (IEPs) or programs Approved learning accommodations do not compromise the level standard, or intended construct, grade- expectations, s. outcome of the assessment Usability, Accessibility, and the Smarter Balanced Refer to , Accommodations Guidelines California linked on the CDE) Department of Education ( Student Accessibility Resources for complete information. w eb page CAASPP Authorized users —local educational agency ( LEA) Appeal coordinators and CAASPP test site coordinators —may submit and view requests for resetting, re- opening or summative assessments in accordance inva lidating students’ with state policy. These requests must result from a test security incident or incorrect test setting that impacted summative testing that is reported using the Security and / Test Administration Incident Reporting System (STAIRS) the through ; A ppeals are process Appeals also submitted Appeal Test Operations Management System (TOMS). either (grace period by the CDE requests must be approved extension or invalidate) or the California Technical . open) Assistance Center (CalTAC) (reset, restore, and re- Block There are five blocks that make up the whole of the California Blocks Science Test (CAST) within the test delivery system. alone items from performance tasks. separate stand- When a will receive a one block student completes of the test, they message that indicates that once that is completed it is block no longer possible to return to that block .  201 8– 19 CAASPP Online Test Administration Manual 226 January 2019 by the California Department of Education Customization Copyright © 2019

237 Appendices | Appendix A: Frequently Used Terms Term Definition Break There is no limit on the number of breaks or the length of a break that a student may be given according to his or her unique needs. However, for some portions of the test, breaks of more than 20 minutes will prevent the student from returning to items already attempted by the student or response items . incomplete free- For a performance task (PT), the student can break for any amount of time and still return to any previously answered ’s current segment only. item within the PT CAASPP Test Site School staff member responsible for monitoring the test Coordinator schedule, process, test administrators, and test examiners. CAASPP test site coordinators are also responsible for ensuring that test administrators and test examiners have been appropriately trained and that testing is conducted in accordance with the test security and other policies and procedures established by the Smarter Balanced Assessment Consortium and the CDE. CAASPP test site coordinators must have a signed CAASPP Test Security on file with the LEA CAASPP coordinator. Agreement California Alternate The summative California Alternate Assessments (CAAs) for English language arts/literacy (ELA), mathematics, and Assessment (CAA) science are administered to eligible students. The CAAs are for students with the most significant cognitive disabilities and whose IEP team has designated the use of an alternate assessment on statewide summative assessments. Eligible students are those whose disability prevents them from taking the Smarter Balanced Summative Assessments for ELA and mathematics and the CAST . Online science assessment administered to students in California Science grades five, eight, and a high school grade. Test (CAST) skills in reading California Spanish Online assessment that measures student’s mechanics, writing, and listening. The CSA, which is Assessment (CSA) is available to serve students who presented in Spanish, speak Spanish as their primary language, as well as those who are learning Spanish as an additional language. 201 8– 19 CAASPP Online Test Administration Manual January 2019  227 by the California Department of Education Customization Copyright © 2019

238 | Appendices Appendix A: Frequently Used Terms Definition Term Based on student responses, the computer program selects Computer Adaptive (CAT) the difficulty of items throughout the assessment. By Test adapting to the student as the assessment is taking place, these assessments present an individually tailored set of items to each student and provide more accurate scores for all students across the full range of the achievement continuum. resource Designated Supports of the assessments available for use Accessibility by any student for whom the need has been indicated by an with the parent/ working educator (or team of educators guardian and student). Usability, Accessibility, and the Smarter Balanced Refer to linked on the CDE Accommodations Guidelines, Student Accessibility w eb page for complete information. Resources LEA personnel granted access by the LEA CAASPP – District Educator coordinator to assessment results in the Online Reporting System (ORS) for the entire LEA. LEA or school personnel granted access to assessment Educator – Test Site results in the ORS for an entire school. – Roster LEA or school personnel granted access to assessment Educator the ORS. Rosters of results in an associated roster in students are created and assigned to the user by the LEA Note that CAASPP coordinator or test site coordinator. unless the user has been assigned to a student roster, he or she cannot review any student results in the ORS. A series of related test questions that are included into Embedded performance task regular classroom instruction. After the student has (PT) responded to the items incorporated into a lesson, the test examiner applies a rubric to score the student’s responses and then records the student’s scores. Student responses are stored to demonstrate changes in the mastery of content over time. PT that requires the student to -write Full A component of the ELA or explanatory, narrative, or opinion develop an informative or argumentative multiparagraph piece of writing for which he or she engages the full writing process.  201 8– 19 CAASPP Online Test Administration Manual 228 January 2019 by the California Department of Education Customization Copyright © 2019

239 Appendices | Appendix A: Frequently Used Terms Definition Term An Appeal that allows the for CAT summative assessments Grace period extension student to review previously answered questions upon logging back on to the assessment after expiration of the pause rule. Note that for a PT, having the test administrator open a new testing session may be all that is needed to continue testing. A grace period extension will only be granted in cases Note: where there was a disruption to a test session, such as a technical difficulty, fire drill, schoolwide power outage, earthquake, or other act beyond the control of the test administrator. in the Appeals for summative assessments Invalidation ppeal A specific A System. Tests invalidated in the Appeals System will be scored and scores will be provided on the Student Score Report (with a note that an irregularity occurred). The student(s) will be counted as participating in the calculation of the school’s participation rate for federal accountability purposes. The score will be counted as “not proficient” for aggregation into the CAASPP results . Permission for an invalidation is initiated by first reporting an incident and then submitting an Appeal using the through process . While the request TOMS STAIRS/Appeals was made to invalidate a student’s assessment, summative the student should be permitted to finish it. the Refer to for Security and Test Administration Incident Procedure Guide more information on the Appeals process. LEA or school personnel responsible for administering only Interim Assessment Administrator Only the interim assessments to students. presented to a student to elicit a or stimulus Item A test question response. LEA- level staff member who is responsible for the overall LEA CAASPP Coordinator summative assessment s in an LEA. LEA administration of the CAASPP coordinators should ensure that the CAASPP test in , test administrators, and test examiners site coordinators their LEAs are appropriately trained and aware of policies and procedures. LEA CAASPP coordinators are designated by their district superintendents or the administrator of their independently testing charter school and must have a signed CAASPP Test Se CalTAC. on file with curity Agreement 201 8– 19 CAASPP Online Test Administration Manual January 2019  229 by the California Department of Education Customization Copyright © 2019

240 Appendices | Appendix A: Frequently Used Terms Definition Term Action taken by a student , test administrator, or test examiner Pause to temporarily halt the test during any part of the test, as needed. Pauses of more than 20 minutes in the CAT he student from returning component of the test will prevent t , completed, flagged for review to items already attempted , or any combination of these statuses . PT, the student can pause for any amount of time and For a still return to any previously answered item within the PT’s current segment only. More information on test pausing is available in section the sub General Test Administration . Information A PT is an item type designed to provide students with an Performance Task opportunity to demonstrate their ability to apply their (PT) knowledge and higher -order thinking skills to explore and analyze a complex, real -world scenario. It is a required online portion of the test. (Note that there are no PTs for the .) for ELA and mathematics CAAs for summative assessments in the Appeals A specific appeal -open Re System. It applies to a test that has already been submitted or has expired and allows the student to access the previously closed test. For example, a summative assessment may be re- opened if a student started a test and became ill and was unable to resume testing until after the testing opportunity expired. Permission for a re- open is initiated by first reporting an and then submitting an Appeal using the online incident STAIRS/Appeals through TOMS. Refer to the process for Security and Test Administration Incident Procedure Guide more information on the Appeals process. Reading Passage/ A reading passage is a type of stimulus ( refer to the definition of stimulus). When reading passage/passage is referenced Passage on the Smarter Balanced assessment , it is to differentiate this type of stimulus from others on the assessment. Reading passage or passage is used when speaking about the assessment. that are part of the ELA reading passages  201 8– 19 CAASPP Online Test Administration Manual 230 January 2019 by the California Department of Education Customization Copyright © 2019

241 Appendices | Appendix A: Frequently Used Terms Definition Term Reset Appeals in the for summative assessments A specific appeal System. Resetting a student’s test removes that test from the system and enables the student to start a new test. Any work previously done on the test would be lost. Valid reasons for a reset would be if a student’s summative test event was administered inconsistently with the student’s IEP (this would include both embedded and non- embedded accommodations) or if the student started a test and did no t have a needed language resource (such as a language glossary). Permission for a reset is initiated by first reporting an incident STAIRS/ and then submitting an Appeal using the online the in TOMS. Appeals Refer to process Security and Test Administration Incident Procedure Guide for more information on the Appeals process. Restore A specific appeal for summative assessments in the Appeals System. Restore a test from the “Reset” status to its prior status. This action can only be performed on assessments that have been reset by the LEA. CalTAC An LEA CAASPP coordinator must contact for permission to restore a test(s). A web browser that is downloaded and installed on a device Secure Browser prior to a student beginning the test. The secure browser is specifically designed for use with the CAASPP online access secure assessments to provide and prevent students from accessing specific hardware and software functions (e.g., other web browsers, screenshot programs) that are not of the allowed during the assessments. The current version 10.3 , does secure browser, update capability have auto- not and must always be updated manually. Security and Test process is the means by which LEAs /Appeals The STAIRS Administration and schools report a test security incident or other testing Incident Reporting issue that interferes with the administration and completion of System (STAIRS)/ the summative assessments and then, if required, submit an Process Appeals Appeal request. The first step is reporting the incident using an Appeal cannot be process ; the STAIRS/Appeals in TOMS this web form. The requested without the submission of returns an email with a summary of the information system submitted that the recipient should retain for at least a year. /Appeals The STAIRS process is used to report incidents that occur with summative assessments only. 201 8– 19 CAASPP Online Test Administration Manual January 2019  231 by the California Department of Education Customization Copyright © 2019

242 Appendices | Appendix A: Frequently Used Terms Definition Term Segment A part of a test within the test delivery system. Depending on the test, segments typically separate items from others if the eligible tools are different (i.e., the mathematics test may have two segments —one segment that allows calculator use and another segment that does not). When a student completes a segment of the test, he or she will receive a message that indicates that once that segment is submitted it is no longer possible to return to that segment. Session A timeframe in which students actively test in a single sitting. The length of a test session is determined by building or LEA administrators who are knowledgeable about the periods in the building and the timing needs associated with the assessment. Smarter Balanced recommends that session durat ions range between 40 and 120 minutes for the online Smarter Balanced Summative Assessments. However, all online CAASPP assessments, including the CAAs, are not timed, and an individual student may need more or less time overall. Further, individual students will have unique needs regarding the length of a test session. Smarter Balanced recommends the CAT portion of the Smarter Balanced ELA and mathematics assessments be . two sessions each administered in egment A test session does not need to end when a s Note: ends. -identifiable number linked to a Statewide Student A unique, non- personally given individual student within the California public Identifier (SSID) kindergarten through grade twelve educational system. SSIDs are used to maintain data on individual students, such as linking students to statewide assessment scores and tracking students in and out of schools and LEAs in order to determine more accurate dropout and graduation rates.  201 8– 19 CAASPP Online Test Administration Manual 232 January 2019 by the California Department of Education Customization Copyright © 2019

243 Appendices | Appendix A: Frequently Used Terms Term Definition Stimulus/Stimuli text that form the Material or materials used in the test con basis for students to answer connected test items. Many or tasks for the assessments include a stimulus along items with a set of questions to which the student responds. Stimulus materials are used in ELA and mathematics students’ assessments to provide context for assessing knowledge and skills. Examples of stimuli include: traditional reading passages or texts viewed on a computer screen; images with audio presentations for students to listen to; simulated web pages for students to use for research or ; and charts and graphs for mathematics items scenarios . Survey of Student A required questionnaire about the student being tested. The purpose of the SSC is to explore whether the teachers’ Characteristics (SSC) knowledge of their students can be used to improve and develop the CAAs for future years. The test examiner must complete the SSC for each student after the student has completed each of the ELA and mathematics assessments. The test examiner completes the SSC on the student’s test ing device through the CAASPP secure browser. Students whose tests were ended early as a result of the student response check will not receive the SSC. LEA or school personnel responsible for administering Test Administrator summative assessments in a secure manner in compliance with the policies and procedures outlined in this manual. Test CAASPP Test administrators are required to have a signed on file Security Affidavit with their CAASPP test site coordinator. Test Examiner Credentialed or licensed LEA or school employee responsible for administering alternate summative assessments in a secure manner in compliance with the policies and procedures outlined in this manual and the CAA Directions for Administration secure . Test examiners are required to have a signed CAASPP Test Security Affidavit on file with their CAASPP test site coordinator. 201 8– 19 CAASPP Online Test Administration Manual January 2019  233 by the California Department of Education Customization Copyright © 2019

244 Appendices | Appendix A: Frequently Used Terms Definition Term The management system used for the CAASPP Test Operations assessments. This is the system through which users interact Management System (TOMS) with and inform the test delivery system. This management system provides administrators with the tools to add and manage users and students participating in the Smarter Balanced assessments including assigning tests and student test settings and user roles. This system uses a role-specific design to restrict access to certain tools and applications based on the user’s designated role. TOMS Pre is -Administration Guide for CAASPP Testing The available on the w eb page on the CAASPP Portal. TOMS A security event that poses a threat to the validity of the Testing Breach summative assessments. Examples may include such or situations as a release of secure materials or a security system risk. These circumstances have external implications , the CDE for the Consortium and may result in a , or both, decision to remove the test item(s) from the available secure bank. The LEA CAASPP coordinator must report the breach if the 955 -2954 CalTAC at 800- by calling either immediately breach is due to social media exposure on the part of a student or adult or the CDE at 916 -445 -8765 for all other using breaches. In addition, he or she must report the incident . within 24 hours process /Appeals the STAIRS For more information on how to proceed using the process when an incident has occurred, STAIRS/Appeals Using the Security and Test please refer to the subsection of this manual and Administration Incident Reporting System the Security and Test Administration Incident Procedure Guide . An unusual circumstance that has a low impact on the Testing Impropriety taking summative individual or group of students who are assessments and has a low risk of potentially affecting student performance on the test, test security, or test validity. These circumstances can be corrected and contained at the local level. he STAIRS / For specific details on how to proceed using t Appeals process when an incident has occurred, please refer Using the Security and Test Administration to the subsection Security Incident Reporting System of this manual and the and Test Administration Incident Procedure Guide .  201 8– 19 CAASPP Online Test Administration Manual 234 January 2019 by the California Department of Education Customization Copyright © 2019

245 | Appendices Appendix A: Frequently Used Terms Definition Term circumstance that impacts an individual or group An unusual Testing Irregularity of students who are taking summative assessments and may potentially affect student performance on the tests, test security, or test validity. These circumstances can be corrected and contained at the local level , but reported using Appeal. process for resolution of the /Appeals the STAIRS For specific details on how to proceed using the STAIRS / Appeals process when an incident has occurred, please refer to the subsection Using the Security and Test Administration Incident Reporting System of this manual and the Security . and Test Administration Incident Procedure Guide Universal Tools students based on student preference and all Available to selection. Refer to Usability, Accessibility, and the Smarter Balanced Student Accommodations Guidelines, linked on the CDE ion. Accessibility Resources w eb page for complete informat resource Unlisted Resources An instructional that a student regularly uses in daily instruction, assessment that has not been , or both previously identified as a universal tool, designated support Matrix One: CAASPP or accommodation. includes a list of unlisted resources that have already been identified and are preapproved. You must register that a student will be assigned one of these preapproved unlisted resources by completing the Unlisted Resources web form for that student MS. in TO 201 8– 19 CAASPP Online Test Administration Manual January 2019  235 by the California Department of Education Customization Copyright © 2019

246 Appendices | Appendix B: Online Item Types Online Item Types Appendix B: in This Section: Resource California Assessment of Student Performance and Progress ( • Online CAASPP) Practice and Training Tests Portal - http://www.caaspp.org/practice — web page and- training/ Online Item and Response Types online assessments, they will be asked test questions that As students engage with the require them to respond in several ways, some of which may be new to students. There are several resources that teachers and students can use to get ready for the test, , it is of this manual appendix C including a practice test and a training test. As pointed out in web page students access the Training Test highly recommended that before taking the ALL test. Doing so will provide students an opportunity to view and practice each of the item types. tests training tests and The practice for CAASPP assessments are available on the CAASPP w eb page. Online Practice and Training Tests Portal Summary of —General Provide Responses Item Types and How to Online Assessments Table 23 lists the different item t ypes and briefly describes each one. Not all assessments will necessarily include all item types. Note: Table 23. Online Item and Scoring Types —General Assessments Brief Description of Content Area Type of Item How Respond to Science Associate table format, select entry to create pairings California Spanish two or more item parts from Composite Assessment (CSA) the machine- scored list Science collection of Custom Manipulate interactive items and custom interactive stimuli in scored a set with multiple- interactive components (e.g., simulations)  201 8– 19 CAASPP Online Test Administration Manual 236 January 2019 by the California Department of Education Customization Copyright © 2019

247 Appendices | Appendix B: Online Item Types Brief Description of Respond Content Area How Type of Item to Mathematics enter equation or numeric Equation (EQ) screen response using on- panel containing mathematical characters English language Writing Extended Essay/ keyboard entry arts/literacy (ELA) Response (WER) Evidence Based Selected ELA two part item: Part A; MC item ; Response (EBSR) Respond to an Cite the evidence Part B: that supports the answer to Part A either MC, MS , or Hot Text Mathematics Drag and Grid Item (GI) – drag -and- drop single or Drop multiple elements into a background image Mathematics , or , draw lines plot points Grid Item (GI) – Graphing both Mathematics and science Grid Item (GI) – Hot Spot select certain areas of an image CSA Grid Item (GI) – Multiple select a single cell in a table Select CSA select two or more cells in a Single Grid Item (GI) – table Select ELA, science select sections of text, or Hot Text (HTQ) drag -and- drop sections of text and CSA Science multiple List Inline Choice -options selected response CSA select multiple words or Inline Test Choices, Multiple Select phrases CSA Inline Test Choices, Single select a single word or Select phrase ELA, mathematics, and Match Interaction (MI) match text or images in science rows to values in columns 201 8– 19 CAASPP Online Test Administration Manual January 2019  237 by the California Department of Education Customization Copyright © 2019

248 Appendices | Appendix B: Online Item Types Brief Description of Respond to How Type of Item Content Area CSA Match, Multiple Select drag and drop two or more appropriate choices into the locations CSA drag and drop a single Match, Single Select choice into the appropriate location Multiple Choice (MC) athematics, , m ELA select a single option science, and CSA ELA, mathematics, two or more options Multiple Select (MS) select science, and CSA CSA Select a single entry box Numeric with a numeric value that may contain decimals or a slash line to represent a fraction CSA Set Leader stimulus, such as a passage or image, with one or more questions assigned to it based on its content ELA, mathematics, and Short Answer Text keyboard entry science Response (SA) Mathematics keyboard entry into table Table Interaction (TI) cells Science or numeric keyboard alpha Text Entry entry CSA zones select two or more Zone, Multiple Select CSA select a single zone Zone, Single Select Item Types and How to Provide Responses Online Summary of —Alternate Assessments ) feature innovative and technology CAAs -enhanced The California Alternate Assessments ( that are designed to be engagi items ng for students and represent a variety of types and approaches . Table with 24 gives details about these items, describing the type of functionality the student and test examiner will which be presented.  201 8– 19 CAASPP Online Test Administration Manual 238 January 2019 by the California Department of Education Customization Copyright © 2019

249 Appendices | Appendix B: Online Item Types Table Item and Scoring Types —Alternate Assessments 24. Online Brief Description of How Type of Item to Respond Set Leader This is a stimulus such as a passage or an image. The more questions assigned to it, based Leader has one or on its content. Multiple Choice a question and list of choices; These items consist of they may also include a stimulus or subset of a passage as the stimulus. • —The student must select the one Single Select ice to receive credit. correct cho —The student must select all correct Multiple Select • choices to receive credit. • Partial Credit —The student must respond to a stimulus by providing a direct response to the test examiner who then rates the response by assigning a weighted score, using the rubric provided in the . Directions for Administration • -2)—The student makes an Multiple Attempt (Try initial selection, and, if the response is incorrect, one option is removed leaving two remaining options from which to choose for a second attempt. These items consist of questions with a drop- down list of Inline Choice List choices to fill in the blank. • —The student must fill a single blank Single Select -down list for credit. from a drop • Multiple Select —The student must fill multiple blanks -down list for credit. from a drop The student responds by selecting a single entry box with Numeric a numeric value. The numeric value may contain decimals or a slash line to represent a fraction. 201 8– 19 CAASPP Online Test Administration Manual January 2019  239 by the California Department of Education Customization Copyright © 2019

250 Appendices | Appendix B: Online Item Types Respond to Brief Description of How Type of Item These items consist of a table with descripti ons or Grid characteristics, which the student then selects a box in a and- false or yes column or row for true- -or-no type of questions. • Single Select —The student marks a single cell in a table for credit. —The student marks two or more cells Multiple Select • in a table. The question might only allow one selection per row or column but it might also have no restrictions in the number of cells a student can mark. These items have answer choices that are predefined Zones “hotspots” on an image, word, or phrase within a sentence. When the student selects a spot, the selection is highlighted, shaded, or outlined in red. —The student selects one zone for Single Select • credit. —The student selects two or more Multiple Select • zones for credit. Graph These items allow s to plot points, lines, student multisegment lines, or any combination of these on a graph. A Graph may have points or lines that appear when the graph first displays that the student cannot manipulate, or it may be interactive, and the student must manipulate them to respond. These items present a short passage or a paragraph that In Line Text Choices contains underlined words or phrases. These underlined words or phrases represent the choices a student can select. —The student selects one term or Single Select • phrase. —The student selects two or more • Multiple Select terms or phrases. These items present a bar graph to the student to Bar -Picturegraph/Histogram manipulate the bar height to represent an answer. —The student manipulates one graph • Single Select bar. • Multiple Select —The student manipulates two or more graph bars.  201 8– 19 CAASPP Online Test Administration Manual 240 January 2019 by the California Department of Education Customization Copyright © 2019

251 Appendices | Appendix B: Online Item Types Respond to Brief Description of How Type of Item These items require a test taker to respond to a stimulus Composite by using multiple item types in a single item with multiple response portions. Scoring is dependent on which item type combination is selected, and the raw weights for each part are combined to give an item score. These items require the student to move objects such as -and- drop) Match (drag words or images by selecting and dragging the objects into a specific order or to a specific location in a table, passage, or image. • —The student drags and drops a single Single Select choice into the appropriate location. Multiple Select —The student drags and drops two or • more choices into the appropriate locations. Some of th e questions in this test require Note: “dragging and dropping” objects into certain designated areas on the screen. Most items were designed to snap into place; however, some were not. For the items that , please take care that you or your do not snap into place student are dropping the object precisely into the intended area(s) to ensure accurate system scoring. The object cannot overlap border lines or the edges of the intended area(s), and should rest squarely in the he dragging intended area(s). If your student is doing t and dropping, please help your student ensure objects are dropped fully within the intended area. Technical Skills to Access Embedded Resources To access some of the embedded resources (such as strikethrough, highlighter, American -to-speech) that are available to help work through these item Sign Language videos, and text . access the need to , students may types context menu Please note the method to access menu is dependent on the student’s device type. Devices and methods are the context . show n in Table 25 25. Context Menu for Selecting with the Right Mouse Button Table the Method to Access Context Menu Device Type -based desktop or laptop the right mouse button. Windows Select with (two -button mouse) and ] key on keyboard Ctrl the [ Hold down -based desktop or laptop Mac OS button mouse) (one- then select with the mouse button. 201 8– 19 CAASPP Online Test Administration Manual January 2019  241 by the California Department of Education Customization Copyright © 2019

252 | Appendices Appendix B: Online Item Types Context Menu the Method to Access Device Type Tap on the menu in the upper -left corner of iPad tablet (touchscreen) the secure browser application. Android- -left corner of based tablet (touchscreen) Tap on the menu in the upper the secure browser application. ] key on the keyboard and Chromebook (trackpad) Hold down the [ Alt tap the trackpad.  201 8– 19 CAASPP Online Test Administration Manual 242 January 2019 by the California Department of Education 2019 Copyright © Customization

253 Appendi ces | Appendix C: Practice and Training Tests Appendix C: Practice and Training Tests s Section: Resources in Thi California Assessment of Student Performance and Progress (CAASPP) Online • http://www.caaspp.org/practice Practice and Training Tests Portal web page — - and- training/ — • Accessibility Guide for CAASPP Online Testing w eb document 19.pdf -guide.2018- http://www.caaspp.org/rsc/pdfs/CAASPP.accessibility CAASPP Test Administrator and Test Examiner Resources for the Online Practice • and Training Tests web page— http://www.caaspp.org/ta -resources/practice- training.html • Practice and Training Test User Guide w eb document — http://www.smarterbalanced.org/wp- content/uploads/2015/09/PracticeAndTrainingTest_UserGuide.pdf In preparatio n for t h e test and to expose students to the various online assessment item - nd science (refer to , mathematics, a (ELA) response types i n English languag e arts/literacy appendix B the practice access that all students recommended highly is t for item types), i to experience tests . Eac h resourc e offers students a uniq ue opportunity a test in and training s and similar to what they will be presente d wit h on the CAASPP assessment a manner will not b e automatically hese resources for testing. T or scored; h owever, f prepares students an d Test Examiner e on the Test Administrator are availabl eference, sco ring guides r for th e Onli ne Practice Tests and Training web page. Resources Overview of the Practice Tests Practice tests can be administered in one of two ways: Using the same procedures as the operational tests, with the Test Administrator • Interface, secure browser, and individual student logon information. Using a standard supported web browser to access the practice tests directly, without • use of the Test Administrator Interface or secure browser. Practice Tests and California Science Test (CAST) Smarter Balanced level test The online practice tests allow educators and students to experience a full grade- CAASPP online assessments. The practice tests, which are not and gain insight into the mirror the summative assessments but are not scored, although answer adaptive, otherwise level test includes a variety of item keys and scoring rubrics are available. Each grade- —approximately 30 items each in ELA and mathematics response types and difficulty levels and 32 items an ELA and mathematics performance task at . Additionally, there is in science 201 8– 19 CAASPP Online Test Administration Manual January 2019  243 by the California Department of Education Customization Copyright © 2019

254 Appendices | Appendix C: Practice and Training Tests (PTs) and three science performance tasks each grade level (three through eight and eleven) . in grades five and eight and high school The practice test also includes a comprehensive reflection of embedded universal tools, designated supports, and accommodations, which should also be provided to students with any non- embedded universal tools, designated supports, and accommodations as allowed on the summative assessments. California Alternate Assessment (CAA) for ELA and Mathematics Practice Tests The CAA practice tests for ELA and mathematics allow students and test examiners to become familiar with grade- level CAA test questions. The practice tests provide a sample of level content that appear on the CAA operational tests. There is the question types and grade- a grade-specific CAA practice test available for each tested grade (three through eight and ) and content area (ELA , mathematics , and science ). high school tests for ELA and mathematics can be accessed either through the secure browser Practice internet browser. or through a standard California Spanish Assessment (CS A) Practice Tests level The CS A practice tests allow educators and students to become familiar with grade- CSA test questions. The practice tests provide a sample of the question types and grade- lev el content that appear on the CSA operational tests. There is a grade- A spe cific CS practice test available for each of grades three through eight and one for all high school . grade levels Practice tests can be accessed either through the secure browser or through a standard internet browser. ests Overview of the Training T , CAST, and California Spanish Assessment (CSA) Smarter Balanced Tests Training The training tests are designed to provide students and educators with an opportunity to quickly familiarize themselves with the software and navigational tools that they will use on bands (grades three the CAASPP assessments. The training tests are organized by grade through five, six through eight, and eleven). Each test contains fewer than 10 questions. website, the questions were selected to provide students with On the student Training Test an opportunity to practice a range of item response types. The training tests do not contain PTs . Similar to the practice tests, the training tests include all embedded universal tools, -to-speech functionality is d supports, and accommodations. Note that the text designate when using the training tests through the secure browser. only available The student training test site may be used by anyone. Students can log on as guests or use their first name and Statewide Student Identifier (SSID). Students who log on using their credentials may log on  201 8– 19 CAASPP Online Test Administration Manual 244 January 2019 by the California Department of Education Customization Copyright © 2019

255 Appendi ces | Appendix C: Practice and Training Tests to a guest session or a proctored training session with a training session ID set up through the Tests Administrator Training Test website. For the CAST, there . It is are training tests available in grades five and eight and high school accessed in the same manner as described previously. CAAs An o nline training test in each of the ELA , mathematics, and science content areas is available to provide a sample of question functionality and response types. The training tests specific and not meant to be used to measure content knowledge. are not grade- th test a DFA Used in conjunction with CAA Training Test , these training tests can help bo examiners and students become familiar with the testing format, interface, functionalities, and accessibility resources available for the CAAs in order to establish the most optimal testing environment for students. The training tests can also be used to help test examiners determine whether they will need to enter responses into the testing interface for the student on the operational tests. for CAAs Training tests can be accessed either through the secure browser or through a standard internet browser. Logon for the Practice and and Test Examiner Test Administrator Training Tests The Test Administrator Training Test site provides an opportunity for test administrators to practice setting up a test session using a practice test or training test. Access to the Test Administrator Training Test site requires the same logon credentials used to access the Test Administrator Interface. This site may only be used by authorized LEA CAASPP coordinators, , test administrators . Note that braille , and test examiners CAASPP test site coordinators practice tests and training tests can only be accessed through the Test Administrator Training web browser and can be accessed by a site by the test administrator using a standard web browser. student also using a standard For additional information about how to set up a practice test or training test session, visit the Test Administrator and Test Examiner Resources for the Online Practice and Training Tests website. Do N OT use the live (operational) student interface or Test Warning: Doing so constitutes a test security incident Administrator Interface for practice. (breach). For all Training Test sessions, use the Test Administrator Training site and the practice tests or training tests. that highly recommended It is all students access the training tests before taking a summative assessment. The training tests will be especially beneficial for those students who 201 8– 19 CAASPP Online Test Administration Manual January 2019  245 by the California Department of Education Customization Copyright © 2019

256 Appendices | Appendix C: Practice and Training Tests have not previously participated in online testing. Teachers are encouraged to conduct a group walk with their students to promote familiarity with -through of a practice or training test the testing format and basic test rules and to allow for free and open communication on the the refer to tes ting process and content ( General Test Administration Information subsection) . This walk -through of the practice and training tests provide opportunities for test administrators to describe the limitations to the support they will be able to provide and the verbal interactions they can have with students during each live test session. Manual January 2019 CAASPP Online Test Administration 8– 19 201  246 Copyright © Customization 2019 by the California Department of Education

257 Appendices | Appendix D: Secure Browser for Testing : Secure Browser for Testing Appendix D in This Section: Resources • website—http://ca.browsers.airast.org/ Secure Browsers Guidelines version 10.3 While the secure browser is an integral component of test security, test administrators and test examiners perform an equally important role in preserving test integrity. In addition to the guidelines put forth by the Smarter Balanced Assessment (CDE) Consortium, the , and individual local educational California Department of Education agencies (LEAs) or schools, test administrators and test examiners should be aware of these and employ the necessary precautions while administering online tests: guidelines . Close External User Applications or other , test examiners, test administrators Prior to administering the online assessments, devices assigned staff should check all all applications except close that will be used and those identified as necessary by the school technology coordinator. After closing these he secure browser on each should open t or test examiner applications, the test administrator device. The secure browser and Student Interface automatically detect certain applications that are prohibited from running on a while the secure browser is open. The secure browser device will not allow a student to log on if th e secure browser detects that a forbidden application is running on the device . A message will also display that lists the forbidden application(s) that needs to be closed. If a forbidden application is launched in the background while the Warning: nt is already in a test, the student will be logged off and a message—“A stude forbidden program has started, and you will be logged out. Ask your Test —will display. The student will have to close the Administrator for assistance.” forbidden application, reopen the secure browser, and log on to continue working on the assessment. This would be considered a test security incident and should Security and Test Administration Incident Reporting be reported using the online Operations Management System in the Test /Appeals process System (STAIRS) . Devices Testing on with Dual Monitors Avoid . Systems that use a dual -monitor setup typically display an application on one monitor screen while another application is accessible on the other screen. devices that are connected to more than Students should not take online assessments on one monitor except in extremely rare circumstances such as when a or test test administrator 201 8– 19 CAASPP Online Test Administration Manual January 2019  247 by the California Department of Education Customization Copyright © 2019

258 Appendices | Appendix D: Secure Browser for Testing aloud and wants to have a duplicate screen to view is administering a test via read- examiner exactly what the student is viewing for ease of reading aloud. In these rare cases where a setup to is allowed, Smarter Balanced requires that the monitors be set up dual monitor “mirror” each other. School technology coordinators can assi st test administrators and test examiners in setting up the two monitors to ensure they mirror each other rather than operate as independent monitors. In these cases, all security procedures must be followed and the test administered in a secure environment to prevent others from hearing the questions or viewing the student or test administrator screens. or test examiner Disable Screen Savers and Timeout Features . On all testing devices, be sure to disable any features that display a screen saver or log users off after a period of inactivity. If such features activate while a student is testing, the secure browser logs the student off the test. The student must log on to the secure browser to resume testing. Secure Browser Error Messages source secure browser are shown in Possible error messages displayed by the open- Table 26. Table 26. Secure Browser Error Messages Description Message is using Secure Browser Not device The system automatically detects whether a the secure browser to access the online testing system. Detected a test other than The system will not permit access to through the secure browser; under no condition may a ing a nonsecure browser. student access a test us device If a Unable to Establish a fails to establish a connection with the test delivery system, a message will be displayed. This is most Connection with the likely to occur if there is a network -related problem. The Test Delivery System causes may include an unplugged network cable or a firewall not allowing access to the site. -Quit C ommands for Secure Browsers Force In the rare event that the secure browser or test becomes unresponsive and you cannot pause the test or close the secure browser, users have the ability to “force quit” the secure browser. browser to close, use the following keyboard commands. (Reminder: secure To force the This will log the student off the test he or she is taking. When the secure browser is opened on to resume testing.) again, the student will have to log back  201 8– 19 CAASPP Online Test Administration Manual 248 January 2019 by the California Department of Education Customization Copyright © 2019

259 Appendices | Appendix D: Secure Browser for Testing You are strongly advised against using the force -quit commands, Warning: as the secure browser treats this action as an abnormal termination. The secure browser hides features such as the Windows taskbar; if the secure browser is not closed correctly, then the taskbar may not reappear correctly. These commands should be used only if the [ Close Secure Browser ] button • does not work. Note s: • quit command will log the student off of the test he or she is taking. The force- student will have to log on again When the secure browser is opened again, the to resume testing. • Users of laptop or netbook devices might also need to press the [ FN ] key before ]. F10 pressing [ • Force -quit commands do not exist for the secure browser for iOS, Chrome OS, or Android devices. Windows ] + [ ] + [ Shift Alt F10 ]. Press [ Ctrl ] + [ Mac OS X Ctrl ]. Ctrl Control ], or [ ^ Press [ ]. The Control key may appear as [ ] + [ Alt ] + [ Shift ] + [ F10 ], [ Linux Ctrl Press [ ]. Esc ] + [ Shift ] + [ Alt ] + [ 201 8– 19 CAASPP Online Test Administration Manual January 2019  249 by the California Department of Education Customization Copyright © 2019

260 Appendices | Appendix E: Computer Adaptive Test Pause Rule Scenarios Appendix E: Computer Adaptive Test Pause Rule Scenarios Pause rule scenarios apply to the Smarter Balanced summative assessments and the California Science Test (CAST). Scenarios: or a CAST 1. If the computer adaptive test (CAT) portion of the test is discrete item block paused for 20 minutes , the student can return to previous test pages and change or less the response to any item he or she has already answered within a segment. 2. If the CAT portion of the test discrete item block is paused for more than 20 or a CAST minutes, the test will return the student to the last page with unanswered items when the student resumes testing. If a page has both completed items and items to which there is not a complete response, the student may change any answers on that page cannot change . The student may not return to previous pages and (i.e., screen) answers to items on previous pages. item s 4 –7 and a. Example: A single test page has item s 4 –10. A student answers pauses the test for more than 20 minutes. When the student resumes testing, he or she can change answers to item s 4 –10 but cannot return to item s 1 –3 on an earlier page. b. Example: A page contains item s 9 –11 and a student answers all of those items before pausing the test for more than 20 minutes. When the student resumes testing, he or she will begin on item 12 and c annot return to item s 1 –11. c. Example: Prior to a pause, a student navigates back to a previous item and deletes his or her answer. The system is then paused while that student is on that particular item. After a pause greater than 20 minutes, the system is designed to place the student on the last unanswered question. In this case, an item to which the student had responded previously is now blank. When the student answers that item and unanswered Next item, selects [ ], the test delivery system proceeds to the next skipping items, as those items would have received a response previously. Note: A constructed response item is considered answered if the student has taken any action within the response area. This includes random keystrokes (e.g., selecting sdkjfasdgi), one or more spaces using the spacebar, anywhere on a Grid Item –Hot Spot item, etc.  201 8– 19 CAASPP Online Test Administration Manual 250 January 2019 by the California Department of Education Customization Copyright © 2019

261 | Appendices Appendix F: Multiplication Table Appendix F: Multiplication Table Note: This page is not intended to be printed for student use during testing. -digit (1 –9) multiplication table is a non- embedded accommodation for grade s four A single and above mathematics items. The multiplication table is to be used only for students with a documented and persistent calculation disability (i.e., dyscalculia). This table can be printed and enlarged, if required, for students with an individualized education program or Section 504 plan requiring this accommodation. It is also available as a PDF on the Student Accessibility Resources and Test Settings w eb page on the California Assessment of Student Performance and Progress Portal . Use of other multiplication tables is prohibited. MULTIPLICATION TABLE 5 4 3 9 8 7 6 × 1 2 5 8 7 6 1 9 1 2 3 4 2 10 12 14 16 18 8 6 4 2 3 12 15 18 21 24 27 9 6 3 8 4 12 16 20 24 28 32 36 4 10 15 20 25 30 35 40 45 5 5 12 18 24 30 36 42 48 54 6 6 14 21 28 35 42 49 56 63 7 7 8 8 16 24 32 40 48 56 64 72 18 27 36 45 54 63 72 81 9 9 201 8– 19 CAASPP Online Test Administration Manual January 2019  251 by the California Department of Education Customization Copyright © 2019

262 | Appendices Appendix G: 100s Number Table Appendix G: 100s Number Table This page is not intended to be printed for student use during testing. Note: A table listing numbers from 1– 100 is a non- embedded accommodation for grades four and only for students with visual above mathematics items. The 100s Number Table is to be used as documented in their individualized education processing or spatial perception needs This table can be printed for students requiring this program or Section 504 plan. accommodation; it is available as a PDF on the Student Accessibility Resources and Test w eb page on the California Assessment of Student Performance and Progress Settings Portal. Use of other 100s number tables is prohibited. 100s Number Table 1 2 3 4 5 6 7 8 9 10 11 13 14 15 16 12 17 18 19 20 22 23 24 25 26 27 28 29 30 21 39 38 37 36 35 34 40 31 32 33 41 43 44 45 46 42 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 73 74 75 76 72 77 78 79 80 82 83 84 85 86 87 88 89 90 81 98 97 96 95 94 100 99 91 92 93  201 8– 19 CAASPP Online Test Administration Manual 252 January 2019 by the California Department of Education Customization Copyright © 2019

263 Appendices | Appendix H: LEA CAASPP Coordinator Checklist Coordinator Checklist CAASPP : LEA Appendix H Direct Responsibilities : Add users who have signed a California Assessment for Student ACTIVITY  Performance and Progress (CAASPP) security agreement or a CAASPP security affid avit to the Test Operations Management System (TOMS). As needed Estimated Time to Complete: Target Completion Date: Complete as soon as possible to provide the option to administer interims assessments, if applicable. -Administration Guide for CAASPP Testing, TOMS Pre Notes and Resources: Chapter 1: Adding and Managing Users  : Set up test administration windows for the local educational agency ACTIVITY (LEA) and assign schools to it. As needed Estimated Time to Complete: Target Completion Date: Complete by December 1, 2018. -Administration Guide for CAASPP Testing, TOMS Pre Notes and Resources: Chapter 1: Adding and Managing Users  ACTIVITY : Verify student test assignments, updating where necessary in TOMS. Estimated Time to Complete: Ongoing Complete at least by the start of the selected testing window. Target Completion Date: Chapter 4: -Administration Guide for CAASPP Testing, TOMS Pre Notes and Resources: Student Test Assignment  ACTIVITY: Notify schools when training materials are available. five to six Complete at least Estimated Time to Complete: weeks prior to testing. Ongoing Target Completion Date: Notes and Resources: c Test Administration Manual, Online hapter 2 • • web page Summative Assessment Training Videos and Webcasts CAASPP stration 201 8– 19 CAASPP Online Test Admini Manual January 2019  253 by the California Department of Education Customization Copyright © 2019

264 Appendic es | Appendix H: LEA CAASPP Coordinator Checklist Notify schools when administration manuals are available. ACTIVITY:  As needed Estimated Time to Complete: weeks prior to testing. five to six least Complete at Target Completion Date: Notes and Resources: chapter 2 Online Test Administration Manual, • Instructions Manuals and CAASPP • web page  ACTIVITY: Communicate California Science Test (CAST) and California Alternate Assessment (CAA) for Science test assignments. One hour Estimated Time to Complete: Target Completion Date: weeks prior to testing. Complete at least five to six Notes and Resources: Science Test Administration for High School Students for the ACTIVITY: Review the  CAA for Science Administration Planning Guides he CAA for Science to be administered. grade levels of t to five hours Three Estimated Time to Complete: five to six weeks prior to testing. Complete at least Target Completion Date: Notes and Resources: CAASPP CAAs web page ACTIVITY: Review all Smarter Balanced policy and summative test administration  documents. to five hours Three Estimated Time to Complete: weeks prior to testing. Target Completion Date: Complete at least five to six Onlin Notes and Resources: chapter 2 e Test Administration Manual, Review scheduling and testing requirements with CAASPP test site ACTIVITY:  coordinators. 90 minutes Sixty to Estimated Time to Complete: three to four weeks prior to testing. Target Completion Date: Complete at least chapter 4 Notes and Resources: Online Test Administration Manual, -required training for CAASPP test site ACTIVITY: Plan and conduct any state  ors and test administrators; retrain as needed. coordinat As needed Estimated Time to Complete: weeks prior to testing. three Complete at least Target Completion Date: Notes and Resources: None  201 8– 19 CAASPP Online Test Administration Manual 254 January 2019 by the California Department of Education Customization Copyright © 2019

265 Appendic es | Appendix H: LEA CAASPP Coordinator Checklist Download and communicate CAA version assignments with the test ACTIVITY:  sites. One hour Estimated Time to Complete: weeks prior to testing. Complete at least two to three Target Completion Date: Notes and Resources: CAASPP • CAA s for EL A and Mathematics Version Assignments web page CAASPP CAA for Science Version Assignments web page • ession for CAASPP test  ACTIVITY: Review training modules and schedule training s site coordinators. hours Two to three Estimated Time to Complete: Complete while spaced over two to three Target Completion Date: weeks prior to testing. Notes and Resources: hapter 2 • Online Test Administration Manual, c web page Summative Assessment Training Videos and Webcasts CAASPP • Review security procedures with CAASPP test site coordinators, test ACTIVITY:  tors, and test examiners. administra Estimated Time to Complete: As needed weeks prior to testing. Target Completion Date: Complete at least two to three Notes and Resources: chapter 3 Online Test Administration Manual,  ACTIVITY: Work with LEA technology coordinators to ensure timely device setup. Conduct network diagnostics. • • Download the secure browser (beginning late August or early September). Verify that schools meet the minimum technology requirements. • Estimated Time to Complete: 10 hours Five to prior to testing. at l east two weeks ompletion Date: Target C Complete Notes and Resources: Technical Specifications and Configuration Guide for CAASPP Online Testing Work with schools to review and verify California Longitudinal Pupil ACTIVITY:  Achievement Data System (CALPADS) student demographic data in TOMS. Estimated Time to Complete: Two to four hours two weeks before testing and during testing. Complete Target Completion Date: at least Notes and Resources: TOMS Pre -Administration Guide for CAASPP Testing, Chapter 5: Student Test Settings stration 201 8– 19 CAASPP Online Test Admini Manual January 2019  255 by the California Department of Education Customization Copyright © 2019

266 Appendi | ces Appendix H: LEA CAASPP Coordinator Checklist Work with test site coordinators to ensure that consistent processes are ACTIVITY:  used to document the selection and assignment of appropriate accessibility resources for students. As needed Estimated Time to Complete: Target Completion Date: least Complete at two weeks before testing. Notes and Resources: TOMS Pre -Administration Guide for CAASPP Testing, • Chapter 5: Student Test Settings Accessibility Guide for CAASPP Online Testing •  ACTIVITY: Work with your test site coordinators to ensure that a request for unlisted resources have been submitted for students who require them. As needed Estimated Time to Complete: Target Completion Date: two weeks prior to testing. Complete at least Chapter 5: -Administration Guide for CAASPP Testing, TOMS Pre Notes and Resources: Student Test Settings  Perform an equipment needs assessment based on individual student ACTIVITY: requirements. Work with the CAASPP test site coordinator to identify students who will need • specialized equipment for accommodations. Communicate with the CAASPP test site coordinators, test administrators, and test • examiners to identify the number of headsets needed in order to take the English language arts/literacy (ELA) Listening portions of the assessment. Place order for the number of headsets needed plus extra. hours One to two Estimated Time to Complete: two weeks prior to testing. Complete at least Target Completion Date: Stude Notes and Resources: nts are permitted and encouraged to use their own ear —but buds or headsets local educational agencies ( ) and schools should also plan LEAs on having some available.  201 8– 19 CAASPP Online Test Administration Manual 256 January 2019 by the California Department of Education Customization Copyright © 2019

267 Appe ndices | Appendix H: LEA CAASPP Coordinator Checklist  Instruct CAASPP test site coordinators to download (or have test ACTIVITY: CAA Directions for examiners download) the correct version of the secure Administration (DFAs) from TOMS for each grade being tested at the school. Estimated Time to Complete: Thirty minutes per manual Complete one to two testing. Target Completion Date: weeks before Notes and Resources: • TOMS website • CAASPP CAA for ELA and Mathematics Version Assignments web page web page CAA for Science Version Assignments CAASPP • download (or have test Instruct CAASPP test site coordinators to ACTIVITY:  examiners download) the correct version of the CAA for Science embedded performance tasks (PTs) for each grade being tested at the school. Estimated Time to Complete: minutes per task Fifteen Complete s Target Completion Date: testing. These files are available before hortly starting January 8, 2019. website Notes and Resources: TOMS (Not tested medical emergency) and PGE Enter condition codes NTE ACTIVITY:  (Parent/Guardian exemption) in TOMS as necessary. As needed Estimated Time to Complete: Ongoing; submit condition codes before a student has Target Completion Date: completed testing. web page Instructions for Using Condition Codes in TOMS Notes and Resources:  ACTIVITY: Collect completed CAA for Science embedded PTs from test site coordinators. Estimated Time to Complete: As needed Target Completion Date: Complete by the end of the selected testing window. Notes and Resources: None stration 201 8– 19 CAASPP Online Test Admini Manual January 2019  257 by the California Department of Education Customization Copyright © 2019

268 Appendices | Appendix H: LEA CAASPP Coordinator Checklist Monitor Administration Activities  ACTIVITY: Investigate all summative testing improprieties, irregularities, breaches, and incidents reported by test administrators and test examiners. • Submit an incident report following the Security of Test Administration Incident Reporting System . process /Appeals (STAIRS) /Appeals Appeal in TOMS if directed to do so after following the STAIRS File an • process. Estimated Time to Complete: As needed Target Completion Date: Ongoing ; the deadline for all submissions will be one week after the selected testing window closes. Notes and Resources: • c Online Test Administration Manual, hapter 3 Security Incidents and Appeals Procedure Guide • Process for Summative Assessments /Appeals STAIRS CAASPP • web page  ACTIVITY: Monitor with the LEA technology coordinator any technical problems to apply resolutions or disseminate information at other school sites prior to testing. As needed Estimated Time to Complete: ngoing throughout the testing This is o window. Target Completion Date: Notes and Resources: None ACTIVITY:  Use the Completion Status system to monitor test completion rates. As needed Estimated Time to Complete: ngoing throughout the testing window. This is o Target Completion Date: Guide to CAASPP Completion Status and Roster Management Notes and Resources: Oversight Responsibilities  ACTIVITY: Ensure that CAASPP test site coordinators, test administrators, and test examiners in the LEA are appropriately trained and aware of policies and procedures, especially related to security. Estimated Time to Complete: As needed three Complete at least Target Completion Date: weeks prior to testing. chapter 3 Notes and Resources: Onlin e Test Administration Manual, Manual  258 201 8– 19 CAASPP Online Test Administration January 2019 Customization Copyright © 2019 by the California Department of Education

269 Appendices | Coordinator Checklist Appendix H: LEA CAASPP ACTIVITY:  Review school test administration schedules for adequate time and resource planning. As needed Estimated Time to Complete: weeks prior to testing. three Complete at least Target Completion Date: Notes and Resources: Online Test Administration Manual, chapter 4  Verify that CAASPP test site coordinators, test administrators, and test ACTIVITY: examiners have reviewed student information in TOMS and are verifying student settings for designated supports and accommodations in TOMS. As needed Estimated Time to Complete: two weeks prior to testing. Target Completion Date: Complete at least Chapter 5: TOMS Pre tion Guide for CAASPP Testing, -Administra Notes and Resources: Student Test Settings ACTIVITY: You or your designee must be available during your testing window for  questions and problem solving. Estimated Time to Complete: As needed Target Completion Date: Complete during your entire testing window. Notes and Resources: None Communicate regularly with CAASPP test site coordinators any ACTIVITY:  emerging trends or issues. As needed Time to Complete: Estimated Complete during your entire testing window. Target Completion Date: None Notes and Resources: stration 201 8– 19 CAASPP Online Test Admini Manual January 2019  259 by the California Department of Education Customization Copyright © 2019

270 | Appendices Appendix H: LEA CAASPP Coordinator Checklist Contact Information Questions about technology and the overall administration procedures Questions about state policies California D California Technical Assistance Center epartment of Education Accommodations, Test Policy, Testing 800- 955 -2954 Incidents [email protected] Name: CAASPP Office http://www.caaspp.org/ Phone: -8765 445 916- Hours of operation: Monday through Friday, Email: [email protected] 7 a.m. to 5 p.m. Pacific time California Department of Education Security Breach or Testing I rregularity Name: CAASPP Office -0969 Fax: 319 916- Email: [email protected] Manual January 2019 CAASPP Online Test Administration 8– 19 201  260 by the California Department of Education Customization Copyright © 2019

271 Appe | ndices Appendix I: CAASPP Test Site Coordinator Checklist Site Test : CAASPP Appendix I Coordinator Checklist Direct Responsibilities Add local users who have signed a California Assessment for Student  ACTIVITY: Performance and Progress (CAASPP) security affidavit to the Test Operations Management System (TOMS). Estimated Time to Complete: As needed Target Completion Date: Complete as soon as possible to provide the option to administer interims assessments, if applicable. Chapter 1: Notes and Resources: -Administration Guide for CAASPP Testing, TOMS Pre Adding and Managing Users Communicate California Science Test (CAST) and California Alternate ACTIVITY:  Assessment (CAA) for Science test assignments. One hour Estimated Time to Complete: Complete at least Target Completion Date: five to six weeks prior to testing. Science Test Administration for High School Students Notes and Resources: Attend trainings that your local educational agency (LEA) offers and ACTIVITY:  review all Smarter Balanced policy and test administration documents. Two to four Estimated Time to Complete: hours weeks prior to testing. three Complete at least Target Completion Date: Notes and Resources: • c hapter 2 Online Test Administration Manual, Summative Assessment Training Videos and Webcasts CAASPP • web page stration 201 8– 19 CAASPP Online Test Admini Manual January 2019  261 by the California Department of Education Customization Copyright © 2019

272 Appendices | Appendix I: CAASPP Test Site Coordinator Checklist Ensure that all test administrators and test examiners attend your ACTIVITY:  school’s or LEA’s training and review the self -paced online training modules posted on the Smarter Balanced portal. Review with test administrator the videos (“What is a Computer Adaptive Test?” and “Embedded Universal Tools and Online Features”) and encourage them to show these to their students in preparation for the test. Estimated Time to Complete: hours Two to three o testing. Target Completion Date: Complete at least three weeks prior t Notes and Resources: c Online Test Administration Manual, • hapter 2 Summative Assessment Training Videos and Webcasts web page • CAASPP with technology personnel to ensure timely device setup:  ACTIVITY: Work • Conduct network diagnostics. Download the secure browser. • Verify that your school has met the minimum technology requirements. • • Ensure that other technical issues are resolved before and during testing. Estimated Time to Complete: Five to 10 hours Complete at least weeks prior to testing. three to four Target Completion Date: Technical Specifications and Configuration Guide for CAASPP Notes and Resources: Online Testing Work with the LEA CAASPP coordinator to ensure that consistent ACTIVITY:  processes are used to document the selection and assignment of appropriate accessibility resources for students. Estim ated Time to Complete: As needed two weeks before testing. Complete at least Target Completion Date: Notes and Resources: Chapter 5: Student Test TOMS Pre • -Administration Guide for CAASPP Testing, Settings • Accessibility Guide for CAASPP Online Testing ACTIVITY: s for unlisted  Work with your test site coordinators to ensure that request resources have been submitted for students who require them. As needed Estimated Time to Complete: Target Completion Date: Complete at least two weeks prior to testing. Chapter 5: TOMS Pre -Administration Guide for CAASPP Testing, Notes and Resources: Student Test Settings  201 8– 19 CAASPP Online Test Administration Manual 262 January 2019 by the California Department of Education Customization Copyright © 2019

273 Appendices | Appendix I: CAASPP Test Site Coordinator Checkli st Communicate with the test administrators and test examiners to identify ACTIVITY:  site and ensure that the needed the number of headsets needed for each testing number are available at least two weeks prior to the testing window. • Headsets are required for the English language arts/literacy (ELA) computer adaptive test ( CAT ) assessment to support the Listening portions of the -to-speech, or for students requiring assessment, for students who require text audio glossaries (mathematics only). • Communicate with the LEA CAASPP coordinator to identify the number of headsets needed. Estimated Time to Complete: one hour Up to Completion Date: two weeks prior to testing. Target Complete at least Students are permitted and Order the number needed plus extra. Notes and Resources: —but districts and schools should also encouraged to use their own ear buds or headsets . plan on having some available Perform an equipment needs check based on individual student  ACTIVITY: requirements. Work with test administrators and test examiners to identify students who will • need specialized equipment for accommodations. wo hours One to t Estimated Time to Complete: Complete at least Target Completion Date: two weeks prior to testing. Notes and Resources: None Based on the test administration windows, work with test administrators,  ACTIVITY: test examiners, and the LEA CAASPP coordinator to establish a testin g schedule. Estimated Time to Complete: hours Two to four one to two Complete at least Target Completion Date: weeks prior to testing. Online Test Administration Manual, Notes and Resources: chapter 4 ACTIVITY:  Work with test administrators and test examiners to review student information in TOMS before students are tested to ensure that correct student information and test settings for designated supports and accommodations are applied. hours Two to four Estimated Time to Complete: Target Completion Date: Complete at least two weeks prior to testing. -Administration Guide for CAASPP Testing, Notes and Resources: TOMS Pre Chapter 5: Student Test Settings stration 201 8– 19 CAASPP Online Test Admini Manual January 2019  263 by the California Department of Education Customization Copyright © 2019

274 Appendices | Appendix I: CAASPP Test Site Coordinator Checklist  Establish a place to test those students who need a separate test ACTIVITY: setting. One to two Estimated Time to Complete: hours weeks prior to testing. one to two Complete at least Target Completion Date: es and Resources: Not Usability, Accessibility, and Accommodations Guidelines —linked on the California Department of Education Student Accessibility Resources web page Download (or have test examiners download) the correct version of the  ACTIVITY: secure from TOMS for each grade being CAA Directions for Administration (DFAs) tested at the school. Estimated Time to Complete: Thirty minutes per manual weeks prior to testing. Target Completion Date: Complet e o ne to two Notes and Resources: • TOMS website web page nts CAA s for ELA and Mathematics Version Assignme CAASPP •  Instruct CAASPP test site coordinators to download (or have test ACTIVITY: examiners download) the correct version of the CAA for Science embedded performance tasks (PTs) for each grade being tested at the school. Estimated Time to Complete: Fifteen minutes per task Target Completion Date: Complete shortly before testing. Note that these files are available on January 8, 2019. Notes and Resources: • TOMS website web page CAASPP • and CAA for Science Version Assignments  ACTIVITY: Ensure proper handling of all printed test materials and scratch paper. Collect all test materials on each day of testing to keep in a secure location until after the test session, and then destroy according to the security policy outlined in Online Test Administration Manual the . As needed Estimated Time to Complete: the testing window. Complete during Target Completion Date: and after Notes and Resources: Online Test Administration Manual, chapter 3  201 8– 19 CAASPP Online Test Administration Manual 264 January 2019 by the California Department of Education Customization Copyright © 2019

275 Appendices | Appendix I: CAASPP Test Site Coordinator Checklist Ensure adherence to all security policies. ACTIVITY:  and submit it to your LEA CAASPP Test Security Agreement Read and sign the • CAASPP coordinator. CAASPP • Ensure that all test administrators and test examiners read and sign Test Security Affidavits . As needed Estimated Time to Complete: Target Completion Date: Ongoing Notes and Resources: hapter 3 • c Online Test Administration Manual, • w eb page Forms CAASPP  Document any summative testing impropriety, irregularity, or breach and ACTIVITY: report to the LEA CAASPP coordinator immediately after learning of the incident. Submit an incident report following the Security of Test Administration Incident • process Reporting System (STAIRS) /Appeals in TOMS . • /Appeals RS Appeal in TOMS if directed to do so after following the STAI File an process. Estimated Time to Complete: As needed Target Completion Date: Ongoing Notes and Resources: c hapter 3 Online Test Administration Manual, • • Security Incidents and Appeals Procedure Guide STAIRS /Appeals web page Process for Summative Assessments CAASPP • ACTIVITY: ter condition codes NTE (Not tested medical emergency) and PGE  En (Parent/Guardian exemption) in TOMS as necessary. As needed Estimated Time to Complete: Ongoing; submit condition codes before a student has Target Completion Date: completed testing. Resources: Notes and web page Instructions for Using Condition Codes in TOMS Manual 201 8– 19 CAASPP Online Test Admini stration January 2019  265 by the California Department of Education Customization Copyright © 2019

276 Appendices | Appendix I: CAASPP Test Site Coordinator Checklist Monitor Administration Activities Monitor testing progress during the testing window and ensure tha ACTIVITY:  t all students participate as appropriate, addressing student issues as needed. As needed Estimated Time to Complete: Ongoing Target Completion Date: Notes and Resources: None Raise any technical issues with the school technology coordinator for ACTIVITY:  resolution. Estimated Time to Complete: As needed Target Completion Date: Ongoing Notes and Resources: None  ACTIVITY: Review, investigate, and report on all potential testing improprieties, irregularities, and breaches reported by test administrators and test examiners. Mitigate incidents when appropriate. Estimated Time to Complete: As needed Ongoing Target Completion Date: Notes and Resources: • hapter 3 c Online Test Administration Manual, Security Incidents and Appeals Procedure Guide • Process for Summative Assessments /Appeals STAIRS CAASPP • w eb page ACTIVITY: Use the Completion Status system to monitor test completion rates.  Estimated Time to Complete: As needed Complete on an o throughout the testing window. basis ngoing Target Completion Date: Guide to CAASPP Completion Status and Roster Management Notes and Resources: Oversight Responsibilities Verify that test administrators and test examiners have reviewed student ACTIVITY:  for designated supports and information in TOMS and are verifying student settings accommodations in TOMS. Estimated Time to Complete: As needed Complete at least Target Completion Date: one to two weeks prior to testing. TOMS Pre -Administration Guide for CAASPP Testing, Notes and Resources: Chapter 5: Student Test Settings  201 8– 19 CAASPP Online Test Administration Manual 266 January 2019 by the California Department of Education Customization Copyright © 2019

277 Appendices | Appendix I: CAASPP Test Site Coordinator Checklist Assist test administrators and test examiners in taking proper measures ACTIVITY:  edded resources -emb to ensure that students have access only to allowable non during testing. Estimated Time to Complete: As needed Complete prior to testing. Target Completion Date: Notes and Resources: None Verify that test administrators and test examiners are adhering to all test  ACTIVITY: security policies and practices. As needed Estimated Time to Complete: Target Completion Date: Complete during testing. chapter 3 Notes and Resources: Online Test Administration Manual, Contact Information Questions about technology and Questions about the overall ration and procedures overall the policies administ state administration California Department of Education School Technology Coordinator Name: ____________________________ Accommodations, Test Policy, Testing Irregularities Phone: ____________________________ CAASPP Office Name: Email: ____________________________ -8765 Phone: 916- 445 LEA CAASPP Coordinator Email: Name: [email protected] ____________________________ Phone: ____________________________ Email: ____________________________ http: //www.caaspp.org/ stration 201 8– 19 CAASPP Online Test Admini Manual January 2019  267 by the California Department of Education Customization Copyright © 2019

278 Appendices | Appendix J: Test Administrator Checklist : Test Administrator Checklist Appendix J ACTIVITY: Confirm that you have received your Test Operations Management  (TOMS) logon information. You should have received an automated email from TOMS notifying you of how to log on. You will also use this username and password for the online testing system. Estimated Time to Complete: As needed weeks prior to testing. Target Completion Date: Complete at least one to two Notes and Resources: If you have not received this information, please check your spam or junk email folder to learn if it was mistakenly routed there. If not, check with your CAASPP test site coordinator. • -Administration Guide for CAASPP Testing, TOMS Pre Chapter 2: Passwords, Access, and Logons -through of the training test or practice test Provide students with a walk ACTIVITY:  for familiarity with navigation of the system and tools. One hour Estimated Time to Complete: Target Completion Date: Complete multiple opportunities prior to testing. Notes and Resources: Online Test Administration Manual, a ppendix C  Assessment of Student Performance and Progress Review all California ACTIVITY: (CAASPP) policy and test administration documents. Estimated Time to Complete: One to two hours Complete at least two to three Target Completion Date: weeks prior to testing. Online Test Administration Manual Notes and Resources:  ACTIVITY: Review the training modules and attend school or district training sessions, if any are offered. Estimated Time to Complete: Two to three hours Target Completion Date: weeks prior to testing. Complete at least two to three tes and Resources: No hapter 2 c Online Test Administration Manual, • CAASPP • Summative Assessments Training Videos and Webcasts  201 8– 19 CAASPP Online Test Administration Manual 268 January 2019 by the California Department of Education Customization Copyright © 2019

279 Appendices | Appendix J: Test Administrator Checklist Show students the videos “What is a Computer Adaptive Test?” and ACTIVITY:  “Embedded Universal Tools and Online Features.” Estimated Time to Complete: One hour weeks prior to Target Completion Date: Complete while spaced over two to three testing. Notes and Resources: CAASPP 2015– 16 Archived Webcasts and Training Videos web page  Perform an equipment needs check based on individual student ACTIVITY: requirements. Work with the CAASPP test site coordinator to identify students who will need • specialized equipment for accommodations. Estimated Time to Complete: One to two hours two weeks prior to testing. Complete at least Target Completion Date: Notes and Resources: Students are permitted and encouraged to use their own ear —but local educational agencies (LEAs) and schools should also plan buds or headsets on having some available. ACTIVITY:  Work with the CAASPP test site coordinator to determine precise testing schedules based on the test administration windo ws selected by the school schedule. • Make sure your students’ test administration schedule includes allowable breaks. Estimated Time to Complete: As needed one to two weeks prior to testing. Complete at least Target Completion Date: Notes and Resources: Online Test Administration Manual, chapter 4  ACTIVITY: Work with your CAASPP test site coordinator to ensure that each student has a Statewide Student Identifier (SSID) and is registered for an -pencil test as necessary. per appropriate pa hours Two to four Estimated Time to Complete: weeks prior to testing. one to two Complete at least Target Completion Date: None Notes and Resources: stration 201 8– 19 CAASPP Online Test Admini Manual January 2019  269 by the California Department of Education Customization Copyright © 2019

280 Appendices | Appendix J: Test Administrator Checklist ACTIVITY: Create logon tickets for students that include their legal first name and  their SSID. (It is also permissible to include a photo of the student or include the student’s last name with the logon information as additional safeguards to ensure that the students receive the correct logon information.) te: Estimated Time to Comple hours Two to four Complete at least weeks prior to testing. one to two Target Completion Date: Notes and Resources: chapter 7 Online Test Administration Manual, ACTIVITY: Confirm each student’s test settings for designated supports and  accommodations in TOMS against his or her individualized education program (IEP), Section 504 plan, or other relevant documentation as appropriate. Two to four hours Estimated Time to Complete: weeks prior to testing. one to two Complete at least Target Completion Date: Chapter 5: Notes and Resources: -Administration Guide for CAASPP Testing, TOMS Pre Student Test Settings Ensure that the secure browser has been downloaded to any device(s) TIVITY: AC  on which students will be testing. One to two Estimated Time to Complete: hours Target Completion Date: Complete at least one to two and again weeks prior to testing the day before testing or morning of testing. Notes and Resources: Check with your CAASPP test site coordinator or school technology coordinator if the [ ] icon is missing. Secure Browser • Technical Specifications and Configuration Guide for CAASPP Online Testing, Chapter 4: Secure Browser Configuration ACTIVITY: Communicate to students the need for headsets in order to take the  English language arts/literacy (ELA) Listening portions of the assessment. 1. Identify any students who may not have their own headsets and make arrangements with the school to have headsets available for those students. Counts should be determined prior to testing. Also have extra headsets on h and for students who may forget to bring theirs. 2. Send reminders to students and parents several days before and the day prior 3. to testing to remind parents that students may bring their own headsets but that headsets will be provided to students without headsets on the day of testing. Estimated Time to Complete: As needed  201 8– 19 CAASPP Online Test Administration Manual 270 January 2019 by the California Department of Education Customization Copyright © 2019

281 | Appendices Appendix J: Test Administrator Checklist Target Completion Date: 1. Make a count of needed headsets (vs students who have their own) at least three weeks prior to testing and tell your CAASPP test site coordinator the number needed. 2. Three days before testing, remind students to have their headsets available the day of tests. 3. One day before testing, remind students to bring their headsets. Administration of the ELA assessment will contain a listening Notes and Resources: portion. Students will need ear buds or headsets. Make sure your school has extras available for students who may need them on the day of testing. Have extra headsets on hand in case students forget.  o finish early. Plan a quiet activity for each test session for students wh ACTIVITY: Estimated Time to Complete: 15–30 minutes Target Completion Date: Complete the week of testing. The activity should not be related to the test being given. For Notes and Resources: example, students who finish early may work on assignments for unrelated subjects or read a book. ACTIVITY:  Prior to administration, check all devices that will be used and close all applications except those identified as necessary by the school’s technology coordinator or the student’s IEP or Section 504 plan. Make sure that no device has dual monitors except where required in an IEP or • Section 504 plan. Work with your CAASPP test site coordinator to set system volume prior to • students launching the secure browser to ensure students can hear the audio portions of the ELA segment. One to two hours Estimated Time to Complete: Target Completion Date: Complete the morning of testing. Notes and Resources: The test administrator or test examiner should open the secure browser on each device after closing any unnecessary applications. stration 201 8– 19 CAASPP Online Test Admini Manual January 2019  271 by the California Department of Education Customization Copyright © 2019

282 Appendices | Appendix J: Test Administrat or Checklist Review all guidelines for creating a secure test environment. ACTIVITY:  Online Test Review all security procedures and guidelines in the • . Administration Manual Carefully read and sign the test security affidavit. • Estimated Time t o Complete: As needed Target Completion Date: Complete prior to and during day(s) of testing. Notes and Resources: c Online Test Administration Manual, hapter 3 • CAASPP Test Security Affidavit •  Make sure the physical conditions of the testing room are satisfactory. ACTIVITY: Make sure that no instructional materials directly related to the content of the • assessments are visible. Students should be seated so there is enough space between them, or provide • desktop partitions to minimize opportunities to look at each other's screen. • Actively monitor students throughout the test sessions. Students who are not being tested may not be in • the room where a test is being administered. Estimated Time to Complete: As needed Target Completion Date: Complete the day(s) of testing. Notes and Resources: Make sure students clear their desks and put away all books, backpacks, purses, and • materials not needed for the test. other Make sure that cell phones, electronic devices of any kind, and other materials not • needed for the test are not present in the testing room unless required by a student’s IEP or Section 504 plan. • Ensure that students do not access unauthorized electronic devices (such as cell phones) at any time during testing. hapter 3 • Online Test Administration Manual, c Manual  272 201 8– 19 CAASPP Online Test Administration January 2019 Customization Copyright © 2019 by the California Department of Education

283 Appendices | Appendix J: Test Administrator Checklist On the day of testing, verify that the students have their logon ACTIVITY:  information (first name, SSID, and session ID). Logon tickets are secure testing material until testing is completed; these should be securely destroyed after testing. Estimated Time to Complete: As needed Target Completion Date: ting. Complete the day(s) of tes Notes and Resources: Online Test Administration Manual, chapter 7 ACTIVITY: Administer the Smarter Balanced assessments, following the script and  -embedded directions for administration. Provide any necessary non designated supports and accommodations. As needed Estimated Time to Complete: Complete the day(s) of testing. Target Completion Date: Provide students with scratch paper for all test sessions. Also Notes and Resources: provide students in grades six and above graph paper for the mathematics assessments. (Smarter Balanced Summative • Online Test Administration Manual, chapter 8 Assessments and CAST) (California Spanish Assessment) hapter 9 Online Test Administration Manual, • c  ACTIVITY: Report any summative testing improprieties, irregularities, and breaches to the CAASPP test site coordinator and LEA CAASPP coordinator in writing immediately following an impropriety, irregularity, or breach. The coordinator will CAASPP Security and Test Incident Reporting report the incident using the online form to submit a report and may also call the California Department of System Education immediately, when appropriate. Estimated Time to Complete: As needed Target Completion Date: Complete as soon as possible during or immediately following testing. Notes and Resources: Online Test Administration Manual, chapter 3 Securely dispose of ACTIVITY:  all printed testing materials, including student logon -on- demand documents, and scratch paper. information, print As needed Estimated Time to Complete: Complete after testing. Target Completion Date: chapter 3 Online Test Administration Manual, Notes and Resources: stration 201 8– 19 CAASPP Online Test Admini Manual January 2019  273 by the California Department of Education Customization Copyright © 2019

284 Appendices | Appendix J: Test Administrator Checklist Contact Information Questions about technology and Questions about the overall overall the administration and procedures administration state policies School Technology Coordinator California Department of Education Name: ____________________________ Accommodations, Test Policy, Testing Irregularities ____________________________ Phone: Name: CAASPP Office Email: ____________________________ 916- -8765 445 Phone: CAASPP Test Site Coordinator [email protected] Email: Name: ____________________________ Phone: ____________________________ Email: ____________________________ LEA CAASPP Coordinator Name: ____________________________ Phone: ____________________________ ____________________________ Email: 274 January 2019 Manual CAASPP Online Test Administration 8– 19 201  by the California Department of Education Customization Copyright © 2019

285 Appendices | Appendix K: Test Examiner Checklists s Examiner Checklist Test Appendix K: California Alternate Assessments (CAA s) for English Language Arts/Literacy and Mathematics ACTIVITY:  Confirm that you have received your Test Operations Management (TOMS) logon information. You should have received an automated email from TOMS notifying you of how to log on. You will also use this username and password for the online testing system. Estimated Time to Complete: As needed one to two Complete at least Target Completion Date: weeks prior to testing. Notes and Resources: If you have not received this information, please check your spam or junk email folder to learn if it was mistakenly routed there. If not, check with your CAASPP test site coordinator. Chapter 2: Passwords, • TOMS Pre -Administration Guide for CAASPP Testing, Access, and Logons  Administration Tutorial and present the resulting View the CAA Test ACTIVITY: completion certificate to your California Assessment of Student Performance and Progress (CAASPP) test site coordinator or local educational agency (LEA) CAASPP coordinator. hours Two to three Estimated Time to Complete: Complete at least two to three weeks prior to testing. Target Completion Date: Notes and Resources: • Online Test Administration Manual, c hapter 2 • CAAs web page CAASPP  ACTIVITY: Review all CAASPP policy and test administration documents. One to two Estimated Time to Complete: hours Target Completion Date: Complete at least two to three weeks prior to testing. Online Test Administration Manual Notes and Resources:  ACTIVITY: Provide students with a walk -through of the training test or practice test for English language arts/literacy and mathematics for familiarity with navigation of the system and tools. Estimated Time to Complete: One hour Complete multiple opportunities prior to testing. Target Completion Date: ppendix C Notes and Resources: Online Test Administration Manual, a stration Manual January 2019 275 201 8– 19 CAASPP Online Test Admini  Customization Copyright © 2019 by the California Department of Education

286 Appendices | Appendix K: Test Examiner Checklists Perform an equipment needs check based on individual student ACTIVITY:  requirements. • Work with the CAASPP test site coordinator to identify students who will need specialized equipment for accommodations. Estimated Time to Complete: hours One to two two weeks prior to testing. Target Completion Date: Complete at least Notes and Resources: Students are permitted and encouraged to use their own ear buds or headsets —but LEAs and schools should also plan on having some available. ne precise testing Work with the CAASPP test site coordinator to determi ACTIVITY:  schedules based on the test administration windows selected by the school schedule. • Make sure your students’ test administration schedule includes allowable breaks. As needed Estimated Time to Complete: Complete at least weeks prior to testing. one to two Target Completion Date: chapter 4 Online Test Administration Manual, Notes and Resources:  Work with your CAASPP test site coordinator to ensure that each ACTIVITY: student to whom you are administering the CAAs has a Statewide Student Identifier (SSID). Estimated Time to Complete: Two to four hours Target Completion Date: Complete at least one to two weeks prior to testing. Notes and Resources: None ACTIVITY:  coordinator to obtain the correct Work with your CAASPP test site version of the secure from TOMS for CAA Directions for Administration (DFAs) each grade you are administering. minutes Fifteen Estimated Time to Complete: Target Completion Date: One to two weeks prior to testing. Notes and Resources: • TOMS website CAA s for ELA and Mathematics Version Assignments web page • CAASPP  Carefully review the ACTIVITY: (s) for each grade you are administering. DFA hours One to two Estimated Time to Complete: Complete prior to administering the online assessments. Target Completion Date: DFA(s) Downloaded Notes and Resources:  201 8– 19 CAASPP Online Test Administration Manual 276 January 2019 by the California Department of Education Customization Copyright © 2019

287 Appendi ces | Appendix K: Test Examiner Chec klists for designated supports and Confirm each student’s test settings ACTIVITY:  accommodations in TOMS against his or her individualized education program , Section 504 plan, or other relevant documentation as appropriate. (IEP) Two to four hours Estimated Time to Complete: Complete at least one to two Target Completion Date: weeks prior to testing. Notes and Resources: TOMS Pre -Administration Guide for CAASPP Testing, Chapter 5: Student Test Settings Ensure that the secure browser has been downloaded to any device(s) TIVITY: AC  on which students will be testing. Estimated Time to Complete: hours One to two Target Completion Date: weeks prior to testing one to two Complete at least and again the day before testing or morning of testing. Check with your CAASPP test site coordinator or school Notes and Resources: technology coordinator if the [ ] icon is missing. Secure Browser Technical Specifications and Configuration Guide for CAASPP Online Testing, • Chapter 4: Secure Browser Configuration athematics ACTIVITY: The C  e arts/literacy ( anguag AAs for English l ELA ) and m online a ssessments are t est e xaminer will o be administered one on one. The t share use of the testing device with the student. Confirm audio is working on the device, s uch that both you and the student can hear the audio. Fifteen minutes o Complete: Estimated Time t Complete before testing. Target Completion Date: ELA and mathematics Notes and Resources: assessments contain videos, animations containing audio, or both.  ACTIVITY: Review all guidelines for creating a secure test environment. • Review all security procedures and guidelines in the Online Test . Administration Manual • Carefully read and sign the test security affidavit. As needed Estimated Time to Complete: Complete prior to and during day(s) of testing. Target Completion Date: and Resources: Notes • c hapter 3 Online Test Administration Manual, CAASPP Test Security Affidavit • stration 201 8– 19 CAASPP Online Test Admini Manual January 2019  277 by the California Department of Education Customization Copyright © 2019

288 Appendices | Appendix K: Test Examiner Checklists  ACTIVITY: Make sure the physical conditions of the testing room are satisfactory and that no instructional materials directly related to the content of the assessments are visible. As needed Estimated Time to Complete: Target Completion Date: Complete the day(s) of testing. Notes and Reso urces: • Make sure that cell phones, electronic devices of any kind, and other materials not needed for the test are not present in the testing room unless required by a student’s IEP or Section 504 plan. • Ensure that students do not access unauthorized electronic devices (such as cell phones) at any time during testing. Online Test Administration Manual, • hapter 3 c ACTIVITY: On the day of testing, verify you have the student’s logon information  d session ID). (first name, SSID, an As needed Estimated Time to Complete: Complete the day(s) of testing. Target Completion Date: Notes and Resources: chapter 7 Online Test Administration Manual, • Online Test Administration Manual, • c hapter 8 • chapter 9 Online Test Administration Manual,  ACTIVITY: Begin the one -on- one test administration with a student by starting with essment, beginning with the Student Response Check the ELA or mathematics ass for the content area. Estimated Time to Complete: As needed Target Completion Date: Complete the day(s) of testing. CAA DFA Notes and Resources: DFA , following ACTIVITY: Administer the assessment according to the script in the  the script and directions for administration. Provide any necessary non -embedded designated supports and accommodations. 100 minutes per test Estimated Time to Complete: Sixty to Target Completion Date: Complete the day(s) of testing. Notes and Resources: Provide students with scratch paper for all test sessions. Also provide students in grades six and above graph paper for the mathematics assessments. Online Test Administration Manual, chapter 6 •  201 8– 19 CAASPP Online Test Administration Manual 278 January 2019 by the California Department of Education Customization Copyright © 2019

289 Appendices | Appendix K: Test Examiner Checklists  ACTIVITY: Report any summative testing improprieties, irregularities, and breaches to the CAASPP test site coordinator and LEA CAASPP coordinator in writing immediately following an impropriety, irregularity, or breach. The coordinator will report the incident using the online CAASPP Security and Test Incident Reporting System form to submit a report and may also call the California Department of Education immediately, when appropriate. Estimated Time to Complete: As needed as soon as possible during or immediately following Complete Target Completion Date: testing. chapter 3 Online Test Administration Manual, Notes and Resources: DFA ACTIVITY: Securely dispose of all printed testing materials, including the  , mand documents, and scratch paper. -on- print de As needed Estimated Time to Complete: Target Completion Date: Complete after testing. Notes and Resources: chapter 3 Online Test Administration Manual, Contact Information Questions Questions about technology and about the overall procedures overall the administration and policies state administration School Technology Coordinator California Department of Education Accommodations, Test Policy, Testing Name: ____________________________ Irregularities Phone: ____________________________ Name: CAASPP Office Email: ____________________________ 916- Phone: -8765 445 CAASPP Test Site Coordinator Email: [email protected] ____________________________ Name: Phone: ____________________________ ____________________________ Email: LEA CAASPP Coordinator Name: ____________________________ Phone: ____________________________ ____________________________ Email: stration 201 8– 19 CAASPP Online Test Admini Manual January 2019  279 by the California Department of Education Customization Copyright © 2019

290 | Ap pendices Appendix K: Test Examiner Checklists for Science Assessment (CAA) California Alternate  Confirm that you have received your Test Operations Management ACTIVITY: (TOMS) logon information. You should have received an automated email from TOMS notifying you of how to log on. You will also use this username and password for the online testing system. As needed Estimated Time to Complete: weeks prior to testing. one to two Target Completion Date: Complete at least If you have not received this information, please check your spam Notes and Resources: or junk email folder to learn if it was mistakenly routed there. If not, check with your CAASPP test site coordinator. • -Administration Guide for CAASPP Testing, TOMS Pre Chapter 2: Passwords, Access, and Logons View the CAA Test Administration Tutorial and present the resulting ACTIVITY:  completion certificate to your California Assessment of Student Performance and Progress (CAASPP) test site coordinator or local educational agency (LEA) PP coordinator. CAAS hours Estimated Time to Complete: Two to three weeks prior to testing. Target Completion Date: Complete at least two to three Notes and Resources: • hapter 2 c Online Test Administration Manual, • CAASPP CAAs web page Review all CAASPP policy and test administration documents. ACTIVITY:  Estimated Time to Complete: One to two hours weeks p Complete at least two to three Target Completion Date: rior to testing. Notes and Resources: Online Test Administration Manual ACTIVITY: Work with the CAASPP test site coordinator to determine testing  schedules; make sure your students’ test administration schedule includes allowable breaks. As needed Estimated Time to Complete: Complete at least Target Completion Date: weeks prior to testing. one to two chapter 4 Notes and Resources: Online Test Administration Manual, CAASPP Online Test Administration Manual  January 2019 280 201 8– 19 by the California Department of Education Customization Copyright © 2019

291 Appendices | Appendix K: Test Examiner Checklists  ACTIVITY: Work with your CAASPP test site coordinator to ensure that each student to whom you are administering the CAA for Science has a Statewide Student Identifier (SSID). Estimated Time to Complete: hours Two to four Complete at least weeks prior to testing. one to two Target Completion Date: None Not es and Resources: Ensure that the secure browser has been downloaded to any device(s) ACTIVITY:  on which students will be testing. One to two Estimated Time to Complete: hours one to two Complete at least weeks prior to testing and again Target Completion Date: the day before testing or morning of testing. Check with your CAASPP test site coordinator or school Notes and Resources: ] icon is missing. Secure Browser technology coordinator if the [ Technical Specifications and Configuration Guide for CAASPP Online Testing, • Chapter 4: Secure Browser Configuration Work with your CAASPP test site coordinator to obtain the CAA for ACTIVITY:  Science embedded PT for each grade you are administering. You will need a separate copy for each student administered. Fifteen Estimated Time to Complete: minutes Target Completion Date: One to two weeks prior to testing. Note that these files are . available starting on January 8, 2019 website TOMS Notes and Resources: Carefully review the embedded PT. ACTIVITY:  Estimated Time to Complete: One to two hours Complete Target Completion Date: just prior to administering the embedded PT. Notes and Resources: Downloaded embedded PT(s) Gather any materials needed, according to guidelines provided in the  ACTIVITY: performance task (PT) and individual student needs and learning styles, embedded and record which m aterials are used to administer the embedded PT. Thirty Estimated Time to Complete: minutes Complete prior to administering the embedded PT. Target Completion Date: Downloaded embedded PT(s) Notes and Resources: stration 201 8– 19 CAASPP Online Test Admini Manual January 2019  281 by the California Department of Education Customization Copyright © 2019

292 Appendices | Appendix K: Test Examiner Checklists a secure test environment. Review all guidelines for creating ACTIVITY:  Review all security procedures and guidelines in the Online Test • . Administration Manual Carefully read and sign the test security affidavit. • As needed Estimated Time to Complete: Target Completion Date: Prior to and during day(s) of testing. Notes and Resources: • Online Test Administration Manual, hapter 3 c CAASPP Test Security Affidavit • Make sure the physical conditions of the testing room are satisfactory ACTIVITY:  and that no instructional materials directly related to the content of the assessments are visible. As needed Estimated Time to Complete: testing. Complete the day(s) of Target Completion Date: Notes and Resources: • Make sure that cell phones, electronic devices of any kind, and other materials not needed for the test are not present in the testing room unless required by a student’s individualized education program or Section 504 plan. Ensure that students do not access unauthorized electronic devices (such as cell • phones) at any time during testing. • hapter 3 c Online Test Administration Manual, Administer the assessment according to the guidelines in the embedded ACTIVITY:  PT. Provide any necessary individualized resources. 100 minutes per test Estimated Time to Complete: Sixty to Target Completion Date: Complete the day(s) of testing. Notes and Resources: Downloaded embedded PT  ACTIVITY: Securely dispose of all printed testing materials. Fifteen minutes Estimated Time to Complete: Complete after testing. Target Completion Date: chapter 3 Notes and Resources: Online Test Administration Manual, CAASPP Online Test Administration Manual  January 2019 282 201 8– 19 by the California Department of Education Customization Copyright © 2019

293 | Appendices Appendix K: Test Examiner Checklists Information Contact Questions about technology and Questions about the overall administration overall the policies procedures administration and state School Technology Coordinator California Department of Education Name: ____________________________ Accommodations, Test Policy, Testing Irregularities Phone: ____________________________ Name: CAASPP Office Email: ____________________________ 916- -8765 445 Phone: CAASPP Test Site Coordinator [email protected] Email: Name: ____________________________ Phone: ____________________________ Email: ____________________________ LEA CAASPP Coordinator Name: ____________________________ ____________________________ Phone: Email: ____________________________ 201  January 2019 283 Manual stration 19 CAASPP Online Test Admini 8– by the California Department of Education Customization Copyright © 2019

294 | Appendices INDEX INDEX 1 F 100s Number Table, 252 Following Test Administration, 125 Destroying Test Materials, 125 A Reporting Testing Improprieties, Irregularities, and Breaches, 125 Accessibilit y Accommodation, 226 I Designated Supports, 228 Universal Tools, 235 IA Administrator Only, 19 Unlisted Resources, 235 Item Types, 236 Accessibility Guidelines, 72 Appeals, 50, 226 L Invalidation, 229 LEA CAASPP Coordinator, 15 Re-open, 230 Reset, 231 M Restore, 231 Multiplication Table, 251 C P CAASPP Test Site Coordinator, 16 CalTAC, 1 Participation, 7 Checklists Pause rules, 58 Test Site Coordinator CAASPP Performance Task, 230 Checklist, 261 practice test, 29 LEA CAASPP Coordinator Checklist, Practice Test, 243 253 Test Administrator Checklist, 268 R Test Examiner Checklists, 275 Reading Passage, 230 Computer Adaptive Test, 228 Roles and Responsibilities, 15 D S Directions for Administration Science Login Script , 128 California Alternate Assessment for Science , 79 E California Science Test, 76 Early Assessment Program, 71 Secure browser, 54 – District, 20 Educator Error Messages, 248 Educator – Roster, 20 Force -quit, 248 – Test Site, 20 Educator Sensitive Responses, 70 Spanish 284 201 8– 19 CAASPP Online Test Administration Manual January 2019  Customization Copyright © 2019 by the California Department of Education

295 | Appendices INDEX Destroying electronic files , 40 California Spanish Assessment, 84 Destroying printed materials, 40 Environment, 34 T 4 Impropriety, 43, 23 Technology Resources, 31 Irregularity, 43 Test Administration, 56 Printed Materials, 39 DFA, 131, 162 Requirements, 35 General Rules of Online Testing, 57 Scratch Paper, 41 Recommended Order of Administration, Test Security Required Action Steps, 45 62 -on- demand materials, 39 Using print Tasks, 93 Test Security Processes, 44 Verifying student information, 93 Test Security Required Action Steps, 45 Test Administration Documentation Test Timeout, 60 Resources, 24 es, Irregularities, and Testing Improprieti Test Administration Resources Breaches, 42 Manuals, 25 Testing Irregularity , 235 Practice and Training Tests, 29 Testing time Test Administrator, 18 Recommended Order of Administration, Test Administrator & Test Examiner, 19 64 Test Examiner, 18 Testing Time, 62 Test expiration rules, 61 Duration and Timing, 64 Test Operations Management System , Training Resources, 28 234 training test, 30 Test Security, 33 Training Test, 244 Breach, 43, 234 285 stration 8– 201 January 2019  19 CAASPP Online Test Admini Manual Customization Copyright © 2019 by the California Department of Education

296 | Appendices Change Log Change Log Section(s) Change(s) Date [to be determined] [to be determined] [to be determined] [to be determined] [to be determined] [to be determined] [to be determined] [to be determined] [to be determined] [to be determined] [to be determined] [to be determined]  201 8– 19 CAASPP Online Test Administration Manual 286 January 2019 by the California Department of Education 2019 Copyright © Customization

Related documents

CityNT2019TentRoll 1

CityNT2019TentRoll 1

STATE OF NEW YORK 2 0 1 9 T E N T A T I V E A S S E S S M E N T R O L L PAGE 1 VALUATION DATE-JUL 01, 2018 COUNTY - Niagara T A X A B L E SECTION OF THE ROLL - 1 CITY - North Tonawanda TAX MAP NUMBER ...

More info »
CRPT 116hrpt9 u2

CRPT 116hrpt9 u2

U:\2019CONF\HJRes31Front.xml APPRO. SEN. [COMMITTEE PRINT] REPORT { } CONGRESS 116TH 1st HOUSE OF REPRESENTATIVES Session 116- FURTHER APPROPRIATIONS FOR MAKING CONTINUING OF HOMELAND SECURITY FOR THE...

More info »
RIE Tenant List By Docket Number

RIE Tenant List By Docket Number

SCRIE TENANTS LIST ~ By Docket Number ~ Borough of Bronx SCRIE in the last year; it includes tenants that have a lease expiration date equal or who have received • This report displays information on ...

More info »
Fourth National Report on Human Exposure to Environmental Chemicals Update

Fourth National Report on Human Exposure to Environmental Chemicals Update

201 8 Fourth National Report on Human Exposure to Environmental Chemicals U pdated Tables, March 2018 , Volume One

More info »
CalCOFI Atlas 33

CalCOFI Atlas 33

THE EARLY STAGES IN OF THE FISHES CALIFORNIA CURRENT REGION CALIFORNIA FISHERIES COOPERATIVE OCEANIC INVESTIGATIONS ATLAS NO. 33 BY THE SPONSORED STATES OF COMMERCE DEPARTMENT UNITED OCEANIC AND ATMOS...

More info »
doj final opinion

doj final opinion

UNITED STAT ES DIS TRICT COURT IC F OR THE D ISTR T OF CO LU M BIA UNITED STAT F AMERICA, : ES O : : la in t if f, P 99 No. on cti l A vi Ci : 96 (GK) -24 : and : TOBACCO-F UND, : REE KIDS ACTION F : ...

More info »
MPI: A Message Passing Interface Standard

MPI: A Message Passing Interface Standard

MPI : A Message-Passing Interface Standard Version 3.0 Message Passing Interface Forum September 21, 2012

More info »
Untitled

Untitled

Harmoniz ed vision 4 hedule of the United States (2019) Re Tariff Sc Annotated f poses ting Pur or Statistical Repor GN p .1 GENERAL R ATION ULES OF INTERPRET inciples: wing pr ollo y the f verned b i...

More info »
625137

625137

2018-19 Nebraska All-Sports Record Book - Nebraska Communications Office -

More info »
untitled

untitled

G:\P\16\HR1\INTRO.XML ... (Original Signature of Member) TH 116 CONGRESS 1 ST S ESSION H. R. 1 To expand Americans’ access to the ballot box, reduce the influence of big money in politics, and strengt...

More info »
Price Book: Canvas Office Landscape Wall and Private Office

Price Book: Canvas Office Landscape Wall and Private Office

Price Book Y Canvas Office Landscape ® Prices effective January 7, 2019 Published May 2019 Wall and Private Office page 2 Introduction Canvas Office 3 Landscape Office Wall and Private 5 Walls Work Su...

More info »
pisa 2012 results volume I

pisa 2012 results volume I

PISA 2012 Results: What Students Know and Can Do tICS, themA StuDent PeRfoRmAnCe In mA ReADIng AnD SCIenCe Volume I rogramme for ssessment A tudent S nternational I P

More info »
Second National Report on Biochemical Indicators of Diet and Nutrition in the U.S. Population

Second National Report on Biochemical Indicators of Diet and Nutrition in the U.S. Population

Second National Report on Biochemical Indicators of Diet and Nutrition in the U.S. Population Second National Report on Biochemical Indicators of Diet and Nutrition in the U.S. Population 2012 Nationa...

More info »
Department of Defense   Law of War Manual (June 2015)

Department of Defense Law of War Manual (June 2015)

D E A R T M E N T O F D E F E N S E P N A L O F W A R M A W U A L J U N E 2 0 1 5 O F F I C E O F G E N ER A L C O U N S E L D P A R T M E N T E O F D E F E N S E

More info »
Out of Reach 2018

Out of Reach 2018

2018 of OUT REACH THE HIGH COST OF HOUSING MADE POSSIBLE BY THE GENEROSITY OF:

More info »
OperatorHoursReport

OperatorHoursReport

John Bel Edwards Rebekah E. Gee MD, MPH SECRETARY GOVERNOR State of Louisiana Louisiana Department of Health Office of Public Health Certified Water and Wastewater Operators 2018 - 2019 Hours Hours li...

More info »
UNSCEAR 2008 Report Vol.I

UNSCEAR 2008 Report Vol.I

This publication contains: VOLUME I: SOURCES SOURCES AND EFFECTS Report of the United Nations Scientific Committee on the Effects of Atomic Radiation to the General Assembly OF IONIZING RADIATION Scie...

More info »
TTL19$13DU

TTL19$13DU

Sec. 19-13-D page 1 (1-13) Department of Public Health TABLE OF CONTENTS The Public Health Code of the State of Connecticut CHAPTER IV Hospitals, Child Day Care Centers and Other Institutions and Chil...

More info »
GAO 19 157SP, HIGH RISK SERIES: Substantial Efforts Needed to Achieve Greater Progress on High Risk Areas

GAO 19 157SP, HIGH RISK SERIES: Substantial Efforts Needed to Achieve Greater Progress on High Risk Areas

United States Government Accountability Office Report to Congressional Committees March 2019 -RISK SERIES HIGH Substantial Efforts Needed to Achieve Progress on Greater Risk Areas High- 19 - GAO - 157...

More info »