Appendix K: Justification Table

Appendix K- Justifications Table

The following table summarizes the questions across the three respondent groups (i.e., users, managers, administrators), indicates which questions are asked of whom (indicated by check mark in cell), as well as the relevance and application of the questions.

Questions	ALPR Users	ALPR Managers	ALPR Administrator	Relevance	Application
Screening and Classification Questions
What key functions does your job involve?				Establishes skill sets associated with the respondents positional status	Confirms the respondent falls into a specific respondent category; Identifies knowledge and skill sets
If not mentioned, probe on how long interviewee has served in current role				Establishes experience level of respondent	Enables interpretation of answers within context of functional job experience
What activities do you perform related to ALPR?				Study purpose relates to ALPR	Establishes knowledge base related to ALPR use
Extent of ALPR Use and Use for Traffic Safety Purposes
For which purposes do you personally/ does your agency use ALPR in general?				Study purpose relates to ALPR	Establishes ALPR use
For which traffic safety purposes do you/does your agency’s use ALPR technology?				Study purpose relates to ALPR for traffic safety	Establishes ALPR use for traffic safety
Probe: If not mentioned, probe on use for detecting drivers with suspended, revoked, or restricted licenses.			
Generally, what percent of your/your agency’s use of ALPR involves traffic safety purposes?				Study purpose relates to ALPR for traffic safety	Quantifies proportion of ALPR use that is specific to traffic safety
How long have you [used/ been involved in managing users/ administering the oversight of] ALPR technology for traffic safety purposes?				Study purpose relates to ALPR for traffic safety	Establishes level of experience with technology application
How do the decisions get made on how/ how much to use ALPR technology for traffic safety?				Impacts extent to which ALPR might be used for traffic safety	Characterizes decision-making as top down or bottom up
Do you have any latitude in terms of how ALPR is used for addressing traffic safety?				Influences extent of ALPR use for traffic safety purposes	Relates to next question on motivation to use
What do you believe are the motivators for law enforcement personnel like yourself to use ALPRs as tools for improving traffic safety?				Opens discussion on what motivates law enforcement agents to use ALPRs for traffic safety purposes	Motivations can be identified and explored to determine which provide best results
How much training did you receive on overall use of ALPR?				Training important to extent of use and to effective use which is later topic	Clarifies the amount of training officers receive
Probe: How much training was specific to ALPR use for traffic safety purposes?				Training important to extent of use and to effective use which is later topic	Clarifies the amount of training officers receive
Probe: Is the training on-going or was it one-time only?				Establishes scope of training	Characterizes the training
Are you responsible for training on use of ALPR for traffic safety purposes? If no, who is?				Training important to extent of use and to effective use which is later topic	For individual managers, establishes their role in training
Probe: Can you describe that training?				Establishes scope of training	Characterizes the training
Has the training officers receive on use of ALPR for traffic safety changed in the past year?				Identifies any potential Post-Ferguson impacts on agency use of ALPR	Sets up the next two questions
If yes: In what ways? To what do you attribute the changes?				Identifies any potential Post-Ferguson impacts on agency use of ALPR	Characterizes impacts
Do you know why your agency first became involved in applying ALPR technology for improving traffic safety?				Influences extent of ALPR use	Provides background to ALPR use within agency
Does your agency generate reports from collected data and pass that information along to field units for proactive traffic enforcement activities?				Describes ALPR use in agency	Provides background to ALPR use within agency
Probe: What types of traffic safety activities do these reports address at the management and field user levels?				Describes ALPR use in agency	Provides background to ALPR use within agency
Does your agency use data collected with ALPR technology to perform predictive analytics such as temporal- and spatial-based traffic enforcement?				Describes ALPR use in agency	Provides background to ALPR use within agency
Database, HOT Lists and Data Storage
Do you develop or maintain databases or HOT lists for the agency?				Establishes how databases are managed or created	Important information for developing additional lines of questioning
Which ALPR databases or HOT lists do you work with?				Establishes types of ALPR databases present at the agency	Important information for developing additional lines of questioning
Probe: How are they developed?				Specific topic of study	Provides detail of how the agency creates or develops database or data systems
Probe: How are they maintained?				Specific topic of study	Provides detail for better understanding the agency’s data maintenance program
How often is data uploaded to the database of HOT list?				Establishes frequency for increasing ALPR data for field use	Provides detail for better understanding the agency’s data dissemination efforts
How often is the updated data provided to users in the field?				Establishes a time reference for increasing ALPR data for field use	Provides detail for better understanding the agency’s data development efforts
What issues do you have, if any, with the databases or HOT lists specific to using them for detecting drivers with suspended, revoked, or restricted licenses?				Establishes scope of effort in developing usable ALPR data pertaining to license violation	Provides detail for better understanding the agency’s data development efforts
Does your agency share ALPR data/databases with other agencies?				Opens dialogue about the sharing of ALPR data with others	Helps identify how transfer of information is performed across agencies for traffic safety purposes
If yes: With what other agencies do you share data?				Probing question for insight expansion	Provides detail for better understanding the scope of data sharing
If yes: How has this sharing of data proven to be effective in improving traffic safety?				Probing question for insight expansion	Provides detail for understanding shared resources and their effectiveness
Are you familiar with your agency’s data retention and storage practices?		
If yes: How is the ALPR data that is collected for traffic safety purposes retained and stored?				Opens dialogue concerning data retention and storage	Used to understand warehousing practices of agencies using ALPRs for traffic safety purposes
If yes: How long does your agency store ALPR data that is collected?				Opens dialogue concerning how long ALPR data is stored and what are the agencies purging practices	Used to understand warehousing practices of agencies using ALPRs for traffic safety purposes
If yes: If your agency purges data, how often is the data purged?				Probing question for insight expansion	Used to better understand purging and purge record keeping practices of agencies using ALPRs for traffic safety purposes
Does your agency have any types of data sharing policies or inter-agency agreements with other law enforcement agencies? If yes, please explain.				Opens dialogue concerning ALPR data sharing practice between different law enforcement agencies	Explores policy and practice between agencies regarding the sharing of ALPR data
What is your agency‘s policy on how the collected ALPR data can be linked to state and national criminal and traffic safety databases?				Opens dialogue for discussing connectivity between agency ALPR databases and other state and national data clearinghouses	Explores the issues of compatibility of ALPR data and other outside clearinghouses
Effectiveness and Value
How do you characterize the effectiveness of using ALPRs as a traffic safety treatment?				Provides a picture of ALPRs effectiveness in addressing traffic safety	Speaks to how the use of ALPR is employed as a traffic safety countermeasure
Probe: Specifically, how effective is ALPR in detecting drivers who have suspended, revoked or restricted licenses?				Provide specificity about the success of ALPR for license violations	Focus’ on effectiveness of ALPR for license violations
Probe: Can you provide some specific examples of its effectiveness (or not) for that purpose?				Provide specificity about the success of ALPR for license violations	Qualifies the extent of effectiveness
How does the agency measure success/effectiveness of ALPR technology for addressing traffic safety?				Provide insight into administrator views on success of ALPR as a safety treatment	Provides a picture of agency support based on their view of success
Probe: What are some specific indicators or metrics that your agency uses to measure success of using ALPRs for traffic safety purposes?				Provides specific examples of indicators and metrics that gauge the success of ALPRs	Promotes discussion about different metrics that are used as benchmarks for success
Do you believe that your agency has received a good return on the investment in terms of using ALPRs as a traffic safety treatment?				Provides overall perspective on success of ALPRs	Bottom line assessment of ROI
Probe: Can you provide some specific examples of the benefit or value of using ALPR for traffic safety purposes?				Provides specific indicators of success of ALPRs	Assessment of ROI
Challenges in Use of ALPR for Traffic Safety
What challenges do you/ does your agency face [in using/ in managing users] of ALPR technology for traffic safety purposes? Probe for specific challenges: technical, operational, institutional.				Establishes scope of effort in using ALPR for traffic safety purposes	Helps better understand the respondents experiences with using the ALPR
IF APPLICABLE: What about challenges in using/managing ALPR to detect drivers with suspended, revoked or restricted licenses?				Provides specificity about how a user addresses driver license issues	Focus is on dealing with challenges in driver license issues
Were those challenges internal to the agency or external from the community?				Provides specificity about the challenges	Helps better understand the respondents experiences with using the ALPR
Probe: How do you as a user/manager/ administrator respond to those challenges?				Identifies solutions in which users overcome issues	Helps better understand how the respondent addressed challenges
Have these challenges changed in the past year?				Identifies any potential Post-Ferguson impacts on agency use of ALPR	Sets up next question
If yes: To what do you attribute those changes?				Identifies any potential Post-Ferguson impacts on agency use of ALPR	Characterizes impacts
Legal Issues
Has your agency run into any legal issues with regard to using ALPR for traffic safety purposes?				Opens dialogue regarding an agency’s privacy practices regarding ALPR data that has been collected for traffic safety purposes	Question is used to better understand how ALPR data privacy issues are addressed
If yes: What were they and how did your agency manage those issues?		
Agency Acceptance of ALPRs
Overall, how do you feel about using ALPR for traffic safety purposes – as compared to using it for other enforcement type purposes?				Explores the opinion of the respondent about using ALPRs for traffic safety	Provides better understanding of motivators that could impact ALPR use as a traffic safety treatment
To the best of your knowledge, how do other law enforcement agents/officers in your agency feel about using ALPR for traffic safety purposes – as compared to using ALPR for other enforcement type purposes?				Explores the opinion of the respondent on how others feel about using ALPRs for traffic safety	Provides better understanding of motivators that could impact ALPR use as a traffic safety treatment
Probe on the differences in the way managers vs. officers feel about the use of ALPRs for traffic safety purposes.		
How would you characterize your agency administration’s support for using ALPR for traffic safety purposes?				Determines the level of support from administrators with regard to using ALPR to improve traffic safety	Provides insight into how users and managers see administrative support for using ALPRs
Has department policy changed in the past year regarding use of ALPR?				Identifies any potential Post-Ferguson impacts on agency use of ALPR	Characterizes impacts
If yes: In what ways? To what do you attribute that?				Identifies any potential Post-Ferguson impacts on agency use of ALPR	Characterizes impacts
Probe: What about policy changes regarding ALPR use specifically for traffic safety purposes?				Identifies any potential Post-Ferguson impacts on agency use of ALPR	Characterizes impacts
Community Acceptance of ALPR
Do you believe that your agency has community support for using ALPR as a traffic safety treatment?				Opens dialogue about community support for using ALPR for traffic safety	Helps identify whether or not the community favors using ALPR for traffic safety purposes
Have you received any feedback from the community regarding the use of ALPRs for traffic safety purposes? If yes: Was the feedback positive or negative or both positive and negative?				Opens dialogue for discussing communication feedback between the agency and the community	Provides better understanding of the relationships between citizens that ALPRs are used on and the law enforcement agency that use ALPR technology
[IF APPLICABLE] Have you or your agency received community feedback on the use of ALPRs for drivers with suspended, revoked or restricted licenses?				Explores the specificity that ALPR has on addressing licensing issues and the interactions that law enforcement agencies might have with the community	Provides better understanding of the relationships between citizens that ALPRs are used on and the law enforcement agency that use ALPR technology
If yes: What concerns if any have been raised and how have those concerns been addressed?				Determines the level of interaction encountered between the citizens or the community and the law enforcement agency	Provides better understanding of the relationships between citizens that ALPRs are used on and the law enforcement agency that use ALPR technology
Privacy Issues
Has your agency run into any privacy concerns with regard to using ALPR for traffic safety purposes? If yes: Please tell me about how your agency managed those issues?				Opens dialogue regarding an agency’s privacy practices regarding ALPR data that has been collected for traffic safety purposes	Question is used to better understand how ALPR data privacy issues are addressed
What steps does your agency take to ensure that privacy of ALPR data is protected?				Probing question for insight expansion	Explores steps that agencies take to ensure privacy of data is secure
Who has access to review the ALPR data that is stored at your agency?				Probing question for insight expansion	Defines whom within an agency has access rights to ALPR data
Does your agency allow the public or civilian review of the stored ALPR data at your agency?				Probing question for insight expansion	Specifies whom is allowed access to ALPR data records kept by an agency
Is the review of the ALPR data all access or is it provided in a dashboard format?				Probing question for insight expansion	Specifies whom is allowed access to ALPR data records kept by an agency