SOLUTIONS® wound care algorithm Federally-supported guideline to facilitate health care professionals' decision making by providing "management and evaluation strategies for acute and chronic wound care" Misapplication can generate negative impact due to misdiagnosis and worsening of symptoms Health United States Federal Agency for Healthcare Research and Quality Yes ConvaTec September 2013 Endorsement of use Yes https://guideline.gov/summaries/summary/47857

Interim Guidelines for Pregnant Women During a Zika Virus Outbreak "Testing algorithm for a pregnant woman with history of travel to an area with Zika virus transmission, with or without clinical illness consistent with Zika virus disease" Misapplication can generate negative impact due to misdiagnosis and worsening of symptoms and spread of disease Health United States Federal Centers for Disease Control (CDC) No Centers for Disease Control (CDC) January 2016 Active use and endorsement of use No http://www.cdc.gov/mmwr/volumes/65/wr/mm6502e1.htm

Emergency Severity Index Version 4 Triage Algorithm "A five level emergency department (ED) triage algorithm that provides clinically relevant stratification of patients into five groups from least to most urgent based on acuity and, unique to ESI, resource needs" Misapplication can generate negative impact due to misdiagnosis and worsening of symptoms Health United States Federal Agency for Healthcare Research and Quality Yes ESI Triage Research Team, LLC November 2011 Endorsement of use Yes http://www.ahrq.gov/sites/default/files/wysiwyg/professionals/systems/hospital/esi/esihandbk.pdf

Planned Readmission Algorithm "A set of criteria for classifying readmissions as planned or unplanned using Medicare claims." Used to determine Medicare payments for patients that have to return to the hospital Miscalculation can lead to negative impact on providers, or to unfairly benefiting others, and overall misinforming users. Can also generate controversy about validity of methods Health United States Federal Centers for Medicare & Medicaid Services (CMS) Yes Yale New Haven Health Services Corporation Center for Outcomes Research & Evaluation (YNHHSC/CORE) March 2013 Endorsement of use No https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/HospitalQualityInits/Measure-Methodology.html

CoCASA (Comprehensive Clinic Assessment Software Application) "A tool for assessing immunization coverage and practices within a provider clinic, or any other environment where immunizations are provided." "After immunization data is entered or imported into CoCASA, data analysis capabilities can be utilized for coverage assessment purposes providing a variety of different reports that can be utilized to pinpoint areas of strength and areas requiring improvement for an individual immunization provider." Used by healthcare providers to evaluate the overall treatment and immunization of their patients. Miscalculation could to the spread of an infectious disease Health United States Federal Centers for Disease Control (CDC) No Centers for Disease Control (CDC) N/A Endorsement of use Yes http://www.cdc.gov/vaccines/programs/cocasa/index.html

CNSA Suite According to their documentation, "cryptographic algorithms are specified by the National Institute of Standards and Technology (NIST) and are used by NSA's Information Assurance Directorate (IAD) in solutions approved for protecting National Security Systems (NSS). They include cryptographic algorithms for encryption, key exchange, digital signature, and hashing." Mistakes can create negative impact by putting cybersecurity of government systems at risk Cybersecurity United States Federal National Institute of Standards and Technology and National Security Agency No NIST January 2016 Active use Yes https://www.iad.gov/iad/library/ia-guidance/ia-solutions-for-classified/algorithm-guidance/index.cfm

WAste Reduction Algorithm (WAR) According to its own description, it "evaluates processes in terms of potential environmental impacts (PEI)", which are the effects that a chemical would have on the environment if it were released into the environment. Used by industry to determine how the emission of pollutants will affect the environment Errors can lead to unexpected negative impact to the environment Environment United States Federal Environmental Protection Agency (EPA) No Environmental Protection Agency August 2011 Endorsement of use Yes https://www.epa.gov/chemical-research/waste-reduction-algorithm-chemical-process-simulation-waste-reduction

ENPI V4.0 Assists power plants and corporate managers in calculating and tracking their energy consumption Misapplication can generate negative impact by showing wrong levels of consumption, creating problems in planning and budget Energy United States Federal Department of Energy No Department of Energy September 2014 Endorsement of use Yes http://energy.gov/eere/amo/downloads/enpi-v40-user-manual

Freeway Lane Selection Algorithm According to its description, it "will enable transportation professionals to more accurately model lane-changing behavior on freeways." Used by transportation planning agencies to simulate driver behaviour and, therefore, plan accordingly Can have a negative impact by leading administrators to improperly plan highways Transportation United States Federal Federal Highway Administration No Federal Highway Administration December 2006 Endorsement of use Yes http://www.fhwa.dot.gov/publications/research/operations/06136/

Avue Third-party automated hiring system for government employees Might be unfair in excluding appropriate candidates or generate negative impact by including inappropriate candidates for government employment Personnel United States Federal Office of Personnel Management (OPM) Yes Avue Technologies Corporation N/A Active use Yes https://www.mspb.gov/MSPBSEARCH/viewdocs.aspx?docnumber=253627&version=253914&application=ACROBAT

Commerce Opportunities On-Line (COOL) Automated hiring system for government employees Might be unfair in excluding appropriate candidates or generate negative impact by including inappropriate candidates for government employment Personnel United States Federal Office of Personnel Management (OPM) No U.S. Department of Commerce N/A Active use Yes https://www.mspb.gov/MSPBSEARCH/viewdocs.aspx?docnumber=253627&version=253914&application=ACROBAT

QuickHire Third-party automated hiring system for government employees Might be unfair in excluding appropriate candidates or generate negative impact by including inappropriate candidates for government employment Personnel United States Federal Office of Personnel Management (OPM) Yes QuickHire LLC, a division of Monster Government Solutions N/A Active use Yes https://www.mspb.gov/MSPBSEARCH/viewdocs.aspx?docnumber=253627&version=253914&application=ACROBAT

Resumix Third-party automated hiring system for government employees Might be unfair in excluding appropriate candidates or generate negative impact by including inappropriate candidates for government employment Personnel United States Federal Office of Personnel Management (OPM) Yes Yahoo! Resumix N/A Active use Yes https://www.mspb.gov/MSPBSEARCH/viewdocs.aspx?docnumber=253627&version=253914&application=ACROBAT

USA Staffing Hiring software for federal agencies that "positions agencies to acquire, assess, certify, select, and onboard qualified candidates precisely, efficiently and cost-effectively" Might be unfair in excluding appropriate candidates or generate negative impact by including inappropriate candidates for government employment Personnel United States Federal Office of Personnel Management (OPM) No Office of Personnel Management (OPM) N/A Active use Yes https://www.opm.gov/services-for-agencies/technology-systems/usa-staffing/

Health Professional Shortage Area (HPSA) designation score HPSAs indicate health care provider shortages. They are scored using metrics of provider IDs, mapping, and Census data Miscalculation can lead to negative impact in areas with real shortages of health professionals that might not be included on the list Health United States Federal Health Resources & Services Administration (HRSA) No Health Resources & Services Administration (HRSA) October 2016 Active use Yes https://bhw.hrsa.gov/shortage-designation/application-scoring-process

Habitat Areas of Particular Concern (HAPC) scoring formula Used to determine which areas should be designated as HAPCs, coastal sea regions which are prioritized for conservation efforts Negative impact can arise from erroneous exclusions which lead to an area not receiving appropriate protection, or erroneous inclusions which bring about restrictions to fisheries Environment United States Federal National Oceanic and Atmospheric Administration No National Oceanic and Atmospheric Administration September 2010 Active use No https://alaskafisheries.noaa.gov/sites/default/files/hapc_process092010.pdf

Assessment Decision Tool (ADT) System "designed to help human resources professionals and hiring supervisors/managers develop assessment strategies targeted to specific competencies and other situational factors relevant to their hiring situation" Might be unfair in excluding appropriate candidates or generate negative impact by including inappropriate candidates for government employment Personnel United States Federal Office of Personnel Management (OPM) No Office of Personnel Management N/A Active use No https://apps.opm.gov/ADT/ADTClientMain.aspx?JScript=1

CareScience Risk Assessment Model Uses three metrics: mortality, complications, and morbidity, to measure hospitals' quality of care Miscalculation can lead to negative impact on providers, or to unfairly benefiting others, and overall misinforming users. Can also generate controversy about validity of methods Health United States Federal Agency for Healthcare Research and Quality Yes CareScience, Inc. N/A Endorsement of use Yes https://archive.ahrq.gov/professionals/quality-patient-safety/quality-resources/tools/mortality/KrochRisk3.html

Safety Net Provider Financial Health Assesses financial situation of healthcare providers Might have a negative impact of not detecting financial unsoundness of providers. Can also generate controversy about validity of methods Health United States Federal Agency for Healthcare Research and Quality No Agency for Healthcare Research and Quality September 2003 Active use Yes https://archive.ahrq.gov/data/safetynet/clouse.htm

Patterns of Violations Used to determine safety in mines Can have a negative impact in miners' lives by failing to accurately flag dangerous mines Safety United States Federal Mine Safety and Health Administration (MSHA) No Mine Safety and Health Administration (MSHA) 2013 Active use Yes https://arlweb.msha.gov/POV/POVsinglesource.asp

Risk-Based Method for Prioritizing CGMP Inspections of Pharmaceutical Manufacturing Sites Selects drug manufacturing sites for inspection Failure to flag unsafe drug manufacturing sites might lead to high magnitude negative impact in the form of sending unsafe products to the market and harming patients Health United States Federal Food and Drug Administration (FDA) No Food and Drug Administration (FDA) September 2004 Active use Yes http://www.fda.gov/ohrms/dockets/ac/04/briefing/2004-4080b1_04_risk-based.pdf

Star ratings for Dialysis Facility Compare (DFC) DFC is a tool that enables patients to find providers of dialysis care. The tool has a star system that is automatically calculated using nine quality measures Miscalculation can lead to negative impact on providers, or to unfairly benefiting others, and overall misinforming users. Can also generate controversy about validity of methods Health United States Federal Centers for Medicare & Medicaid Services (CMS) No Centers for Medicare & Medicaid Services (CMS) June 2016 Active use Yes https://www.medicare.gov/dialysisfacilitycompare/

Fraud Prevention System (FPS) Algorithmic system that uses predictive modeling technology to prevent fraudulent Medicare payments Failure to detect fraudulent payment can lead to the high magnitude negative impact of monetary loss for the government. False positives can impact providers Health; Fiscal management United States Federal Centers for Medicare & Medicaid Services (CMS) No Centers for Medicare & Medicaid Services (CMS) November 2016 Active use Yes https://www.cms.gov/outreach-and-education/outreach/partnerships/fraudpreventiontoolkit.html

Vulnerability and Risk Assessment Tool (VRAT) Identifies risks and vulnerabilities in postal facilities Can have a negative impact in workers' lives by failing to accurately flag risks in facilities Safety United States Federal U.S. Postal Service No U. S. Postal Service N/A Active use Yes http://about.usps.com/who-we-are/foia/mis-updated-description.pdf

Do Not Pay (DNP) Business Center System that signals vendors that should not receive payments from agencies, based on criteria determined by the agencies Might be unfair by way of incorrectly flagging a vendor as improper or incorrecly failing to flag an improper vendor, also creating negative impact in this market Fiscal management United States Federal Bureau of the Fiscal Service No Bureau of the Fiscal Service August 2016 Active use Yes https://donotpay.treas.gov/index.htm

Microcomputer Assisted Rating System (MARS) An automated system to rate and rank applicants for jobs where no written test is required Might unfairly exclude appropriate candidates or generate negative impact by including inappropriate candidates for government employment Personnel United States Federal Office of Personnel Management (OPM) No Office of Personnel Management (OPM) 1994 Active use Yes https://clinton6.nara.gov/1994/06/1994-06-30-npr-report-office-of-personnel-management.html

Risk Assessment for Improper Payment Estimates the rate of improper payment rates by the Department of Defense Might have a negative impact in the form of ignoring expenses that would increase the rate of improper payments Defense; Fiscal management United States Federal Defense Finance and Accounting Service (DFAS) No Defense Finance and Accounting Service (DFAS) 2013 Active use No http://comptroller.defense.gov/Portals/45/documents/gwipr/fy2014/riskAssessment/DFAS_Risk_Assessment_FY2014.pdf

Annual Overall Rating (AOR) Evaluates concessioners to measure if they are "complying with their contracts and meet all NPS operational performance, environmental management, asset management, risk management, public health and administrative compliance standards," acording to its own description Might be unfair in incorrectly rating a concessioner for exclusion or incorrectly ignoring factors that should exclude other concessioners. Can negatively impact both the concession market and the users of National Parks Fiscal management United States Federal National Park Service (NPS) No National Park Service (NPS) March 2016 Active use Yes https://concessions.nps.gov/docs/concessioner%20tools/AOR_Workbook_User_Guide.pdf

Documented Safety Analysis (DSA) Guidelines that "systematically identify and assess hazards" in nuclear facilities Can negatively impact in workers' lives by failing to accurately flag risks in facilities. Because this is the nuclear sector, the magnitude of the negative impact may be large Safety United States Federal Department of Energy No Department of Energy April 2002 Active use No https://energy.gov/sites/prod/files/2013/07/f2/std3009_cn2_rl.pdf

National Electric Sector Cybersecurity Organization Resource (NESCOR) Guidance to create cybersecurity risk assessment processes for energy distribuition systems with a scoring system for threats to determine corrective actions Mistakes can create negative impact by putting cybersecurity of power supply at risk Cybersecurity United States Federal Department of Energy No Department of Energy December 2013 Endorsement of use No https://energy.gov/sites/prod/files/2014/04/f14/IntegratingElectricitySubsectorFailureScenariosIntoARiskAssessmentMethodology.pdf

ENERGY STAR Energy efficiency rating system for products Mistakes lead to negative impact on consumers, who might inadvertently choose inefficient products. Because of its broad scope, the magnitute of the impact could be large Energy United States Federal Environmental Protection Agency (EPA) No Environmental Protection Agency (EPA) 1992 Endorsement of use Yes https://energy.gov/sites/prod/files/2013/11/f5/existing_labels.pdf

Building Energy Asset Score (Asset Score) Energy efficiency rating system for buildings Mistakes lead to negative impact on planners, who might inadvertently construct inefficient buildings Energy United States Federal Department of Energy No Department of Energy 2012 Endorsement of use Yes https://energy.gov/sites/prod/files/2013/12/f5/asset_score_api_webinar_061413_0.pdf

Early identification of delinquent operators Predictive analysis for unsafe mines Can have a negative impact in miners' lives by failing to accurately flag dangerous mines Safety United States Federal Mine Safety and Health Administration (MSHA) No Summit Consulting, LLC March 2016 Active use Yes http://fcsm.sites.usa.gov/files/2016/03/F3_Dai_2015FCSM.pdf

Recruitment One-Stop System includes automated assesment tool for candidates for government employment Might unfairly exclude appropriate candidates or generate negative impact by including inappropriate candidates for government employment Personnel United States Federal Office of Personnel Management (OPM) No Office of Personnel Management (OPM) N/A Active use Yes https://georgewbush-whitehouse.archives.gov/omb/egov/c-4-2-recruit.html

Financial Services Sector All-Hazards Threat Matrix Accounts for over 1,900 individual threats to the financial sector of the United States Might have negative impact of high magnitude by way of failing to detect threats. Can also be controversial, considering the lack of clarity about which are the parameters Safety United States Federal Department of Homeland Security (DHS) No Department of Homeland Security (DHS) 2009 Active use Yes https://homeland.house.gov/files/Testimony%20Carlin_0.pdf

Ecological Monitoring Framework Creates a method of assigning scores to ecological condition of parks Failure can negatively impact the condition of national parks Environment United States Federal National Park Service (NPS) No National Park Service (NPS) 2009 Active use No https://irma.nps.gov/DataStore/DownloadFile/448300

Proposed Project Selection Method for Human Support Research and Technology Development Proposal of a formula to rate projects for NASA's Human Support Research and Technology Development Miscalculation can negatively impact the planning of space exploration and the scientists working on it Management United States Federal National Aeronautics and Space Administration (NASA) No National Aeronautics and Space Administration (NASA) Jan 2005 Potential use No https://ntrs.nasa.gov/search.jsp?R=20050158745

Self-assessment of Public Financial Management Performance (PFMP-SA) A toolkit for health sector managers to "assess their systems and procedures to improve accountability and performance" Miscalculation can negatively impact foreign health planning and all the people who rely on it Management United States Federal United States Agency for International Development (USAID) No Abt Associates Inc Dec 2013 Endorsement of use No http://pdf.usaid.gov/pdf_docs/PA00KF1T.pdf

Healthy Home Rating System (HHRS) Assesses the hazards and the potential effect of conditions of housing May underestimate risks involved in housing, causing negative impact on residents Health; safety United States Federal Department of Housing and Urban Development (HUD) No Department of Housing and Urban Development (HUD) January 2014 Endorsement of use No https://portal.hud.gov/hudportal/documents/huddoc?id=operatingguidanceHHRS_1-14.pdf

Risk Assessment Methodology for Critical Infrastructures (RAM-CI) "Provides a user-friendly, systematic, and comprehensive risk-based tool to assist CI sector and security professionals in assessing and managing security risk from malevolent threats." Failure can lead to missed threats to critical infrastructure, leading to a negative impact of high magnitude Safety United States Federal Sandia National Laboratories No Sandia National Laboratories December 2008 Endorsement of use Yes http://prod.sandia.gov/techlib/access-control.cgi/2008/088143.pdf

Risk Informed Algorithm Used to prioritize high risk food inspections Failure can lead to consumers getting sick, a negative impact of high magnitude Safety United States Federal Food and Drug Administration (FDA) No Food and Drug Administration (FDA) October 2010 Active use Yes http://www.accessdata.fda.gov/scripts/fdatrack/view/track_project.cfm?program=cfsan&id=CFSAN-OC-Risk-Informed-Algorithm

Tool 3K Assists healthcare providers as to the best way to increase patient mobility without the risk of falling Can negatively impact patients that are being mobilized Health United States Federal Agency for Healthcare Research and Quality (AHRQ) No Central DuPage Hospital January 2013 Endorsement of use No https://www.ahrq.gov/professionals/systems/hospital/fallpxtoolkit/fallpxtk-tool3k.html

API/FCI Analysis Chart Chart that combines two metrics about facilities - the Criticality of Asset Asset Priority Index (API) and the Facilities Condition Index (FCI) - to determine what should be done with them Might lead to a negative impact with high magnitude upon infrastructure Management United States Federal Department of the Interior No Department of the Interior July 2012 Active use No https://www.blm.gov/style/medialib/blm/nifc/im.Par.29394.File.dat/FA_IM2013016a3.pdf

Algorithm for Fall Risk Assessment & Interventions Assists healthcare providers as to the best way to increase patient mobility without the risk of falling Can negatively impact patients that are being mobilized Health United States Federal Centers for Disease Control (CDC) No Centers for Disease Control (CDC) N/A Endorsement of use No https://www.cdc.gov/steadi/pdf/algorithm_2015-04-a.pdf

Category Rating The category rating process ranks candidates that have been evaluated/rated against minimum qualification requirements by placing them into one of two or more predefined quality categories Might unfairly exclude appropriate candidates or generate negative impact by including inappropriate candidates for government employment Personnel United States Federal Office of Personnel Management (OPM) No Office of Personnel Management (OPM) March 2006 Active use No https://www.chcoc.gov/sites/default/files/trans727.pdf

Open Source Indicators (OSI) Project that "automatically anticipates and detects significant societal events using publicly available data" A missed event can impair the government's reaction to it, leading to a negative impact, possibly of high magnitude Intelligence United States Federal Intelligence Advanced Research Projects Activity (IARPA) No Intelligence Advanced Research Projects Activity (IARPA) August 2011 Active use Yes https://www.iarpa.gov/index.php/research-programs/osi

Clinical Criteria Algorithm for Wheelchair Prescribing Used to determine which patients get access to wheelchair Can lead to negative impact on patients who need the equipment but are not included in these parameters Health United States Federal Centers for Medicare & Medicaid Services (CMS) No Centers for Medicare & Medicaid Services (CMS) N/A Endorsement of use No https://www.cms.gov/Medicare/Coverage/DeterminationProcess/downloads/id143c.pdf

Wireless Emergency Alert (WEA) – Cell Radio Frequency (RF) Propagation Algorithm Algorithm that determines cell phone tower footprints, to select which can be used to send emergency messages Might exclude geographical locations from receiving emergency messages, leading to the negative impact of loss of life Safety United States Federal Department of Homeland Security (DHS) No Department of Homeland Security June 2014 Active use Yes https://www.dhs.gov/sites/default/files/publications/WEA%20-%20TCS%20Final%20Report.pdf

Logical Response Aperture (LRA) Advanced Automated Analytics Detects malware and other "hostile activity against the networks of US government agencies and other protected entities" Mistakes can have negative impact by putting cybersecurity of government systems at risk Cybersecurity United States Federal Department of Homeland Security (DHS) No Department of Homeland Security February 2016 Active use Yes https://www.dhs.gov/sites/default/files/publications/dpiac-report-2016-01-algorithmic-analytics_0.pdf

Intrusion Detection System (IDS) Detects threats to government networks Mistakes can have negative impact by putting cybersecurity of government systems at risk Cybersecurity United States Federal Department of Homeland Security (DHS) No Department of Homeland Security July 2012 Active use Yes https://www.dhs.gov/sites/default/files/publications/privacy/DPIAC/NCPS%20Overview_DPIAC_31OCT2012.pdf

Cost Estimating Guide for Road Construction Calculates the cost of building different types of roads, including labor costs Might fail to take in account specific costs, leading to negative impact upon the management of funds Management; environment United States Federal Forest Service No Forest Service March 2013 Active use No https://www.fs.usda.gov/Internet/FSE_DOCUMENTS/stelprdb5279284.pdf

Cost Estimating Guide for Clearing and Earthwork Calculates the cost of clearing woods and digging projects Might fail to take in account specific costs, leading to negative impact upon the management of funds Management; environment United States Federal Forest Service No Forest Service February 2009 Active use No https://www.fs.usda.gov/Internet/FSE_DOCUMENTS/stelprdb5247289.pdf

Ranking method for managing invasive plant species A decision matrix that takes into account the potential damage of a species and the potential for control of that species Failure to recommend apropriate action might lead to widespread environmental damage, a negative impact with high magnitude Management; environment United States Federal Forest Service No Forest Service March 2011 Active use No https://www.fs.usda.gov/Internet/FSE_DOCUMENTS/stelprdb5309131.pdf

Hazard Tree Rating Method Score that takes into account potential for tree failure (indicators that show danger of it collapsing) and potential for damage (potential for striking a target, potential for damaging a target, and target value) Can have a negative impact in peoples' lives by failing to accurately rate hazardous trees Management; environment United States Federal Forest Service No Forest Service N/A Active use No https://www.fs.usda.gov/detail/r10/forest-grasslandhealth/?cid=fsbdev2_038339

Merit Promotion Calculation method to give department employees "an opportunity to receive fair, equitable, and appropriate consideration for higher level jobs" Might unfairly exclude appropriate candidates or generate negative impact by including inappropriate candidates for government promotion Personnel United States Federal Department of Agriculture No Department of Agriculture July 2002 Active use No http://www.fsa.usda.gov/Internet/FSA_File/merit_promotion.pdf

Listeria monocytogenes risk-based verification sampling algorithm Defines thresholds for sampling tests of meats Might have a nagative impact of high magnitude by way of failing to inspect samples properly, which might lead to mass contamination Safety United States Federal Food Safety and Inspection Service (FSIS) No Food Safety and Inspection Service (FSIS) May 2012 Active use Yes https://www.fsis.usda.gov/wps/wcm/connect/45800bd0-64f2-45c5-811c-e93f16797a1c/Updates-Lm-Verification-Sampling-Algorithm.pdf?MOD=AJPERES

Diagnosis and Treatment of Headache Diagnosis Algorithm Guides treatment of headaches depending on symptoms Misapplication can generate negative impact due to misdiagnosis and worsening of symptoms Health United States Federal Agency for Healthcare Research and Quality (AHRQ) Yes Institute for Clinical Systems Improvement January 2006 Endorsement of use No https://www.guideline.gov/algorithm/4769/NGC-4769_2.pdf

Phonetic Orthographic Computer Algorithm (POCA) Determines the orthographic and phonetic similarity between two drug names. Used to assess the safety, and feasibility of proposed proprietary drug names. Failure can cause negative impact of high magnitude by creating confusion among patients due to similar drug names Health United States Federal Food and Drug Administration (FDA) No Food and Drug Administration (FDA) April 2015 Active use Yes https://www.healthdata.gov/dataset/poca-phonetic-orthographic-computer-algorithm

Healthcare Failure Modes and Effects Analysis (HFMEA) Used to analyze the risk of failure in patient care. Might lead to patients not being treated properly Health United States Federal Department of Veterans Affairs No Department of Veterans Affairs May 2014 Active use No http://www.patientsafety.va.gov/docs/joe/hfmea_intro_jm_may14.doc

Automated Underreporter (AUR) Automated analysis and processing of potential underreported and/or over-deducted tax returns Might have a negative impact of high magnitude by not flagging tax returns that should be audited, causing loss to the government. Could also be unfair to some contribuitors Management; taxes United States Federal Internal Revenue Service (IRS) No Internal Revenue Service (IRS) September 2016 Active use Yes https://www.irs.gov/irm/part4/irm_04-019-003r.html

Program Assessment Guide (PAG) Assess efficacy of government programs, using weighted scoring card Might not identify failing programs, causing the negative impact of monetary loss to the government Management United States Federal Department of Labor No Department of Labor August 2013 Active use No http://www.jobcorps.gov/Libraries/pdf/pag.sflb

Gang Graffiti Automatic Recognition and Interpretation (GARI) Application which helps law enforcement and gang task force officers identify and interpret gang graffiti or tattoo images. It compares the image against an image database and provides details about the identity and meaning of the graffiti or tattoo Might miss signals related to gangs, negatively impacting the police force. Also, might mistakingly identify tattoos as gang-related, causing harm to people who have them, potentially leading to controversy Safety United States Federal Department of Homeland Security (DHS) No Purdue University January 2014 Endorsement of use Yes https://www.dhs.gov/sites/default/files/publications/Enhancing%20Community%20Safety-Gang%20Graffiti%20Automatic%20Recognition%20and%20Interpretation%20System-GARI-Jan2014_2.pdf

Coast Guard Search and Rescue Visual Analytics (cgSARVA) "Assessment tool that helps Coast Guard decision-makers understand the risks associated with resource reallocation for search and rescue missions" Might prevent a mission from taking place, leading to the negative impact of endangering the lives of people who need assistance. Tool may also generate controversy

Safety United States Federal Department of Homeland Security (DHS) No Purdue University November 2013 Endorsement of use Yes https://www.dhs.gov/sites/default/files/publications/Enhancing%20the%20USCG%20Operational%20Effectiveness%20With%20COAST-Nov2013.pdf

SALT Mass Casualty Triage Algorithm for a Very Large Radiation Emergency Guidelines for triage of victims of large radiation event Misapplication can generate negative impact by causing victims to not be treated properly Safety United States Federal Radiation Emergency Medical Management (REMM) No Radiation Emergency Medical Management (REMM) December 2016 Active use; endorsment of use No https://www.remm.nlm.gov/salttriage.htm

Contamination: Diagnose/Manage Guidelines for treatment of victims of radiation event Misapplication can generate negative impact by causing victims to not be treated properly Safety United States Federal Radiation Emergency Medical Management (REMM) No Radiation Emergency Medical Management (REMM) December 2016 Active use; endorsment of use No https://www.remm.nlm.gov/contamonly.htm

Exposure: Diagnose/Manage Acute Radiation Syndrome Guidelines for treatment of victims of Acute Radiation Syndrome Misapplication can generate negative impact by causing victims to not be treated properly Safety United States Federal Radiation Emergency Medical Management (REMM) No Radiation Emergency Medical Management (REMM) December 2016 Active use; endorsment of use No https://www.remm.nlm.gov/exposureonly.htm#skip

Automated Cropland Classification Algorithms (ACCA) Algorithm that classifies "agricultural cropland extent, areas, and characteristics (e.g. irrigated vs. rainfed) over large areas such as a country or a region through combination of multi-sensor remote sensing and secondary data" Errors in the algorithm may lead to miscalculation of important metrics for agricultural planning or lead to errors in judging crop yields, leading to negative impact of high magnitude to farmers Management; agriculture United States Federal United States Geological Survey (USGS) No United States Geological Survey (USGS) September 2012 Active use No https://pubs.er.usgs.gov/publication/70098947

Return Review Program "An automated system that will enhance the IRS’s capabilities to prevent, detect, and resolve criminal and civil tax noncompliance" Might not flag tax returns that should be audited, causing the negative impact of monetary loss to the government Management; taxes United States Federal Internal Revenue Service (IRS) No Internal Revenue Service (IRS) July 2015 Potential use Yes https://www.treasury.gov/tigta/auditreports/2015reports/201520060fr.html

Automated Geospatial Watershed Assessment (AGWA) Tool that, according to its documentation, "parameterizes, executes, and spatially visualizes" watershed runoff and erosion models Miscalculation of watershed runoff and erosion might lead to negative impact of losses for farmers and ineffective environmental action Environment United States Federal Agricultural Research Service (ARS) No Agricultural Research Service (ARS) June 2004 Active use Yes http://www.tucson.ars.ag.gov/agwa/

Checklist for conflict sensitivity in education programs Offers a framework for analyzing aspects of education programs, with the objective to reduce conflict and tensions in USAID-run programs Can cause negative impact by failing to assess dangers in USAID programs, leaving workers at risk Education United States Federal United States Agency for International Development (USAID) No United States Agency for International Development (USAID) November 2013 Active use No https://www.usaid.gov/sites/default/files/documents/1865/USAID_Checklist_Conflict_Sensitivity_14FEB27_cm.pdf

Facility Risk Rating Model (FRRM) Identifies risks and vulnerabilities in postal facilities Can have a negative impact in workers' lives by failing to accurately flag risks in facilities Safety United States Federal U.S. Postal Service No U. S. Postal Service December 2007 Active use Yes https://www.uspsoig.gov/sites/default/files/document-library-files/2015/SA-AR-08-003.pdf

Program Assessment Rating Tool (PART) "A questionnaire designed to help assess the management and performance of programs. It is used to evaluate a program’s purpose, design, planning, management, results, and accountability to determine its overall effectiveness" Might not identify failing programs, causing the negative impact of monetary loss to the government Management United States Federal Office of Management and Budget No Office of Management and Budget October 2008 Active use Yes https://www.whitehouse.gov/sites/default/files/omb/assets/OMB/expectmore/part.html

Landslide Hazard Rating Matrix Used to calculate the risk of landslides in highways Can have a negative impact in drivers' lives by failing to accurately flag landslide risks Safety United States Federal Federal Highway Administration (FHWA) No Federal Highway Administration (FHWA) December 2007 Active use No https://ntl.bts.gov/lib/33000/33900/33985/Vol1LandslideHazardRatingMatrixDatabaseFinalReport.pdf

Site-ranking System (SRS) "Ranks hazardous chemical and radioactive waste sites by scoring important and readily available factors that influence risk to human health. Using SRS, sites can be ranked for purposes of detailed site investigations" Can have a negative impact in workers' lives by failing to accurately flag risks in facilities Safety United States Federal Sandia National Laboratories No Sandia National Laboratories May 1988 Active use No http://prod.sandia.gov/techlib/access-control.cgi/1986/862994.pdf

Major Hazard Risk Assessment (MHRA) Used to determine safety in mines Can have a negative impact in miners' lives by failing to accurately flag dangerous mines Safety United States Federal Centers for Disease Control (CDC) No Centers for Disease Control (CDC) October 2008 Active use No https://www.cdc.gov/niosh/mining/UserFiles/works/pdfs/2009-104.pdf

Project Scoring Sheet Scoring calculation to detemine need and value of renovating projects for Department of Interior structures and roads Might lead to a negative impact of high magnitude in infrastructure. According to their own report, the Department "owns and operates over 110,000 buildings and structures, more than 100,000 miles of public roads." "These facilities serve nearly 479 million visitors annually" Management United States Federal Department of the Interior No Department of the Interior 2016 Active use No https://www.doi.gov/sites/doi.gov/files/migrated/pam/programs/asset_management/upload/2016-Att-G-with-appendices.pdf

Statistical CAMELS Off-site Rating (SCOR) Designed to help identify institutions that have experienced noticeable financial deterioration Can have a negative impact upon banks' clients and financial system as a whole by failing to detect financial deterioration in banks Finance United States Federal Federal Deposit Insurance Corporation (FDIC) No Federal Deposit Insurance Corporation (FDIC) 1998 Active use No https://www.fdic.gov/bank/analytical/banking/2003sep/2_15n3.pdf

Venous Thromboembolism Pulmonary Embolism Diagnosis Algorithm Guides treatment of pulmonary embolism depending on symptoms Misapplication can generate negative impact due to misdiagnosis and worsening of symptoms Health United States Federal Agency for Healthcare Research and Quality (AHRQ) Yes Institute for Clinical Systems Improvement, Inc. June 2007 Endorsement of use No https://www.guideline.gov/algorithm/5885/NGC-5885_2.pdf

Emerging Clusters A "method for identifying emerging, high-impact technology clusters and trends based on patents, citations, co-citations, and clusters of patents" with the purpose of "fostering regional

innovation" Failure to recognize emerging clusters of technology can negatively impact commercial strategy and harm the economy and competitiveness of the United States Economy United States Federal Department of Commerce No Department of Commerce October 2007 Active use Yes https://www.ntis.gov/assets/pdf/Report-EmergingClusters.pdf

Lender Risk Rating System A tool to assist the Small Business Administration (SBA) in assessing the risk of each

active Lender’s and Certified Development Company’s (CDC’s) SBA loan operations and loan portfolio Might lead to a negative impact on small businesses not being able to borrow money or it might lead to the government lending money to improper businesses Finance United States Federal Small Business Administration (SBA) No Small Business Administration (SBA) March 2010 Active use Yes https://www.sba.gov/sites/default/files/files/lender_risk_rating_system.pdf

Automated detection of improper data Tools automatically detect data that is inapropriatly collected by the intelligence agency, such as data from American citizens without legal authorization Controversy might arise from the lack of clarity of the parameters for exclusion. Failure leads to negative impact by violating the privacy of citizens Cybersecurity; privacy United States Federal National Security Agency (NSA) No National Security Agency (NSA) October 2014 Active use Yes https://www.nsa.gov/about/civil-liberties/reports/assets/files/nsa_clpo_report_targeted_EO12333.pdf

Advanced Concepts & Performance Assessments MD71 program Algorithms that model ballistic missile simulation to analyze and improve ballistic defense systems Failure can lead to negative impact of high magnitude via lack of proper defense of the U.S. against ballistic missiles, leading to mass casualty Defense United States Federal Missile Defense Agency No Missile Defense Agency February 2016 Active use Yes http://comptroller.defense.gov/Portals/45/Documents/defbudget/FY2017/budget_justification/pdfs/03_RDT_and_E/MDA_RDTE_MasterJustificationBook_Missile_Defense_Agency_PB_2017_1.pdf

Aegis BMD Algorithm Development, Modeling & Simulation, Performance Analysis Algorithms that model ballistic missile simulation to analyze and improve ballistic defense systems Failure can lead to negative impact of high magnitude via lack of proper defense of the U.S. against ballistic missiles, leading to mass casualty Defense United States Federal Missile Defense Agency No Missile Defense Agency February 2016 Active use Yes http://comptroller.defense.gov/Portals/45/Documents/defbudget/FY2017/budget_justification/pdfs/03_RDT_and_E/MDA_RDTE_MasterJustificationBook_Missile_Defense_Agency_PB_2017_1.pdf

Simultaneous Correlation of Unambiguous Tracks (SCOUT) Algorithm Algorithms that model ballistic missile simulation to analyze and improve ballistic defense systems Failure can lead to negative impact of high magnitude via lack of proper defense of the U.S. against ballistic missiles, leading to mass casualty Defense United States Federal Missile Defense Agency No Missile Defense Agency February 2016 Active use Yes http://comptroller.defense.gov/Portals/45/Documents/defbudget/FY2017/budget_justification/pdfs/03_RDT_and_E/MDA_RDTE_MasterJustificationBook_Missile_Defense_Agency_PB_2017_1.pdf

Multi-Object Kill Vehicle - MOKV Engagement Management Algorithms Algorithms that model ballistic missile simulation to analyze and improve ballistic defense systems Failure can lead to negative impact of high magnitude via lack of proper defense of the U.S. against ballistic missiles, leading to mass casualty Defense United States Federal Missile Defense Agency No Missile Defense Agency February 2016 Active use Yes http://comptroller.defense.gov/Portals/45/Documents/defbudget/FY2017/budget_justification/pdfs/03_RDT_and_E/MDA_RDTE_MasterJustificationBook_Missile_Defense_Agency_PB_2017_1.pdf

Automated Self-Administered 24-Hour Dietary Assessment Tool (ASA24) A food diary tool recommended to clinicians and patients. Users input meals consumed in a 24hr cycle and the tool returns data and analysis, including dietary recommendations Can lead to negative impact on patients' lives, by suggesting improper diets Health United States Federal National Cancer Institute (NCI) No National Cancer Institute (NCI) 2009 Endorsement of use Yes https://epi.grants.cancer.gov/asa24/

Lease Risk Model Predictive statistical model used to determine risk of fraud in lease contracts of facilities Failure to detect fraudulent leases can lead to negative impact of high magnitude via monetary loss for the government. False positives can impact real-estate owners Finance United States Federal U.S. Postal Service Yes Elder Research October 2013 Active use Yes https://cdn2.hubspot.net/hubfs/2176909/Resources/Elder-Research-Case-Study-Lease-Renewal-Risk-Model-USPS-OIG.pdf

Claimant Risk Analysis Model Predictive modeling used to identify workers’ compensation claims with high-risk of fraud Failure to detect fraudulent leases can lead to negative impact of high magnitude via monetary loss for the government. False positives can impact real-estate owners Finance United States Federal U.S. Postal Service No U. S. Postal Service July 2013 Active use Yes http://docplayer.net/802084-Inspector-general-united-states-postal-service.html

Weighted Airman Promotion System (WAPS) Selection program that determines the promotion of airmen in the United States Air Force Might unfairly exclude appropriate candidates or generate negative impact by including inappropriate candidates for government promotion Personnel; military United States Federal Department of Defense No Department of Defense 1993 Active use Yes http://www.afpc.af.mil/Weighted-Airman-Promotion-System

Veterans’ Preference in Appointments Score that determines the preference of military veterans in federal hiring Might be unfair in excluding appropriate candidates or generate negative impact by including inappropriate candidates for government employment Personnel United States Federal Office of Personnel Management (OPM) No Office of Personnel Management N/A Active use No https://hru.gov/Studio_Recruitment/HT_01_Veterans_Preference.aspx

Uniform Interagency Consumer Compliance Rating System This five-category, numerical rating system standardizes individual agency approaches to measuring the compliance of financial institutions with consumer protection and civil rights laws Might lead to monetary loss Finance United States Federal Department of the Treasury No Department of the Treasury 1980 Active use No https://occ.gov/publications/publications-by-type/comptrollers-handbook/_paginated/overview/over00013.htm

Scoring Matrix to determine the display locations for the space shuttle orbiters Used to determine the final location of the shuttles that had flown in space(Discovery, Atlantis, and Endeavour) There is a clear economic benefit for selected locations, meaning it can unfairly benefit some. Also, there was the potential for controversy Economy United States Federal National Aeronautics and Space Administration (NASA) No National Aeronautics and Space Administration August 2011 Active use No https://oig.nasa.gov/audits/reports/FY11/Review_NASAs_Selection_Display_Locations.pdf

Traffic Analysis Toolbox According to its own description, it includes "methodologies such as sketch-planning, travel demand modeling, traffic signal optimization, and traffic simulation Can lead to bad simulations of traffic, leading to inneficiency and monetary loss Transportation United States Federal Department of Transportation Yes Various November 2004 Endorsement of use Yes http://ops.fhwa.dot.gov/publications/fhwahop08054/sect4.htm

Risk Management Self-Evaluation Framework (RMSEF) A framework for risk management applicable to the transportation of hazardous materials, designed to be used by regulators, shippers, carriers, and emergency response personnel Can generate dangerous conditions for transportation of hazardous material, leading to loss of life Safety; transportation United States Federal Office of Hazardous Materials Safety (OHMS) No Office of Hazardous Materials Safety (OHMS) January 2020 Endorsement of use No http://phmsa.dot.gov/staticfiles/PHMSA/DownloadableFiles/Files/rmsef_security_template.pdf

Tier Ranking System (TRS) II A scoring model to determine compliance by lenders for housing Might lead to a negative impact on people not being able to borrow money or it might lead to the government lending money to improper businesses Finance United States Federal Department of Housing and Urban Development (HUD) No Department of Housing And Urban Development N/A Active use Yes http://portal.hud.gov/hudportal/documents/huddoc?id=spsnarrative.pdf

Fermilab Operations Risk Ranking Matrix This matrix takes in account impact and risk of research. Can generate dangerous conditions for research, leading to loss of life Safety United States Federal Fermi National Accelerator Laboratory (Fermilab) No Fermi National Accelerator Laboratory (Fermilab) April 2016 Active use No http://ppp-docdb.fnal.gov/cgi-bin/ShowDocument?docid=85

Fermilab Enterprise Risk Tolerance (Ranking) Matrix This matrix takes in account impact and risk of research. Can generate dangerous conditions for research, leading to loss of life Safety United States Federal Fermi National Accelerator Laboratory (Fermilab) No Fermi National Accelerator Laboratory (Fermilab) November 2015 Active use No http://ppp-docdb.fnal.gov/cgi-bin/ShowDocument?docid=60

Home Energy Scoring Tool System that asseses energy usage for homes. Mistakes lead to negative impact on home owners, who might not determine cause of high energy usage Energy United States Federal Department of Energy No Lawrence Berkeley National Laboratory (LBNL) 2012 Active use Yes http://hes-documentation.lbl.gov/home-energy-scoring-tool/scoring-methodology

Assessment worksheet “A decision-making tool to systematically help identify risks and benefits and determine the best courses of action for any given situation” Can generate dangerous conditions for operations, leading to loss of life Safety United States Federal Department of the Interior No Department of the Interior January 2013 Active use No https://safetynet.doi.gov/information/program/docs/DOI_ORM_Assessment_Worksheet.xlsx

HAZUS A standardized methodology for analyzing potential losses from floods, hurricane winds and earthquakes Might prevent a mission from taking place, leading to the negative impact of endangering the lives of people who need assistance Safety United States Federal Federal Emergency Management Agency (FEMA) No Federal Emergency Management Agency (FEMA) February 2015 Active use; endorsement of use Yes https://www.fema.gov/hazus

Scoring and Recommended Prophylaxis against thrombosis Guidelines for thrombosis treatment Misapplication can generate negative impact by causing victims to not be treated properly Health United States Federal Agency for Healthcare Research and Quality No Agency for Healthcare Research and Quality August 2016 Endorsement of use No http://www.ahrq.gov/professionals/quality-patient-safety/patient-safety-resources/resources/vtguide/vtguide4.html

Traffic Management Advisor (TMA) An automated tool for planning flight trajectories of commercial flights Can lead to less efficient trajectories, impacting the finances of airlines Transportation United States Federal Federal Aviation Administration (FAA) No Federal Aviation Administration (FAA) N/A Active use Yes https://www.aviationsystemsdivision.arc.nasa.gov/publications/2013/AIAA-2013-5130.pdf

Risk Priority Number (RPN) ranking Scores different equipments in oil and gas operations to determine risk of failure and need for intervention Can have a negative impact by failing to accurately flag risks Safety United States Federal Bureau of Safety and Environmental Enforcement No Bureau of Safety and Environmental Enforcement June 2013 Active use No https://www.bsee.gov/sites/bsee.gov/files/tap-technical-assessment-program//693ad.pdf

General Rating Formula for Mental Disorders Used to determine degree and type of medical problems of veterans to calculate payment of benefits Misapplication can generate negative impact by causing veterans to not receive proper benefits, or it might cause overpayment Welfare United States Federal Department of Veterans Affairs No Department of Veterans Affairs 1989 Active use No http://www.cafc.uscourts.gov/sites/default/files/opinions-orders/12-7114.Opinion.4-3-2013.1.PDF

Computer Assisted Passenger Prescreening System II (CAPPS) Second version of current program that evaluates each air travel passenger to determine its potential risk of being a terrorist Can have a negative impact by failing to accurately flag risks and can create problems to people incorrectly flagged as dangerous. Controversy has prevented it from being used Safety United States Federal U.S. Customs and Border Protection No U.S. Customs and Border Protection 2004 Potential use Yes https://www.cbp.gov/bulletins/38genno30.pdf

Guidelines for the Prevention of Opportunistic Infections in Persons Infected with Human Immunodeficiency Virus Guidelines to treat infections related to HIV Misapplication can generate negative impact by causing patients to not be treated properly Health United States Federal Department of Health And Human Services No U.S. Public Health Service (USPHS) / Infectious Diseases Society of America (IDSA) 1997 Endorsement of use No http://www.cdc.gov/MMWR/preview/mmwrhtml/00048226.htm

Automated Incident Assessment Calculates the importance of incidents in which census works lose or misplace personal information of interviewees Can lead to underreporting of serious privacy violations Privacy United States Federal Census Bureau No Census Bureau 2009 Active use No https://www.census.gov/2010census/pdf/2010_Census_PII_Assessment.pdf

El Niño-Southern Oscillation (ENSO) Forecasts Weather forecast model Failure to accurately predict the weather can lead to economic loss for residents, industry, agriculture Environment United States Federal Department of Commerce No Various N/A Active use Yes https://www.climate.gov/news-features/blogs/enso/how-good-have-enso-forecasts-been-lately

Predictive Modeling Analysis of Medicare Claims Analyzes Medicare claims to detect potentially fraudulent activity. Failure to detect fraudulent payment can lead to the high magnitude negative impact of monetary loss for the government. False positives can impact providers Health United States Federal Centers for Medicare & Medicaid Services (CMS) No Centers for Medicare & Medicaid Services (CMS) June 2011 Active use Yes https://www.cms.gov/Outreach-and-Education/Medicare-Learning-Network-MLN/MLNMattersArticles/downloads/SE1133.pdf

Nursing Home Compare Five-Star Quality Rating System Tool that enables patients to find providers based on quality of care Miscalculation can lead to negative impact on providers, or to unfairly benefiting others, and overall misinforming users. Can also generate controversy about validity of methods Health United States Federal Centers for Medicare & Medicaid Services (CMS) No Centers for Medicare & Medicaid Services (CMS) July 2018 Active use Yes https://www.cms.gov/medicare/provider-enrollment-and-certification/certificationandcomplianc/downloads/usersguide.pdf

Quality Rating System (QRS) rating methodology Tool that enables patients to find providers based on quality of care Miscalculation can lead to negative impact on providers, or to unfairly benefiting others, and overall misinforming users. Can also generate controversy about validity of methods Health United States Federal Centers for Medicare & Medicaid Services (CMS) No Centers for Medicare & Medicaid Services (CMS) October 2015 Active use Yes https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/QualityInitiativesGenInfo/Downloads/QRS-Rating-Methodology-for-2015.pdf

Hospital Quality Star Rating on Hospital Compare Tool that enables patients to find providers based on quality of care Miscalculation can lead to negative impact on providers, or to unfairly benefiting others, and overall misinforming users. Can also generate controversy about validity of methods Health United States Federal Centers for Medicare & Medicaid Services (CMS) No Centers for Medicare & Medicaid Services (CMS) N/A Active use Yes https://www.cms.gov/Newsroom/MediaReleaseDatabase/Fact-sheets/2016-Fact-sheets-items/2016-07-27.html

Merit-based Incentive Payment System (MIPS) Pays for Medicare services according to quality ratings Miscalculation can lead to negative impact on providers, or to unfairly benefiting others, and overall misinforming users. Can also generate controversy about validity of methods Personnel United States Federal Centers for Medicare & Medicaid Services (CMS) No Centers for Medicare & Medicaid Services (CMS) 2015 Active use Yes https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/Value-Based-Programs/MACRA-MIPS-and-APMs/MIPS-Scoring-Methodology-slide-deck.pdf

Automated filtering system Winnow down messages to be read by the NSA Can have a negative impact by failing to accurately flag risks Privacy United States Federal National Security Agency (NSA) No National Security Agency (NSA) N/A Active use Yes https://www.congress.gov/crec/2001/09/13/CREC-2001-09-13.pdf

Automated Targeting System Used "to improve the collection, use, analysis, and dissemination of information that is gathered for the primary purpose of targeting, identifying, and preventing potential terrorists and terrorist weapons from entering the United States" Can have a negative impact by failing to accurately flag risks and can create problems to people incorrectly flagged as dangerous Safety United States Federal Department of Homeland Security (DHS) No Department of Homeland Security (DHS) November 2006 Active use Yes https://www.dhs.gov/xlibrary/assets/privacy/privacy_pia_cbp_ats.pdf

Passenger Name Record (PNR) automated filtering Automatically removes sensitive data from program that shares information between the U.S. and European authorities about air travel passengers Can have a negative impact by failing to accurately detect sensitive data Privacy United States Federal Department of Homeland Security (DHS) No Department of Homeland Security N/A Active use Yes https://www.dhs.gov/sites/default/files/publications/privacy_eu_pnr_aircarriers_april_2010.pdf

HURREVAC-eXtended (HV-X) A web-based suite of tools that integrates all phases of hurricane planning and evacuation decisions Might prevent a mission from taking place, leading to the negative impact of endangering the lives of people who need assistance Environment United States Federal Department of Homeland Security (DHS) No Department of Homeland Security (DHS) May 2016 Active use Yes https://www.dhs.gov/science-and-technology/news/2016/05/17/responder-news-enhancing-hurricane-season-training-decision

Office of Workers’ Compensation Programs disability rating Used to determine degree and type of medical problems of beneficiaries to calculate payment of benefits Misapplication can generate negative impact by causing beneficiaries to not receive proper benefits, or it might cause overpayment Economy United States Federal Office of Workers' Compensation Programs (OWCP) No Office of Workers' Compensation Programs (OWCP) N/A Active use; endorsement of use No https://www.dol.gov/ecab/decisions/2014/Sep/13-1519_O.htm

Indirect Dietary Residential Exposure Assessment Model (IDREAM) "Estimates indirect ingestion exposure to disinfectants used in residential settings on hard surfaces where there may be inadvertent transfer to edible items prepared on those surfaces" Might fail to predict exposure of consumers to harmful toxics, causing physical harm Safety United States Federal Environmental Protection Agency (EPA) No Environmental Protection Agency June 2015 Active use; endorsement of use Yes https://www.epa.gov/sites/production/files/2015-07/documents/idream_user_guide.pdf

Monitor Safety/Analyze Data (MSAD) process Process designed to "filter, review, analyze and trend" commercial aviation safety data Can have a negative impact by failing to accurately flag risks Transportation; safety United States Federal Federal Aviation Administration (FAA) No Federal Aviation Administration (FAA) March 2010 Active use No https://www.faa.gov/documentLibrary/media/Order/FAA%20Order%208110.107.pdf

Uniform Financial Institutions Rating System (UFIRS) Used to determine the financial status of banks Can have a negative impact upon banks' clients and financial system as a whole by failing to detect financial deterioration in banks Finance United States Federal Federal Deposit Insurance Corporation No Federal Deposit Insurance Corporation N/A Active use No https://www.fdic.gov/regulations/laws/rules/5000-900.html

Ratings system for federal banks Used to determine the financial status of banks Can have a negative impact upon banks' clients and financial system as a whole by failing to detect financial deterioration in banks Finance United States Federal Federal Reserve System No Federal Reserve System November 1995 Active use No https://www.federalreserve.gov/boarddocs/srletters/1995/sr9551.htm

Pre-scoring to Assistance to Firefighters Grant Automated selection process to determine selection for funds Might unfairly exclude appropriate projects or generate negative impact by including inappropriate projects. Might benefit specific groups unfairly Safety; management United States Federal Federal Emergency Management Agency (FEMA) No Federal Emergency Management Agency (FEMA) August 2011 Active use Yes https://www.fema.gov/media-library-data/20130726-1855-25045-0101/september_28_2011_fy_2011_afg_applicants_what_s_next.txt

Site/Building Inherent Vulnerability Assessment Matrix Assesses risk of terrorist attacks on buildings. Can have a negative impact in workers' lives by failing to accurately flag risks in facilities Safety United States Federal Federal Emergency Management Agency (FEMA) No Federal Emergency Management Agency (FEMA) December 2003 Active use No https://www.fema.gov/media-library-data/20130726-1455-20490-6222/fema426.pdf

National Flood Insurance Program Community Rating System A program that provides incentives for those communities to develop extra measures to provide protection from flooding. Might unfairly exclude appropriate projects or generate negative impact by including inappropriate projects. Might benefit specific groups unfairly Safety; management United States Federal Federal Emergency Management Agency (FEMA) No Federal Emergency Management Agency (FEMA) August 2011 Active use Yes https://www.fema.gov/pdf/business/nfip/nfip_reform_phase_III_report.pdf

Practical Guide for Quality Management of Pavement Condition Data Collection Guidelines for local agencies to assess the quality of pavement A bad output might lead to unsafe or inneficient roads Transportation; safety United States Federal Federal Highway Administration (FHWA) No Federal Highway Administration (FHWA) February 2013 Endorsement of use No http://www.fhwa.dot.gov/pavement/management/qm/data_qm_guide.pdf

U.S. DOT Vulnerability Assessment Scoring Tool Used to determine vulnerability of transportation systems (rail, ports, airports, roads) to climate Might fail to predict risks, potentially causing physical harm to commuters or financial loss for government Transportation; management United States Federal Department of Transportation No Department of Transportation June 2015 Endorsement of use Yes https://www.fhwa.dot.gov/environment/climate_change/adaptation/adaptation_framework/modules/scoring_tools_guide/page01.cfm

Load and resistance factor design (LRFD) Industry standard for road construction supported by the federal government A bad output might lead to unsafe or ineficient roads, and loss of life Safety; transportation United States Federal Department of Transportation No Federal Highway Administration (FHWA) / American Association of State Highway and Transportation Officials (AASHTO 2001 Endorsement of use Yes https://www.fhwa.dot.gov/publications/publicroads/05jul/09.cfm

Climate Change & Extreme Weather Vulnerability Assessment Framework Calculates and grades risk involved with extreme weather events Can have a negative impact by failing to accurately flag risks Environment; safety United States Federal Federal Highway Administration (FHWA) No Federal Highway Administration (FHWA) December 2012 Active use; endorsement of use No https://www.fhwa.dot.gov/environment/climate_change/adaptation/publications/vulnerability_assessment_framework/figure4.cfm

Consume 3.0—A Software Tool for Computing Fuel Consumption Calculates potential of wood as fuel of forest fires and prescribe fire fighting actions Might fail to detect a risk or lead to inapropriate action, endangering the lives of people Safety United States Federal Forest Service No Forest Service June 2009 Endorsement of use Yes http://www.firescience.gov/projects/briefs/98-1-9-06_fsbrief55.pdf

Career Connector Automated rating‑and‑ranking tool used by the IRS to evaluate personnel Might be unfair in excluding appropriate candidates or generate negative impact by including inappropriate candidates for government employment Personnel United States Federal Internal Revenue Service (IRS) No Internal Revenue Service (IRS) 2009 Active use Yes https://www.flra.gov/decisions/v68/68-149.html

Supervision and Regulation Statistical Assessment of Bank Risk model (SR-SABR) Used to determine the financial status of banks Can have a negative impact upon banks' clients and financial system as a whole by failing to detect financial deterioration in banks Finance United States Federal Federal Reserve System No Federal Reserve System December 2015 Active use Yes http://www.gao.gov/new.items/d11612.pdf

Risk assessment methods for the Geostationary Operational Environmental Satellite (GOES) program Risk management plan for meteorological and oceanographic satellites Can cause negative impact by failing to assess dangers in satellites programs, leading to their operational loss and loss of data collecting on environment Safety United States Federal National Oceanic and Atmospheric Administration (NOAA) No National Oceanic and Atmospheric Administration (NOAA) August 2013 Active use Yes http://www.goes-r.gov/syseng/docs/Risk_Mgmt_Plan_v2-0.pdf

Statistical Hurricane Intensity Prediction Scheme (SHIPS) Used to predict strength of cyclones in the Atlantic coast Failure to accurately predict the weather can lead to economic loss for residents, industry, agriculture Environment; safety United States Federal National Oceanic and Atmospheric Administration (NOAA) No National Oceanic and Atmospheric Administration (NOAA) N/A Active use; endorsement of use Yes http://www.goes-r.gov/users/comet/tropical/textbook_2nd_edition/navmenu.php_tab_10_page_5.3.0.htm

Ranking system for the Homeless Providers Grant and Per Diem (GPD) Ranking system that determines which applicants will receive monetary funds from the Department of Veterans Affairs Might unfairly exclude appropriate projects or generate negative impact by including inappropriate projects. Might benefit specific groups unfairly Finance United States Federal Department of Veterans Affairs No Department of Veterans Affairs February 2013 Active use No https://www.va.gov/HOMELESS/docs/GPD/GPD_Final_Rule_38CFR61_02-25-2013.pdf

Multicriteria-Based Ranking Model for Risk Management of Animal Drug Residues in Milk and Milk Products The risk assessment is a tool to assist with reevaluating which animal drug residues should be included in milk testing programs Can impact the measurement of the contamination of milk, leading to health concerns by consumers Safety United States Federal Food and Drug Administration (FDA) No Food and Drug Administration (FDA) April 2015 Endorsement of use Yes http://www.gpo.gov/fdsys/pkg/FR-2015-04-30/pdf/2015-10000.pdf

Safety Fitness Rating Methodology (SFRM) Used to measure the safety fitness of motor carriers against the safety fitness standard A bad output might lead to unsafe or ineficient motor carriers Safety United States Federal Department of Transportation No Department of Transportation March 2000 Active use No https://www.gpo.gov/fdsys/granule/FR-2000-03-07/00-5471

Framingham Risk Equation Guidelines to determine cardiovascular risk Misapplication can generate negative impact by causing patients to not be treated properly Health United States Federal Department of Health And Human Services No Department of Health And Human Services 2008 Endorsement of use No https://www.guideline.gov/summaries/summary/48117?

Clinical algorithms for lower urinary tract symptoms in men Guidelines for assessment and management of lower urinary tract symptoms in men Misapplication can generate negative impact by causing patients to not be treated properly Health United States Federal Department of Health And Human Services No Department of Health And Human Services N/A Endorsement of use No https://www.guideline.gov/summaries/summary/49273

Croft's Grades of Injury Guidelines for chiropractical treatment Misapplication can generate negative impact by causing patients to not be treated properly Health United States Federal Department of Health And Human Services No Department of Health And Human Services N/A Endorsement of use No https://www.guideline.gov/summaries/summary/47637/best-practices---practice-guidelines

Clinical algorithms for bladder treatment Guidelines for bladder treatment Misapplication can generate negative impact by causing patients to not be treated properly Health United States Federal Department of Health And Human Services No Department of Health And Human Services N/A Endorsement of use No https://www.guideline.gov/summaries/summary/46927?

Project Definition Rating Index (PDRI) for Building Projects A method that assists in planning building projects Might generate ineficient building projects Safety United States Federal National Aeronautics and Space Administration (NASA) No National Aeronautics and Space Administration (NASA) April 2000 Active use No http://www.hq.nasa.gov/office/codej/codejx/Assets/Docs/ProjectDefinitionRatingIndex.pdf

Early Model Based Event Recognition using Surrogates (EMBERS) Anticipatory intelligence system for forecasting socially significant population-level events, such as civil unrest incidents, disease outbreaks, and election outcomes, on the basis of publicly available data A missed event can impair the government's reaction to it, leading to a negative impact, possibly of high magnitude Economy; safety; health United States Federal Director of National Intelligence No Director of National Intelligence N/A Active use Yes https://www.iarpa.gov/index.php/newsroom/iarpa-in-the-news/2015/445-forecasting-significant-societal-events-using-the-embers-streaming-predictive-analytics-system

IRS Merit Promotion Plan and Internal Placement Calculation method to give department employees chance of being promoted Might unfairly exclude appropriate candidates or generate negative impact by including inappropriate candidates for government promotion Personnel United States Federal Internal Revenue Service (IRS) No Internal Revenue Service (IRS) March 2013 Active use No https://www.irs.gov/irm/part6/irm_06-335-001.html

ProUCL Version 3.0 Software to support risk assessment and cleanup decisions at contaminated sites Might lead workers that clean contaminated sites to dangerous situations Environment United States Federal Environmental Protection Agency (EPA) No Environmental Protection Agency (EPA) April 2004 Active use Yes http://www.lm.doe.gov/cercla/documents/rockyflats_docs/sw/sw-a-005700.pdf

Fast Ocean Atmosphere Model (FOAM) Climate simulation algorithm Failure to accurately predict climate impact can lead to economic loss for residents, industry, agriculture Environment United States Federal Department of Energy No Department of Energy 1994 Active use; endorsement of use Yes http://www.mcs.anl.gov/research/projects/foam/publications.html

HCAHPS (Hospital Consumer Assessment of Healthcare Providers and Systems) star ratings Tool that enables patients to find providers based on quality of care Miscalculation can lead to negative impact on providers, or to unfairly benefiting others, and overall misinforming users. Can also generate controversy about validity of methods Health United States Federal Centers for Medicare & Medicaid Services (CMS) No Centers for Medicare & Medicaid Services (CMS) October 2015 Active use Yes https://www.medicare.gov/hospitalcompare/Data/HCAHPS-Star-Ratings.html

Federal Merit Promotion Program Calculation method to give department employees chance of being promoted Might unfairly exclude appropriate candidates or generate negative impact by including inappropriate candidates for government promotion Personnel United States Federal Merit Systems Protection Board No Merit Systems Protection Board March 2013 Active use No http://www.mspb.gov/netsearch/viewdocs.aspx?docnumber=253639&version=253926&application=ACROBAT

Risk assessment of credit unions Used to determine the financial status of credit unions Can have a negative impact upon banks' clients and financial system as a whole by failing to detect financial deterioration in banks Finance United States Federal National Credit Union Administration No National Credit Union Administration October 2016 Active use No https://www.ncua.gov/regulation-supervision/Pages/policy-compliance/communications/letters-to-credit-unions/2016/irr-workbook-guide.pdf

Guidelines for Evaluation of an Application for a PCA Risk Mitigation Credit Guidance to evaluate a federally insured credit union’s application for a risk mitigation credit (RMC) Can have a negative impact upon banks' clients and financial system as a whole by failing to detect financial deterioration in banks Finance United States Federal National Credit Union Administration No National Credit Union Administration March 2001 Active use No https://www.ncua.gov/legal/guidesetc/guidesmanuals/ncua8508.pdf

Filtering algorithms Automated tools filter out inappropriate collection of data about U.S. persons Can lead to underreporting of serious privacy violations Privacy United States Federal National Security Agency (NSA) No National Security Agency (NSA) N/A Active use Yes https://www.nsa.gov/about/civil-liberties/reports/assets/files/nsa_clpo_report_targeted_EO12333.pdf

Performance Rating Method (PRM) Used to rate the energy efficiency of commercial and high-rise residential buildings Mistakes lead to negative impact on planners, who might inadvertently construct inefficient buildings Energy United States Federal Department of Energy No Pacific Northwestet National Laboratory (PNNL) May 2016 Active use Yes http://www.pnnl.gov/main/publications/external/technical_reports/PNNL-25130.pdf

Commercial Building Energy Asset Score Helps commercial building managers to compare their building infrastructure to other buildings to "facilitate cost-effective investment in energy efficiency improvements" Mistakes lead to negative impact on planners, who might inadvertently construct inefficient buildings Energy United States Federal Department of Energy No Department of Energy August 2013 Endorsement of use Yes http://www.pnnl.gov/main/publications/external/technical_reports/PNNL-22045rev1.1.pdf

Visual Sample Plan (VSP) modules Methods to use software to measure investigations into nuclear weapons tests Can negatively impact the investigation into the effects of nuclear tests Safety United States Federal Department of Energy No Department of Energy September 2010 Active use Yes http://www.pnnl.gov/main/publications/external/technical_reports/PNNL-19869.pdf

PARRiS Benchmark Used to oversee the financial quality of lenders from the SBA Can lead to severe monetary loss for the SBA Finance United States Federal Small Business Administration (SBA) No Small Business Administration (SBA) N/A Active use No https://www.sba.gov/sites/default/files/articles/PARRiS_Overview_-_Aug_16_2016.pdf

SSI Redetermination Scoring Model Determines overpayment of Social Security benefits Failure to detect fraudulent payment can lead to the high magnitude negative impact of monetary loss for the government. False positives can impact providers Welfare United States Federal Social Security Administration No Social Security Administration N/A Active use Yes https://www.ssa.gov/legislation/testimony_072512.html

General Rating Formula for Diseases and Injuries of the Spine Used to determine degree and type of medical problems of veterans to calculate payment of benefits Misapplication can generate negative impact by causing veterans to not receive proper benefits, or it might cause overpayment Welfare United States Federal Department of Veterans Affairs No Department of Veterans Affairs N/A Active use No https://www.uscourts.cavc.gov/documents/Cullen_08-1193_published_opinion_8-13-2010.pdf

Project ranking criteria Calculates the cost of projects Might fail to take in account specific costs, jeopardizing management of funds Management United States Federal U.S. Fish and Wildlife Service No U.S. Fish and Wildlife Service N/A Active use No https://www.fws.gov/midwest/es/ec/nrda/MoTriState/pdf/EaglePicherIScoringMatrixMay2013.pdf

Workforce Planning Risk Assessment Analyzes projects and identifies risks and vulnerabilities to workers Might fail to predict risks and cause loss of life Safety United States Federal United States Geological Survey (USGS) No United States Geological Survey (USGS) N/A Active use No https://www2.usgs.gov/humancapital/sw/workforceplanning/documents/WFPriskassessment.docx

AERMOD Guideline model for air impact assessment If the air quality is miscalculated, there may be health harm to citizens Environment United States Federal Environmental Protection Agency (EPA) No American Meteorological Society / Environmental Protection Agency Regulatory Model Improvement Committee (AERMIC) 2005 Active use Yes https://eplanning.blm.gov/epl-front-office/projects/nepa/79446/106308/129967/25_Alton_Coal_SDEIS_App_K_Air_Resources_Reports.pdf

30-day All-Cause Hospital Readmission measure "Risk-standardized readmission rate for people age 65 or older who were hospitalized at a short-stay acute-care hospital"" Errors in calculation might fail to reducing avoidable readmissions Health United States Federal Centers for Medicare & Medicaid Services (CMS) No The Center for Outcomes Research & Evaluation (CORE) 2015 Active use Yes https://effectivehealthcare.ahrq.gov/get-involved/nominated-topics/what-value-predictive-analytics-particularly-population-health

Risk Assessment System (RAS) Provides management of department with information to control hazards If there is a miscalculation, people would be exposed to hazards Safety United States Federal Department of the Interior No Department of the Interior N/A Active use No https://safetynet.doi.gov/information/general/risk_manager/ras.html

Hanford Federal Facility Agreement and Consent Order Risk assessment to determine whether or not to retrieve waste from a single-shell tank Analyses like this raise issues of risk to human health and the environment Safety, health United States Federal Department of Energy No Department of Energy 2004 Active use No http://pdw.hanford.gov/arpir/pdf.cfm?accession=D5134611

Enforcement Priority System (EPS) This system rates cases of the commission based on priority, and makes recommendations on which cases to close The Federal Elections Commision might be lead to overlook important cases Management United States Federal Federal Elections Commission No Federal Elections Commission 2001 Active use No https://www.fec.gov/files/legal/murs/current/36404.pdf

BASINS Climate Assessment Tool The tool helps analysis explore potential effects of climate change on streamflow and water quality Failure to detect impact on the environment might lead to further harm Environment United States Federal Environmental Protection Agency (EPA) No Environmental Protection Agency (EPA) 2006 Active use Yes https://www.epa.gov/exposure-assessment-models/basins-climate-assessment-tool-tutorials

Gas Distribution Integrity Management Program (DIMP) Compiles and ranks the risk assessment of gas pipelines A faulty pipeline risk assessment might lead to lack of maintenance and to accidents Safety United States Federal Department of Transportation No Department of Transportation 2008 Active use No https://primis.phmsa.dot.gov/dimp/docs/PHMSA_DIMP_McLaren_10_30_2012.pdf

Criteria for Scholarships, Fellowships and Faculty Development Program System that rates institutions on different criteria to disburse grants If there is an erronous rating, distribution of grants might be unfair or have diminished impact Education United States Federal Nuclear Regulatory Commission No Nuclear Regulatory Commission N/A Active use No https://www.nrc.gov/about-nrc/grants/evaluation-criteria.pdf

TRENDS Methodology The methodology is used to estimate emissions and model air quality An incorrect evaluation could lead to health hazards Environment United States Federal Environmental Protection Agency (EPA) No Environmental Protection Agency (EPA) 1991 Active use No https://www.epa.gov/environmental-economics/statistical-methodology-assigning-emissions-industries-united-states-1970

Rating system for child restraints Calculates and rates child restraints in order to reduce injuries in car accidents Incorrect ratings may lead parents to buy low quality child restraints that do not adequately protect children Safety, transportation United States Federal Department of Transportation No National Highway Traffic Safety Administration (NHTSA) 2003 Active use No https://www.nhtsa.gov/nhtsa/announce/testimony/FINALTREADtestimony_06-03-200.html

Dynamic scoring Technique to forecast government revenue and expenditures based on fiscal policy Has impacts fiscal policy, so it can cause higher taxes or deficits Economy United States Federal Congressional Budget Office No Congressional Budget Office 2015 Active use No https://www.gpo.gov/fdsys/pkg/CHRG-114shrg95802/html/CHRG-114shrg95802.htm

Guidance for Conducting Risk Assessments and Related Risk Activities Specifies how risk assessments should be conducted If risks are not thoroughly evaluated, people might face health risks such as exposure to harmful chemicals Safety United States Federal Department of Energy Yes The University of Tennessee and BECHTEL JACOBS COMPANY LLC 1999 Active use No https://rais.ornl.gov/documents/bjc_or-271.pdf

Deliberative Risk Ranking for Community Water Systems A risk ranking for water systems that takes in consideration multiple stakeholders Accurately evaluating risks for a community water system can keep people from health risks and maximize safe human use of natural resources Environment United States Federal United States Geological Survey (USGS) No Peter D. Howe, Brent Yarnal, Alex Coletti, Nathan J. Wood 2013 Potential use No https://www.sciencebase.gov/catalog/item/51f38c5fe4b0a32220222f4b

Energy saving calculations Calculates the effect of weather in the energy efficiency rating for buildings Mistakes lead to negative impact on planners, who might inadvertently construct inefficient buildings Energy United States Federal Department of Energy No Department of Energy 2015 Endorsement of use No https://energy.gov/sites/prod/files/2015/08/f26/WeatherData_022615.pdf

Project Definition Rating Index Used to assess the likelihood of successful project If projects get mistakenly identify as successful and get funded, resources are wasted Management United States Federal Nuclear Regulatory Commission Yes Construction Industry Institute N/A Active use No https://www.nrc.gov/docs/ML1018/ML101820632.pdf

Scour Critical Bridge Indicator (SCBI) Code and Scour Assessment Rating (SAR) Identifies bridges in poor conditions Inaccurately classification of bridges can lead to loss of life Safety United States Federal Department of the Interior No Pennsylvania Department of Transportation (PennDOT) / U.S. Geological Survey N/A Active use Yes https://pa.water.usgs.gov/reports/ofr01-446.pdf

Cyber Resilience Review Evaluate an organization’s operational resilience and cybersecurity practices If this assessment is not thorough enough, systems may still have weaknesses Cybersecurity United States Federal Department of Homeland Security (DHS) No Department of Homeland Security (DHS) / Computer Emergency Response Team (CERT) Division of Carnegie Mellon University’s Software Engineering Institute N/A Endorsement of use Yes https://www.us-cert.gov/ccubedvp/assessments

Public Financial Management Risk Assessment Framework Designed to identify fiduciary risks of partner government institutions If risk is badly managed, USAID would lose money on unfruitful projects Finance United States Federal U.S. Agency for International Development (USAID) No U.S. Agency for International Development (USAID) 2014 Active use No https://www.usaid.gov/sites/default/files/documents/1868/220mae.pdf

Automated Behavior and Cohesion Assessment Tools The software evaluates performance outcomes with models of crew task performance, social interactions and individual state of NASA flight surgeons Lack of cooperation of teams can lead to loss of mission and life Intelligence United States Federal National Aeronautics and Space Administration (NASA) No National Aeronautics and Space Administration (NASA) N/A Potential use Yes https://humanresearchroadmap.nasa.gov/Tasks/?i=783

Shared Decision Making Flowchart for how a clinician should approach talking to patients If a clinician does not help a patient make the best decision possible, there might be health consequences Health United States Federal Department of Veterans Affairs No Department of Veterans Affairs 1989 Active use No https://www.healthquality.va.gov/HEALTHQUALITY/documents/CPGgenericSDMPOCKET_FINALSmall.pdf

Human Capital Enterprise System Automates personnel transactions related to hiring, promotions, job applications, and retirements Errors might lead to financial losses and personnel issues Management; personnel United States Federal U.S. Postal Service No U.S. Postal Service 2008 Active use Yes https://blueearth.usps.gov/strategic-planning/cs10/CSPO_12_2010_FINAL_107.htm

Rating direct threats in USAID Biodiversity Programming Makes assessments of biodiversity threats more explicit nd helps decision-making If the model doesn't not take into consideration all environmental factors, the team's priorities may not be correct Environment United States Federal U.S. Agency for International Development (USAID) No U.S. Agency for International Development (USAID) 2017 Active use No http://pdf.usaid.gov/pdf_docs/pa00mwpx.pdf

Competitive Evalution System For The Office Of Personnel A grading system to evaluate employees Evaluations done improperly might risk the efficacy of the agency Personnel United States Federal Central Intelligence Agency (CIA) No Central Intelligence Agency (CIA) 2006 Active use No https://www.cia.gov/library/readingroom/document/cia-rdp82-00357r001000040031-6

Prediction Intensity Interval model for Hurricanes Predicts the intensity of a hurricanes An incorrect prediction may cause people to be unprepared for a natural disaster Environment United States Federal National Science Foundation No Southern Methodist University's Intelligent Data Analysis Lab (IDA) 2011 Active use Yes https://www.nsf.gov/discoveries/disc_summ.jsp?cntn_id=122439

Air Transportation Oversight System (ATOS) Assesses the safety of air carriers If an air carrier is unsafe and that status undetected, accidents can happen leading to loss of life Safety United States Federal Department of Transportation No Federal Aviation Administration (FAA) 2009 Active use No http://fsims.faa.gov/wdocs/8900.1/v10%20air%20trans%20over%20sys/chapter%2001/10_001_002_chg_81a.htm

Safety Ratings Ratings help consumers make smart decisions about safety when purchasing a vehicle An inaccurate rating may result in a consumer buying a more dangerous car than they intended Safety United States Federal Department of Transportation No National Highway Traffic Safety Administration (NHTSA) 1993 Active use No https://www.nhtsa.gov/vehicle/2017/FORD/MUSTANG/2%252520DR/RWD

Hazard Ranking System Used to uncontrolled waste sites on the National Priorities List (NPL) An inaccurate rating may result in environmental damages Safety United States Federal Environmental Protection Agency (EPA) No Environmental Protection Agency (EPA) N/A Active use No https://nepis.epa.gov/Exe/ZyPURL.cgi?Dockey=9100W8RR.TXT

Chemical Security Assessment Tool Caculates the distance of concern for a toxic release threat, indicating to operators what are the precautions that should be made An inaccurate rating may result in environmental damages Safety United States Federal Department of Homeland Security (DHS) No Department of Homeland Security (DHS) 2007 Active use Yes https://www.gao.gov/assets/680/671570.pdf

NRCareers Automates personnel transactions related to hiring, promotions, job applications, and retirements Errors might lead to financial losses and personnel issues Personnel United States Federal Nuclear Regulatory Commission Yes Monster Government Solutions 2006 Potential use Yes http://www.nrc.gov/docs/ML0327/ML032790112.pdf

Relative Risk Profile Cities are rated and ranked for risks including terrorism, which affects funding for counterterrorism efforts A city may have a high degree of risk but not get enough counterterrorism funding the rankings were in incorrect Safety United States Federal Department of Homeland Security (DHS) No Department of Homeland Security (DHS) N/A Active use No https://titus.house.gov/press-releases/titus-dhs-should-be-making-counterterrorism-funding-decisions-to-mitigate-future

Pipeline Risk Analysis for Maintenence and Integrity Decisions This system estimates the level of operating risk associated with all segments of a pipeline If risk is miscalculated, the pipeline may cause environmental damage to areas surrounding it Safety; Environment United States Federal Department of the Interior Yes C-FER Technologies 1998 Potential use No https://www.bsee.gov/sites/bsee.gov/files/tap-technical-assessment-program//221ao.pdf

Carbon Dioxide from Fossil Fuel Combustion Module of the State Inventory Tool Estimates carbon dioxide emissions from different fossil fuel types An inaccurate rating may result in environmental damages Environment United States Federal Environmental Protection Agency (EPA) No Environmental Protection Agency (EPA) 1998 Active use Yes https://www.epa.gov/sites/production/files/2017-12/documents/co2_from_fossil_fuels_users_guide.pdf

Complex Cognitive Assessment Battery Contains nine tests of higher cognitive functions to be used in testing pilots and operators Inaccurate results may lead to unprepared workforce and loss of life Health; safety United States Federal Department of Transportation No Department of Transportation N/A Endorsement of use Yes http://www.hf.faa.gov/workbenchtools/default.aspx?rPage=Tooldetails&subCatId=4&toolID=14

Automatic Calculation of Rainfall Erosivity Method for automatic calculation of erosion from rainfall An inaccurate rating may result in environmental damages Environment United States Federal Department of Agriculture No Department of Agriculture 2010 Potential use Yes https://pubag.nal.usda.gov/catalog/790674

CNCS Organizational Capacity Assessment Tool Organizational Capacity Assessment tools empower organizations to better measure their capacity to effect change in their communities and measure their performance An inaccurate score may cause an organization to overestimate or understimate its capacity to effect change in the community Economy United States Federal Corporation for National & Community Service No Corporation for National and Community Service N/A Endorsement of use No https://www.nationalservice.gov/sites/default/files/resource/OrganizationalCapacityAssessmentToolWork.pptx

Explanatory Item Response Models A software for researchers to determine the fairness of standardized tests Errors might lead to tests being accepted or rejected incorrectly Education United States Federal National Science Foundation Yes Edgar Merkle 2019 Potential use Yes https://www.nsf.gov/awardsearch/showAward?AWD_ID=1460719

Patient Experience Measures from the CAHPS Clinician & Group Surveys These surveys measure patient experience and the quality of care given A badly designed survey may contain bias, and does not reflect the real quality of care Health United States Federal Department of Health And Human Services No Consumer Assessment of Healthcare Providers and Systems 2015 Active use No https://www.integration.samhsa.gov/mai-coc-grantees-online-community/The_Patient_Experience_Measures_from_CAHPS.pdf

NASSCO quick ratings System to rate the state of a sanitary sewer collection system A bad sewer system may cause leakage of chemicals Environment United States Federal Department of Energy Yes National Association of Sewer service Companies 2015 Active use No http://www2.lbl.gov/ehs/esg/Reports/assets/SSMP2015_.pdf

General Equilibrium model An economic model that can be used to determine tax policy If incorrect or incorrectly used, the amount of taxes charged may be more or less than needed Economy United States Federal Department of the Treasury No Department of the Treasury 1976 Potential use No https://www.treasury.gov/resource-center/tax-policy/tax-analysis/Documents/WP-9.pdf

Transit Performance Monitoring System Designed to collect data on transit customers through the use of on-board surveys A bad system would result in inaccurate data being collected, which may lead to inefficient changes to the public transit system Transportation United States Federal Department of Transportation Yes M. Davis and Company / NuStats International / Dr. Peter Furth 1993 Potential use No https://rosap.ntl.bts.gov/view/dot/6299/dot_6299_DS1.pdf?

Fire Prevention and Safety Grants Applicants are scored against set criteria to be evaluated for the grant A bad evaluation system would result in the grant money spent inefficiently Safety United States Federal Federal Emergency Management Agency (FEMA) No Federal Emergency Management Agency (FEMA), Department of Homeland Security (DHS) 2018 Active use No https://www.federalregister.gov/documents/2018/03/15/2018-05214/assistance-to-firefighters-grant-program-fire-prevention-and-safety-grants

Image Examination Rating Scale Automates measurement of images to support law enforcement forensics Errors can negativaly impact law enforcement activity Safety United States Federal Department of Commerce No National Institute of Standards and Technology 2012 Potential use No https://www.nist.gov/sites/default/files/documents/oles/Forensics-NIST-2012-Abstracts-FINAL.pdf

Participatory Analysis for Community Action Tools Identifies opportunitites and constraints in projects to elicit interventions based on community preferences Errors might lead to community's needs not being correctly identified and waste of resources Management United States Federal U.S. Peace Corps No U.S. Peace Corps N/A Active use No http://files.peacecorps.gov/multimedia/pdf/library/GED5_pacatools.pdf

Serious Emotional Disturbance (SED) federal definition Defines childhood Serious Emotional Disturbance (SED) for for estimating national state prevalence of SED If the definition is unclear, there would be an over- or underestimate of people with serious emotional disturbances Health United States Federal Department of Health And Human Services No Substance Abuse and Mental Health Services Administration (SAMHSA) / Center for Behavioral Health Statistics and Quality (CBHSQ) 2014 Potential use No https://www.samhsa.gov/data/sites/default/files/SED%20Expert%20Panels%20Summary%20Report.pdf

Rail Corridor Risk Management System A tool to be used by rail carriers to analyze and compare routes to carry hazardous materials Failure can lead to environmental damage and loss of life Transportation; Safety United States Federal National Transportation Safety Board No National Transportation Safety Board 2011 Active use Yes https://www.ntsb.gov/_layouts/ntsb.recsearch/Recommendation.aspx?Rec=R-14-020

SOI Tax Stats - Statistical Methodology A methodology used to calculate the statistics of income If inaccurate, the government would publish inaccurate statistics and harm economic analyses Taxes United States Federal Department of the Treasury No Internal Revenue Service (IRS) N/A Active use No https://www.irs.gov/statistics/soi-tax-stats-statistical-methodology

Service Center Support Metrics Performance standards to evaluate the quality of contracted service centers Bad quality control of call centers contracted by the government can lead to waste Management United States Federal Department of Transportation No Federal Aviation Administration (FAA) 2002 Active use No https://faaco.faa.gov/index.cfm/attachment/download/83959

Disability-Adjusted Life Years (DALYs) Calculation of total number of years lost to illness, disability, or premature death within a given population. An inaccurate calculation would result in an inaccurate estimate on how disabilities affect people Health United States Federal National Council on Disability No World Bank 1993 Active use No https://ncd.gov/publications/2002/May232002

CFIS (Crown Fire Initiation and Spread), FlamMap and NEXUS Fire-management application, with fire spread rate modeling systems An incorrect modeling may cause firefighters to allocate their resources inefficiently, which may cause lives to be lost Safety; Environment United States Federal General Services Administration No Department of Agriculture 2006 Potential use Yes https://www.fs.fed.us/rm/pubs/rmrs_rp058.pdf

How to Determine Hiking Difficulty A calculation that takes into account elevation gain and distance to come up with a difficulty rating A bad estimate of difficulty may cause hikers to get stuck on a difficult trail Health United States Federal Department of the Interior No Department of the Interior N/A Endorsement of use No https://www.nps.gov/shen/planyourvisit/how-to-determine-hiking-difficulty.htm

Data Center Infrastructure Rating A rating for data centers' energy efficiency An incorrect rating may lead to waste Energy United States Federal Environmental Protection Agency (EPA) No Environmental Protection Agency (EPA) 2010 Potential use No https://www.energystar.gov/ia/partners/prod_development/downloads/Data_Center_Rating_Development_Results_Nov12.pdf

Data Quality Assessment Tool for Administrative Data System that rates quality of data mantained by the government Failure to appropriately rate the data source may cause loss of information and waste Management United States Federal Department of Labor No Federal Committee on Statistical Methodology 2011 Potential use No https://www.bls.gov/osmr/datatool.pdf

Senior Level (SL) and Scientific and Professional (ST) Performance Appraisal System Training Government-wide system for performance appraisal system If the system is biased, some people may get higher ratings than others, leading to unfair advantage Personnel United States Federal Department of the Interior No DOI 2017 Potential use No https://www.doi.gov/sites/doi.gov/files/uploads/sl_st_performance_system_training.pdf

Statistical Methodology for Aquaculture Census Defines how data is collected and analyzed for the census for aquaculture A bad calculation may result in an incorrect estimate about aquaculture in the U.S., leading to ineffective agricultural policy Agriculture United States Federal Department of Agriculture No US Census of Agriculture 2013 Active Use No https://www.agcensus.usda.gov/Publications/2012/Online_Resources/Aquaculture/appendix_a.pdf

Ranking of Administrative Law Judge candidates Candidates of administrative law judges are scored and ranked, and veterans receive veteran preference points If it's not a good system, a candidate unfit for the job may be selected Personnel United States Federal Department of Justice No Office of Personnel Management (OPM) N/A Active Use No https://www.justice.gov/osg/brief/azdell-v-james-opposition

Automatic Fall Prediction System A system to predict falls among the elderly based on tracked movement patterns Can negatively impact patients that are being mobilized Safety United States Federal Department of Health And Human Services Yes University of South Florida 2012 Potential use Yes https://healthit.ahrq.gov/ahrq-funded-projects/evaluation-and-integration-automatic-fall-prediction-system

Employee's Performance Appraisal Scores in the Air Force Rate employees on categories such as "Communications Discipline," "Timeliness of Work," "Support 