1 | Terms | Definition 1 | Citation 1 | Definition 2 | Citation 2 | Definition 3 | Citation 3 | Definition 4 | Citation 4 | Definition 5 | Citation 5 | Related terms and synonyms | Legal definition applicable | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2 | accountability | 1) relates to an allocated responsibility. The responsibility can be based on regulation or agreement or through assignment as part of delegation; 2) For systems, a property that ensures that actions of an entity can be traced uniquely to the entity; 3) In a governance context, the obligation of an individual or organization to account for its activities, for completion of a deliverable or task, accept the responsibility for those activities, deliverables or tasks, and to disclose the results in a transparent manner. | ISO/IEC_TS_5723:2022(en) | "accountable" (adjective vs. noun): answerable for actions, decisions, and performance | ISO/IEC_TS_5723:2022(en) | |||||||||
3 | accuracy | Closeness of computations or estimates to the exact or true values that the statistics were intended to measure. | OECD | A qualitative assessment of correctness or freedom from error. | FDA_Glossary | The measure of an instrument's capability to approach a true or absolute value. It is a function of precision and bias. | FDA_Glossary | The accuracy of a machine learning system is measured as the percentage of correct predictions or classifications made by the model over a specific data set. It is typically estimated using a test or "hold out" sample, other than the one(s) used to construct the model. Its complement, the error rate, is the proportion of incorrect predictions on the same data. | Raynor | measure of closeness of results of observations, computations, or estimates to the true values or the values accepted as being true | ISO/IEC_TS_5723:2022(en) | |||
4 | active learning | A proposed method for modifying machine learning algorithms by allowing them to specify test regions to improve their accuracy. At any point, the algorithm can choose a new point x, observe the output and incorporate the new (x, y) pair into its training base. It has been applied to neural networks, prediction functions, and clustering functions. | Raynor | Active learning (also called “query learning,” or sometimes “optimal experimental design” in the statistics literature) is a subfield of machine learning and, more generally, artificial intelligence. The key hypothesis is that, if the learning algorithm is allowed to choose the data from which it learns—to be “curious,” if you will—it will perform better with less training. | settles_active_2009 | the process of learning through activities and/or discussion in class, as opposed to passively listening to an expert. | Freeman_et_al_2014 | |||||||
5 | active learning agent | [a machine learning algorithm that can] decide what actions to take [with regards to its training data, in contrast to a passive learning agent, which is limited to a fixed policy]. | Russell_and_Norvig | passive learning agent | ||||||||||
6 | activity | Work that an organization performs using business processes; can be singular or compound. | IEEE_Guide_IPA | Set of cohesive tasks of a process. | CSRC | |||||||||
7 | adaptive dynamic programming | An adaptive dynamic programming (or ADP) agent takes advantage of the constraints among the utilities of states by learning the transition model that connects them and solving the corresponding Markov decision process using dynamic programming. | Russell_and_Norvig | A means of learning a model and a reward function from observations that then uses value or policy iteration to obtain the utilities or an optimal policy; makes optimal use of the local constraints on utilities of states imposed through the neighborhood structure of the environment. | Russell_and_Norvig | |||||||||
8 | adaptive learning | Updating predictive models online during their operation to react to concept drifts | Gama,_Joao | |||||||||||
9 | adversarial example | Machine learning input sample formed by applying a small but intentionally worst-case perturbation ... to a clean example, such that the perturbed input causes a learned model to output an incorrect answer. | NISTIR_8269_Draft | Samples generated from real samples with carefully designed imperceptible perturbations | Zhang,_Yonggang | adversarial perturbation | ||||||||
10 | adverse action notice | A notification of i) a refusal to grant credit in substantially the amount or on substantially the terms requested in an application unless the creditor makes a counteroffer (to grant credit in a different amount or on other terms) and the applicant uses or expressly accepts the credit offered; ii) A termination of an account or an unfavorable change in the terms of an account that does not affect all or substantially all of a class of the creditor's accounts or iii) A refusal to increase the amount of credit available to an applicant who has made an application for an increase. | ECOA | |||||||||||
11 | adverse impact ratio | privileged and unprivileged groups receiving different outcomes irrespective of the decision maker’s intent and irrespective of the decision-making procedure. Quantified as the ratio: disparate impact ratio = 𝑃( 𝑦̂ (𝑋) = fav ∣∣ 𝑍 = unpr )/𝑃( 𝑦̂ (𝑋) = fav ∣∣ 𝑍 = priv ) where 𝑃(𝑦̂ (𝑋) = fav) is the favorable label, (𝑍 = priv) is the privileged group, and (𝑍 = unpr) is the unprivileged group. | Varshney,_Kush | disparate impact ratio, relative risk ratio | ||||||||||
12 | agile | a development approach that delivers software in increments by following the principles of the Manifesto for Agile Software Development. | Gartner | A philosophy and methodology used to describe the continuous, iterative process to develop and deliver software and other digital technologies. User requirements and feedback inform incremental development and delivery by developers. | NSCAI | |||||||||
13 | AI principles | [An overarching concept, value, belief, or norm that guides AI development, testing, and deployment across the AI lifecycle. The OECD] identifies five complementary values-based principles for the responsible stewardship of trustworthy AI and calls on AI actors to promote and implement them: inclusive growth, sustainable development and well-being; human-centred values and fairness; transparency and explainability; robustness, security and safety; and accountability. | OECD_CAI_recommendation | |||||||||||
14 | algorithm | A set of computational rules to be followed to solve a mathematical problem. More recently, the term has been adopted to refer to a process to be followed, often by a computer. | Comptroller_Office | precise rules for transforming specified inputs into specified outputs in a finite number of steps | knuth_art_1981 | algorithms are step-by-step procedures for solving problems. For concreteness, we can think of them simply as being computed programs, written in some precise computer languages | garey_computers_1979 | |||||||
15 | algorithmic aversion | biased assessment of an algorithm which manifests in negative behaviours and attitudes towards the algorithm compared to a human agent. | Ekaterina_et_al_2020 | |||||||||||
16 | alignment | ensur[ing] that powerful AI is properly aligned with human values. ... The challenge of alignment has two parts. The first part is technical and focuses on how to formally encode values or principles in artificial agents so that they reliably do what they ought to do. ... The second part of the value alignment question is normative. It asks what values or principles, if any, we ought to encode in artificial agents. | Gabriel_2020 | |||||||||||
17 | amplification | [an act of amplifying, which is] to make larger or greater (as in amount, importance, or intensity). | Merriam-Webster_amplify | Let [construct space] 𝑌 ′ and [prediction space] 𝑌ˆ be categorical. Then, a model exhibits disparity amplification if 𝑑tv (𝑌ˆ |𝑍=0,𝑌ˆ |𝑍=1) > 𝑑tv (𝑌 ′ |𝑍=0,𝑌 ′ |𝑍=1). dtv is the total variation distance defined as follows. Let 𝑌0 and 𝑌1 be categorical random variables with finite supports Y0 and Y1. Then, the total variation distance between 𝑌0 and 𝑌1 is 𝑑tv (𝑌0,𝑌1) = 12 Σ︁ 𝑦∈Y0∪Y1 Pr[𝑌0=𝑦] − Pr[𝑌1=𝑦] . In the special case where 𝑌0,𝑌1 ∈ {0, 1}, the total variation distance can also be expressed as | Pr[𝑌0=1] − Pr[𝑌1=1] |. | yeom_avoiding_2021 | |||||||||
18 | analytics | Analytics is the application of scientific & mathematical methods to the study & analysis of problems involving complex systems. There are three distinct types of analytics: * Descriptive Analytics gives insight into past events, using historical data. * Predictive Analytics provides insight on what will happen in the future. * Prescriptive Analytics helps with decision making by providing actionable advice. | informs_analytics_2022 | |||||||||||
19 | annotation | Further documentation accompanying a requirement. | IEEE_Soft_Vocab | [the act of] mak[ing] or furnish[ing] critical or explanatory notes or comment | Merriam-Webster_annotate | |||||||||
20 | anomaly | Anything observed in the documentation or operation of a system that deviates from expectations based on previously verified system, software, or hardware products or reference documents. | IEEE_Soft_Vocab | Condition that deviates from expectations, based on requirements specifications, design documents, user documents, or standards, or from someone's perceptions or experiences. | SP800-160 | |||||||||
21 | anonymization | The process in which individually identifiable data is altered in such a way that it no longer can be related back to a given individual. Among many techniques, there are three primary ways that data is anonymized. Suppression is the most basic version of anonymization and it simply removes some identifying values from data to reduce its identifiability. Generalization takes specific identifying values and makes them broader, such as changing a specific age (18) to an age range (18-24). Noise addition takes identifying values from a given data set and switches them with identifying values from another individual in that data set. Note that all of these processes will not guarantee that data is no longer identifiable and have to be performed in such a way that does not harm the usability of the data. | IAPP_Privacy_Glossary | process that removes the association between the identifying dataset and the data subject | CSRC | |||||||||
22 | anthropomorphism | the attribution of distinctively human-like feelings, mental states, and behavioral characteristics to inanimate objects, animals, and in general to natural phenomena and supernatural entities | Anthropomorphism_in_AI_2020 | a particular human-like interpretation of existing physical features and behaviors that goes beyond what is directly observable | Anthropomorphism_in_AI_2020 | |||||||||
23 | application | A software program hosted by an information system. | SP800-37 | A hardware/software system implemented to satisfy a particular set of requirements. | CSRC | software or a program that is specific to the solution of an application problem | aime_measurement_2022 citing ISO/IEC TR 24030 | |||||||
24 | application programming interface (API) | a software contract between the application and client, expressed as a collection of methods or functions. . . it defines the available functions you can execute; . . . the intermediary interface between the client and the application. | Hands-On_Smart_Contract_Dev | |||||||||||
25 | artificial intelligence (AI) system | an engineered or machine-based system that can, for a given set of objectives, generate outputs such as predictions, recommendations, or decisions influencing real or virtual environments. AI systems are designed to operate with varying levels of autonomy | NIST AI RMF (Adapted from: OECD Recommendation on AI:2019; ISO/IEC 22989:2022). | |||||||||||
26 | artificial intelligence learning | The ingestion of a corpus, application of semantic mapping, and relevant ontology of structured and/or unstructured data that yields inference and correlation leading to the creation of useful conclusive or predictive capabilities in a given knowledge domain. Strong AI learning also includes the capability of creating unique hypotheses, attributing data relevance, processing data relationships, and updating its own lines of inquiry to further the usefulness of its purpose. | IEEE_Guide_IPA | |||||||||||
27 | artificial narrow intelligence (ANI) | [an AI system that] is designed to accomplish a specific problem-solving or reasoning task. | OECD_Artificial_Intelligence_in_Society | weak intelligence; applied intelligence | ||||||||||
28 | artificial neural networks | A computing system, made up of a number of simple, highly interconnected processing elements, which processes information by its dynamic state response to external inputs. | Reznik,_Leon | Definition 1. A directed graph is called an Artificial Neural Network (ANN) if it has x at least one start node (or Start Element; SE), x at least one end node (or End Element; EE), x at least one Processing Element (PE), x all the nodes used must be Processing Elements (PEs), except start nodes and end nodes, x a state variable ni associated with each node i, x a real valued weight wki associated with each link (ki) from node k to node i, x a real valued bias bi associated with each node i, x at least two of the multiple PEs connected in parallel, x a learning algorithm that helps to model the desired output for given input. x a flow on each link (ki) from node k to node i, that carries exactly the same flow which equals to nk caused by the output of node k , x each start node is connected to at least one end node, and each end node is connected to at least one start node, x no parallel edges (each link (ki) from node k to node i is unique). | ||||||||||
29 | assessment | Action of applying specific documented criteria to a specific software module, package or product for the purpose of determining acceptance or release of the software module, package or product. | IEEE_Soft_Vocab | the action or an instance of making a judgment about something : the act of assessing something : APPRAISAL | Merriam-Webster_assessment | |||||||||
30 | attack | Action targeting a learning system to cause malfunction. | NISTIR_8269_Draft | Any kind of malicious activity that attempts to collect, disrupt, deny, degrade, or destroy information system resources or the information itself. | CSRC | |||||||||
31 | attribute | Property associated with a a set of real or abstract things that is some characteristic of interest. | IEEE_Soft_Vocab | property or characteristic of an object that can be distinguished quantitatively or qualitatively by human or automated means | aime_measurement_2022, citing ISO/IEC TR 24029-1 | |||||||||
32 | audit | Systematic, independent, documented process for obtaining records, statements of fact, or other relevant information and assessing them objectively, to determine the extent to which specified requirements are fulfilled. | IEEE_Soft_Vocab | To conduct an independent review and examination of system records and activities in order to test the adequacy and effectiveness of data security and data integrity procedures, to ensure compliance with established policy and operational procedures, and to recommend any necessary changes. | FDA_Glossary | Independent examination of a software product, software process, or set of software processes to assess compliance with specifications, standards, contractual agreements, or other criteria | NASA_Soft_Standards | Independent review conducted to compare the various aspects of the laboratory’s performance with a standard for that performance. Also defined as a systematic, independent and documented process for obtaining audit evidence and evaluating it objectively to determine the extent to which audit criteria are fulfilled. | UNODC_Glossary_QA_GLP | |||||
33 | audit log | A chronological record of system activities, including records of system accesses and operations performed in a given period. | SP800-37 | |||||||||||
34 | authenticity | property that an entity is what it claims to be | ISO/IEC_TS_5723:2022(en) | |||||||||||
35 | automation | Independent machine-managed choreography of the operation of one or more digital systems. | IEEE_Guide_IPA | conversion of processes or equipment to automatic operation, or the results of the conversion | IEEE_Soft_Vocab | The system functions with no/little human operator involvement; however, the system performance is limited to the specific actions it has been designed to do. Typically these are well-defined tasks that have predetermined responses (i.e., simple rule-based responses). | DOD_TEVV | |||||||
36 | automation bias | over-relying on the outputs of AI systems | David_Leslie_Morgan_Briggs | |||||||||||
37 | autonomic | A monitor-analyze-plan-execute (MAPE) computer system capable of sensing environments, interpreting policy, accessing knowledge (data --- information --- knowledge), making decisions, and initiating dynamically assembled routines of choreographed activity to both complete a process and update the set of environmental variables that enables the autonomic system to self-manage its own operation and the processes it oversees. An autonomic system is identified by eight characteristics: a) Knows the resources to which it has access, what its capabilities and limitations are, and how and why it is connected to other systems. b) Is able to configure and reconfigure itself depending on the changing computing environment. c) Is able to optimize its performance to ensure the most efficient computing process. d) Is able to work around encountered problems either by repairing itself or routing functions away from the trouble. e) Is able to detect, identify, and protect itself against various types of attacks to maintain overall system security and integrity. f) Is able to adapt to its environment as it changes by interacting with neighboring systems and establishing communication protocols. g) Relies on open standards and requires access to proprietary environments to achieve full performance. h) Is able to anticipate the demand on its resources transparently to users. | IEEE_Guide_IPA | |||||||||||
38 | autonomous vehicle | [an] automobile, bus, tractor, combine, boat, forklift, etc. . . . capable of sensing its environment and moving safely with little or no human input. | Introduction_to_Information_Systems | |||||||||||
39 | autonomy | A system’s level of independence from human involvement and ability to operate without human intervention. [Different AI systems have different levels of autonomy.] An autonomous system has a set of learning, adaptive and analytical capabilities to respond to situations that were not pre-programmed or anticipated (i.e., decision-based responses) prior to system deployment. Autonomous or semi-autonomous AI systems can be characterised as "human-in-the-loop", "human-on-the-loop", or "human-out-of-the loop" systems depending on their level of meaningful involvement of human beings. | TTC6_Taxonomy_Terminology | |||||||||||
40 | availability | Ensuring timely and reliable access to and use of information. | SP800-37 | The property that data or information is accessible and usable upon demand by an authorized person. | NIST_SP_800 | property of being accessible and usable on demand by an authorized entity | ISO/IEC_TS_5723:2022(en) | |||||||
41 | back-testing | A form of outcomes analysis that involves the comparison of actual outcomes with modeled forecasts during a development sample time period (in-sample back-testing) and during a sample period not used in model development (out-of-time back-testing), and at an observation frequency that matches the forecast horizon or performance window of the model. | Comptroller_Office | |||||||||||
42 | batched automation | Process automation execution of intentionally segregated work processes that are able to be processed irrespective of their contextual placement within a service. | IEEE_Guide_IPA | |||||||||||
43 | benchmark | Standard against which results can be measured or assessed; Procedure, problem, or test that can be used to compare systems or components to each other or to a standard. | IEEE_Soft_Vocab | An alternative prediction or approach used to compare a model’s inputs and outputs to estimates from alternative internal or external data or models. | Comptroller_Office | The term benchmarking is used in machine learning (ML) to refer to the evaluation and comparison of ML methods regarding their ability to learn patterns in ‘benchmark’ datasets that have been applied as ‘standards’. Benchmarking could be thought of simply as a sanity check to confirm that a new method successfully runs as expected and can reliably find simple patterns that existing methods are known to identify. | olson_pmlb_2017 | |||||||
44 | bias | A systematic error. In the context of fairness, we are concerned with unwanted bias that places privileged groups at systematic advantage and unprivileged groups at systematic disadvantage. | AI_Fairness_360 | (computational bias) An effect which deprives a statistical result of representativeness by systematically distorting it, as distinct from a random error which may distort on any one occasion but balances out on the average. | OECD | (systemic bias) systematic difference in treatment of certain objects, people or groups in comparison to others | measurement_iso22989_2022 | (mathematical) A point estimator \theta_hat is said to be an unbiased estimator fo \theta if E(\theta_hat) = \theta for every possible value of \theta. If \theta_hat is not unbiased, the difference E(\theta_hat) - \theta is called the bias of \theta | devore_probability_2004 | |||||
45 | bias mitigation algorithm | A procedure for reducing unwanted bias in training data or models. | AI_Fairness_360 | |||||||||||
46 | bias testing | As it relates to disparate impact, courts and regulators have utilized or considered as acceptable various statistical tests to evaluate evidence of disparate impact. Traditional methods of statistical bias testing look at differences in predictions across protected classes, such as race or sex. In particular, courts have looked to statistical significance testing to assess whether the challenged practice likely caused the disparity and was not the result of chance or a nondiscriminatory factor. | SP1270 | |||||||||||
47 | big data | consists of extensive datasets primarily in the characteristics of volume, variety, velocity, and/or variabilitythat require a scalable architecture for efficient storage, manipulation, and analysis | NIST_1500 | |||||||||||
48 | binning | a technique of lumping small ranges of values together into categories, or "bins," for the purpose of reducing the variability (removing some of the fine structure) in a data set. | Pyle,_Dorian_Data_Preparation_as_a_Process | |||||||||||
49 | biometric data | personal data resulting from specific technical processing relating to the physical, physiological or behavioural characteristics of a natural person, which allow or confirm the unique identification of that natural person, such as facial images or dactyloscopic data; | GDPR | an individual’s physiological, biological, or behavioral characteristics, including information pertaining to an individual’s deoxyribonucleic acid (DNA), that is used or is intended to be used singly or in combination with each other or with other identifying data, to establish individual identity. Biometric information includes, but is not limited to, imagery of the iris, retina, fingerprint, face, hand, palm, vein patterns, and voice recordings, from which an identifier template, such as a faceprint, a minutiae template, or a voiceprint, can be extracted, and keystroke patterns or rhythms, gait patterns or rhythms, and sleep, health, or exercise data that contain identifying information. | CCPA | A measurable physical characteristic or personal behavioral trait used to recognize the identity, or verify the claimed identity, of an applicant. Facial images, fingerprints, and iris scan samples are all examples of biometrics. | SP800-12 | personal data; processing | ||||||
50 | boosting | A machine learning technique that iteratively combines a set of simple and not very accurate classifiers (referred to as "weak" classifiers) into a classifier with high accuracy (a "strong" classifier) by upweighting the examples that the model is currently misclassifying | aime_measurement_2022, citing Machine Learning Glossary by Google | |||||||||||
51 | breach | The loss of control, compromise, unauthorized disclosure, unauthorized acquisition, or any similar occurrence where: a person other than an authorized user accesses or potentially accesses personally identifiable information; or an authorized user accesses personally identifiable information for another than authorized purpose. | CSRC | |||||||||||
52 | broad artificial intelligence (broad AI) | Complex, computational, cognitive automation system capable of providing descriptive, predictive, prescriptive, and limited deductive analytics with relevance and accuracy exceeding human expertise in a broad, logically related set of knowledge domains. | IEEE_Guide_IPA | |||||||||||
53 | built-in test | Equipment or software embedded in the operational components or systems, as opposed to external support units, which perform a test or sequence of tests to verify mechanical or electrical continuity of hardware, or the proper automatic sequencing, data processing, and readout of hardware or software systems. | SP1011 | |||||||||||
54 | bug-bounty | Reward given to independent security researchers, penetrations testers, and white hat hackers for discovering exploitable software vulnerabilities and sharing this knowledge with the operator of a particular bug-bounty program (BBP). | Kuehn,_Andreas | |||||||||||
55 | business process | A defined set of business activities that represent the steps or tasks required to achieve a business objective, including the flow and use of information, participants, and human or digital resources. | IEEE_Guide_IPA | |||||||||||
56 | business process management | Discipline involving any combination of modeling, automation, execution, control, measurement and optimization of business activity flows, in support of enterprise goals, spanning systems, employees, customers, and partners within and beyond the enterprise boundaries. | IEEE_Guide_IPA | |||||||||||
57 | business rule | Definition, constraint, dependency, or decision criteria that determine the method of execution of a task or tasks, or influences the order of execution of a task or tasks. Business rules assert control, or influence the behavior, of a business process within computing systems. | IEEE_Guide_IPA | |||||||||||
58 | calibration | A comparison between a device under test and an established standard, such as UTC(NIST). When the calibration is finished, it should be possible to state the estimated time offset and/or frequency offset of the device under test with respect to the standard, as well as the measurement uncertainty. | CSRC | operation that, under specified conditions, in a first step, establishes a relation between the quantity values with measurement uncertainties provided by measurement standards and corresponding indications with associated measurement uncertainties and, in a second step, uses this information to establish a relation for obtaining a measurement result from an indication | aime_measurement_2022, citing ISO/IEC Guide 99 | Set of operations that establish, under specified conditions, the relationship between values indicated by a measuring instrument or measuring system, or values represented by a material measure, and the corresponding known values of a measurand. | UNODC_Glossary_QA_GLP | |||||||
59 | capability | measure of capacity and the ability of an entity, person or organization to achieve its objectives | ISO/IEC_TS_5723:2022(en) | |||||||||||
60 | case | Single entry, single exit multiple way branch that defines a control expression, specifies the processing to be performed for each value of the control expression, and returns control in all instances to the statement immediately following the overall construct. | IEEE_Soft_Vocab | |||||||||||
61 | chatbot | Conversational agent that dialogues with its user (for example: empathic robots available to patients, or automated conversation services in customer relations). | COE_AI_Glossary | |||||||||||
62 | choreography | An ordered sequence of system-to-system message exchanges between two or more participants. In choreography, there is no central controller, responsible entity, or observer of the process. | IEEE_Guide_IPA | |||||||||||
63 | classification | When the output is one of a finite set of values (such as sunny, cloudy or rainy), the learning problem is called classification, and is called Boolean or binary classification if there are only two values. | AIMA | task of assigning collected data to target categories or classes. | aime_measurement_2022, citing ISO/IEC TR 24030 | |||||||||
64 | classifier | A model that predicts categorical labels from features. | AI_Fairness_360 | |||||||||||
65 | clustering | Detecting potentially useful clusters of input examples. | AIMA | The basic problem of clustering may be stated as follows: Given a set of data points, partition them into a set of groups which are as similar as possible. | aggarwal_clustering_2013 | the tendency for items to be consistently grouped together in the course of recall. This grouping typically occurs for related items. It is readily apparent in memory tasks in which items from the same category, such as nonhuman animals, are recalled together. | APA_clustering | |||||||
66 | cognitive automation | The identification, assessment, and application of available machine learning algorithms for the purpose of leveraging domain knowledge and reasoning to further automate the machine learning already present in a manner that may be thought of as cognitive. With cognitive automation, the system performs corrective actions driven by knowledge of the underlying analytics tool itself, iterates its own automation approaches and algorithms for more expansive or more thorough analysis, and is thereby able to fulfill its purpose. The automation of the cognitive process refines itself and dynamically generates novel hypotheses that it can likewise assess against its existing corpus and other information resources. | IEEE_Guide_IPA | |||||||||||
67 | cognitive computing | Complex computational systems designed to — Sense (perceive the world and collect data); — Comprehend (analyze and understand the information collected); - Act (make informed decisions and provide guidance based on this analysis in an independent way); and — Adapt (adapt capabilities based on experience) in ways comparable to the human brain. | IEEE_Guide_IPA | |||||||||||
68 | column | In the context of relational databases, a column is a set of data values, all of a single type, in a table. | techopedia_column_2022 | |||||||||||
69 | computer vision | The digital process of perceiving and learning visual tasks in order to interpret and understand the world through cameras and sensors. | NSCAI | An image understanding task that automatically builds a description not only of the image itself, but of the three dimensional scene that it depicts. | NBSIR_82-2582 | |||||||||
70 | concept drift | Use of a system outside the planned domain of application, and a common cause of performance gaps between laboratory settings and the real world. | SP1270 | an online supervised learning scenario when the relation between the input data and the target variable changes over time. | Gama,_Joao | Systems that classify or predict a concept (e.g., credit ratings or computer intrusion monitors) over time can suffer performance loss when the concept they are tracking changes. This is referred to as concept drift. This can either be a natural process that occurs without a reference to the system, or an active process, where others are reacting to the system (e.g., virus detection). | Raynor | |||||||
71 | confidentiality | Data confidentiality is a property of data, usually resulting from legislative measures, which prevents it from unauthorized disclosure. | OECD | Preserving authorized restrictions on information access and disclosure, including means for protecting personal privacy and proprietary information. | CSRC | The property that data or information is not made available or disclosed to unauthorized persons or processes. | NIST_SP_800 | A property that information is not disclosed to users, processes, or devices unless they have been authorized to access the information. | CISA | |||||
72 | confusion matrix | A matrix showing the predicted and actual classifications. A confusion matrix is of size LxL, where L is the number of different label values | Kohavi,_Ron | |||||||||||
73 | consent | ‘Consent’ of the data subject means any freely given, specific, informed and unambiguous indication of the data subject's wishes by which he or she, by a statement or by a clear affirmative action, signifies agreement to the processing of personal data relating to him or her. | GDPR | “Consent” means any freely given, specific, informed, and unambiguous indication of the consumer’s wishes by which the consumer, or the consumer’s legal guardian, a person who has power of attorney, or a person acting as a conservator for the consumer, including by a statement or by a clear affirmative action, signifies agreement to the processing of personal information relating to the consumer for a narrowly defined particular purpose. Acceptance of a general or broad terms of use, or similar document, that contains descriptions of personal information processing along with other, unrelated information, does not constitute consent. Hovering over, muting, pausing, or closing a given piece of content does not constitute consent. Likewise, agreement obtained through use of dark patterns does not constitute consent. | CCPA | personal data | ||||||||
74 | constituent system | independent system that forms part of a system of systems (SoS) (note: Constituent systems can be part of one or more SoS. Each constituent system is a useful system by itself, having its own development, management, utilization, goals, and resources, but interacts within the SoS to provide the unique capability of the SoS). | ISO/IEC_TS_5723:2022(en) | |||||||||||
75 | constraint | Specification of what may be contained in a data or metadata set in terms of the content or, for data only, in terms of the set of key combinations to which specific attributes (defined by the data structure) may be attached. | OECD | A limitation or implied requirement that constrains the design solution or implementation of the systems engineering process and is not changeable by the enterprise | IEEE_Soft_Vocab | |||||||||
76 | construct validity | the degree to which the application of constructs to phenomena is warranted with respect to the research goals and questions. | Wieringa,_Roel_J. | Construct validation is involved whenever a test is to be interpreted as a measure of some attribute or quality which is not “operationally defined.” The problem faced by the investigator is, “What constructs account for variance in test performance?” | cronbach_construct_1955 | Established experimentally to demonstrate that a survey distinguishes between people who do and do not have certain characteristics. It is usually established experimentally. | fink_survey_2010 | Establishing construct validity means demonstrating, in a variety of ways, that the measurements obtained from measurement model are both meaningful and useful. | jacobs_measurement_2023 | |||||
77 | content validity | Refers to the extent to which a measure thoroughly and appropriately assesses the skills or characteristics it is intended to measure. | fink_survey_2010 | the extent to which a test measures a representative sample of the subject matter or behavior under investigation. For example, if a test is designed to survey arithmetic skills at a third-grade level, content validity indicates how well it represents the range of arithmetic operations possible at that level. Modern approaches to determining content validity involve the use of exploratory factor analysis and other multivariate statistical procedures. | APA_content_validity | |||||||||
78 | context | The context is the circumstances, purpose, and perspective under which an object is defined or used. | OECD | The immediate environment in which a function (or set of functions in a diagram) operates | IEEE_Soft_Vocab | the interrelated conditions in which something exists or occurs. | Merriam-Webster_context | |||||||
79 | contextual learning | A computing system with sufficient knowledge regarding its purpose that it understands the source, relevance, and utility of data and inputs. | IEEE_Guide_IPA | |||||||||||
80 | context-of-use | The Context of Use is the actual conditions under which a given artifact/software product is used, or will be used in a normal day to day working situation. | interaction_context_2023 | comprises a combination of users, goals, tasks, resources, and the technical, physical and social, cultural and organizational environments in which a system, product or service is used[; ...] can include the interactions and interdependencies between the object of interest and other systems, products or services. | ISO_9241-11:2018 | |||||||||
81 | controllability | property of a system that allows a human or another external agent to intervene in the system’s functioning; such a system is heteronomous. | ISO/IEC_TS_5723:2022(en) | |||||||||||
82 | control class | (control group) the set of observations in an experiment or prospective study that do not receive the experimental treatment(s). These observations serve (a) as a comparison point to evaluate the magnitude and significance of each experimental treatment, (b) as a reality check to compare the current observations with previous observation history, and (c) as a source of data for establishing the natural experimental error. | nist_statistics_2012 | |||||||||||
83 | controller | ‘Controller’ means the natural or legal person, public authority, agency or other body which, alone or jointly with others, determines the purposes and means of the processing of personal data; where the purposes and means of such processing are determined by Union or Member State law, the controller or the specific criteria for its nomination may be provided for by Union or Member State law; | GDPR | personal data; processor | ||||||||||
84 | copilot | An artificial intelligence powered software program designed to assist users with various tasks and automate features within compatible applications using advanced language models, machine-learning algorithms, and conversational interfaces to understand user requests and provide suggestions, summaries, and content generation in response. | A product or service that provides assistance using, incorporating and/or based on artificial intelligence software and artificial intelligence software services | |||||||||||
85 | corpus (corpora) | A deliberately assembled collection of knowledge and data (structured and/or unstructured) believed to contain relevant information on a topic or topics to be used by software systems for which useful analysis, prediction, or outcome is being sought. | IEEE_Guide_IPA | |||||||||||
86 | correlation | In its most general sense correlation denoted the interdependence between quantitative or qualitative data. In this sense it would include the association of dichotomised attributes and the contingency of multiply-classified attributes. | OECD | The correlation coefficient of two random variables y_1, and y_2, denoted \rho(y_1,y_2) is: \rho(y_1, y_2) = Cov(y_1, y_2)/\sqrt{Var(y_1)*Var(y_2)} | box_statistics_2005 | |||||||||
87 | counterfactual explanation | Statements taking the form: Score p was returned because variables V had values (v1, v2,...) associated with them. If V instead had values (v1', v2',...) score p' would have been returned. | wachter_counterfactual_2018 | |||||||||||
88 | counterfactual fairness | A fairness metric that checks whether a classifier produces the same result for one individual as it does for another individual who is identical to the first, except with respect to one or more sensitive attributes. Evaluating a classifier for counterfactual fairness is one method for surfacing potential sources of bias in a model | aime_measurement_2022, citing Machine Learning Glossary by Google | Given a predictive problem with fairness considerations, where A, X and Y represent the protected attributes, remaining attributes, and output of interest respectively, let us assume that we are given a causal model (U; V; F), where V = A \cup X. We postulate the following criterion for predictors of Y . Definition 5 (Counterfactual fairness). Predictor ^Y is counterfactually fair if under any context X = x and A = a, P( ^Y_{A <- a} (U) = y | X = x; A = a) = P( ^Y_{A <- a')(U) = y | X = x;A = a); (1) for all y and for any value a' attainable by A. | kusner_counterfactual_2017 | |||||||||
89 | countermeasure | Actions, devices, procedures, techniques, or other measures that reduce the vulnerability of a system. Synonymous with security controls and safeguards. | SP800-37 | Actions, devices, procedures, or techniques that meet or oppose (i.e., counters) a threat, a vulnerability, or an attack by eliminating or preventing it, by minimizing the harm it can cause, or by discovering and reporting it so that corrective action can be taken. | GWUC | safeguard; security control | ||||||||
90 | criterion validity | compares responses to future performance or to those obtained from other, more well-established surveys. Criterion validity is made up two subcategories: predictive and concurrent. Predictive validity refers to the extent to which a survey measure forecasts future performance. A graduate school entry examination that predicts who will do well in graduate school has predictive validity. Concurrent validity is demonstrated when two assessments agree or a new measure is compared favorably with one that is already considered valid. | fink_survey_2010 | an index of how well a test correlates with an established standard of comparison (i.e., a criterion). Criterion validity is divided into three types: predictive validity, concurrent validity, and retrospective validity. For example, if a measure of criminal behavior is valid, then it should be possible to use it to predict whether an individual (a) will be arrested in the future for a criminal violation, (b) is currently breaking the law, and (c) has a previous criminal record. | APA_criterion_validity | criterion-referenced validity; criterion-related validity | ||||||||
91 | crowdsource | a type of participative online activity in which an individual, an institution, a non-profit organization, or company proposes to a group of individuals of varying knowledge, heterogeneity, and number, via a flexible open call, the voluntary undertaking of a task. | Enrique | |||||||||||
92 | customer | The beneficiary of the execution of an automated task, process, or service. | IEEE_Guide_IPA | |||||||||||
93 | cybersecurity | Prevention of damage to, protection of, and restoration of computers, electronic communications systems, electronic communications services, wire communication, and electronic communication, including information contained therein, to ensure its availability, integrity, authentication, confidentiality, and nonrepudiation. | SP800-37 | |||||||||||
94 | dark pattern | “Dark pattern” means a user interface designed or manipulated with the substantial effect of subverting or impairing user autonomy, decisionmaking, or choice, as further defined by regulation. | CCPA | |||||||||||
95 | data | Characteristics or information, usually numerical, that are collected through observation. | OECD | re-interpretable representation of information in a formalized manner suitable for communication, interpretation or processing | aime_measurement_2022, citing ISO/IEC TR 24029-1 | |||||||||
96 | data analytics | the process of applying graphical, statistical, or quantitative techniques to a set of observations or measurements in order to summarize it or to find general patterns. | APA_data_analysis | Data analysis is the process of transforming raw data into usable information, often presented in the form of a published analytical article, in order to add value to the statistical output. | OECD | |||||||||
97 | data cleaning | Data Cleaning is the process of identifying, correcting, or removing inaccurate or corrupt data records | Ranschaert,_Erik | |||||||||||
98 | data control | management oversight of information policies for an organization’s information; observing and reporting on how processes are working and managing issues. | Egnyte | |||||||||||
99 | data dredging | A statistical bias in which testing huge numbers of hypotheses of a dataset may appear to yield statistical significance even when the results are statistically nonsignificant. | SP1270 | statistical bias; p-hacking | ||||||||||
100 | data drift | The change in model input data that leads to model performance degradation. | Microsoft_Azure_documentation | |||||||||||
101 | data-driven | Data-driven decision making (DDD) refers to the practice of basing decisions on the analysis of data rather than purely on intuition. | provost_data_2013 | |||||||||||
102 | data fabric | A data corpus, after the application of semantic mapping, relevant ontologies, and data seeding sufficient for artificial intelligence (AI) or machine learning algorithms to provide meaningful insight, prediction, and/or prescription. | IEEE_Guide_IPA | |||||||||||
103 | data fusion | A process in which data, generated by multiple sensory sources, is integrated and/or correlated to create information, knowledge, and/or intelligence that may be displayed for user or be actionable to accomplish the tasks. | SP1011 | The process of combining data from multiple sources to produce more accurate, consistent, and concise information than that provided by any individual data source. | Munir,_Arslan | |||||||||
104 | data governance | A set of processes that ensures that data assets are formally managed throughout the enterprise. A data governance model establishes authority and management and decision making parameters related to the data produced or managed by the enterprise. | CSRC | refers to a system, including policies, people, practices, and technologies, necessary to ensure data management within an organization | NIST_1500 | |||||||||
105 | data mining | computational process that extracts patterns by analysing quantitative data from different perspectives and dimensions, categorizing them, and summarizing potential relationships and impacts | aime_measurement_2022 citinig ISO/IEC 22989 | the process of data analysis and information extraction from large amounts of datasets with machine learning, statistical approaches. and many others. | Ranschaert,_Erik | |||||||||
106 | data point | a discrete unit of information. | TechTarget_data_point | |||||||||||
107 | data preparation | We define data preparation as the set of preprocessing operations performed in early stages of a data processing pipeline, i.e., data transformations at the structural and syntactical levels | hameed_data_2020 | |||||||||||
108 | data proxy | Data that are closely related to and serve in place of data that are either unobservable or immeasurable. | Comptroller_Office | |||||||||||
109 | data quality | degree to which the characteristics of data satisfy stated and implied needs when used under specified conditions | IEEE_Soft_Vocab | The dimensions of the IMF definition of "data quality" are: - integrity; - methodological soundness; - accuracy and reliability; - serviceability; - accessibility. There are a number of prerequisites for quality. These comprise: - legal and institutional environment; - resources; - quality awareness. | OECD | |||||||||
110 | data science | Methodology for the synthesis of useful knowledge directly from data through a process of discovery or of hypothesis formulation and hypothesis testing. | NIST_1500 | Interdisciplinary science that uses statistics, algorithms, and other methods to extract meaningful and useful patterns from data sets—sometimes known as “big data.” Today, machine learning is often used in this field. Next to analysis of data, data science is also concerned with the capturing, preparation, and interpretation of data. | AI_Ethics_Mark_Coeckelbergh | artificial intelligence (AI); machine learning (ML) | ||||||||
111 | data scientist | A practitioner who has sufficient knowledge in the overlapping regimes of business needs, domain knowledge, analytical skills, and software and systems engineering to manage the end-to-end data processes in the analytics life cycle. | NIST_1500 | |||||||||||
112 | data seeding | The intentional introduction of initial state conditions, influencing factors, and outcomes (both successful and unsuccessful) in a data fabric to create sufficient machine learning analysis signals to enable encouragement/discouragement to enrich deterministic relationships between data elements in a given information domain. | IEEE_Guide_IPA | |||||||||||
113 | data wrangling | process by which the data required by an application is identified, extracted, cleaned and integrated, to yield a data set that is suitable for exploration and analysis. | Furche,_Tim | |||||||||||
114 | decision | A conclusion reached after consideration of business rules and relevant data within a given process. | IEEE_Guide_IPA | Types of statements in which a choice between two or more possible outcomes controls which set of actions will result. | IEEE_Soft_Vocab | |||||||||
115 | decision point | A point within a business process where the process flow can take one of several alternative paths, including recursive. | IEEE_Guide_IPA | |||||||||||
116 | decision tree | Tree‐structure resembling a flowchart, where every node represents a test to an attribute, each branch represents the possible outcomes of that test, and the leaves represent the class labels. | Reznik,_Leon | |||||||||||
117 | decision-making | the cognitive process resulting in the selection of a belief or a course of action among several possible alternative options. It could be either rational or irrational. The decision-making process is a reasoning process based on assumptions of values, preferences and beliefs of the decision-maker. Every decision-making process produces a final choice, which may or may not prompt action. | Wikipedia_Decision-making | the cognitive process of choosing between two or more alternatives, ranging from the relatively clear cut (e.g., ordering a meal at a restaurant) to the complex (e.g., selecting a mate). Psychologists have adopted two converging strategies to understand decision making: (a) statistical analysis of multiple decisions involving complex tasks and (b) experimental manipulation of simple decisions, looking at the elements that recur within these decisions. | APA_decision_making | |||||||||
118 | decision support system | a computer program application used to improve a company's decision-making capabilities. It analyzes large amounts of data and presents an organization with the best possible options available[; they] bring together data and knowledge from different areas and sources to provide users with information beyond the usual reports and summaries. This is intended to help people make informed decisions. | TechTarget_decision_support_system | |||||||||||
119 | decommission | the total or partial removal of existing components and their corresponding sub-components from Production and any relevant environment, minimizing risks and impacts, ensuring policy compliance, and maximizing the financial benefits (i.e., optimizing the cost reduction). | IG1190M_AIOps_Decommission_v1.0.0 | |||||||||||
120 | deductive analytics | Insights, reporting, and information answering the question, "What would likely happen IF…?” Deductive analytics evaluates causes and outcomes of possible future events. | IEEE_Guide_IPA | deductive reasoning | ||||||||||
121 | deep learning | Deep learning is a broad family of techniques for machine learning in which hypotheses take the form of complex algebraic circuits with tunable connection strengths. The word “deep” refers to the fact that the circuits are typically organized into many layers, which means that computation paths from inputs to outputs have many steps. Deep learning is currently the most widely used approach for applications such as visual object recognition, machine translation, speech recognition, speech synthesis, and image synthesis; it also plays a significant role in reinforcement learning applications. | Russell_and_Norvig | A form of machine learning that uses neural networks with several layers of "neurons": simple interconnected processing units that interact. | AI_Ethics_Mark_Coeckelbergh | [an approach to AI that allows] computers to learn from experience and understand the world in terms of a hierarchy of concepts, with each concept defined through its relation to simpler concepts. By gathering knowledge from experience, this approach avoids the need for human operators to formally specify all the knowledge that the computer needs. The hierarchy of concepts enables the computer to learn complicated concepts by building them out of simpler ones. If we draw a graph showing how these concepts are built on top of each other, the graph is deep, with many layers. | deeplearningbook_intro | |||||||
122 | deepfake | AI-generated or manipulated image, audio or video content that resembles existing persons, objects, places or other entities or events and would falsely appear to a person to be authentic or truthful. | TTC6_Taxonomy_Terminology | |||||||||||
123 | deletion | Of an <X>, the action of destroying an instantiated <X>. | IEEE_Soft_Vocab | |||||||||||
124 | denial-of-service | The prevention of authorized access to resources or the delaying of time-critical operations. (Time-critical may be milliseconds or it maybe hours, depending upon the service provided). | SP800-12 | An attack that prevents or impairs the authorized use of information system resources or services. | CISA | when legitimate users are unable to access information systems, devices, or other network resources due to the actions of a malicious cyber threat actor. Services affected may include email, websites, online accounts (e.g., banking), or other services that rely on the affected computer or network. A denial-of-service condition is accomplished by flooding the targeted host or network with traffic until the target cannot respond or simply crashes, preventing access for legitimate users. DoS attacks can cost an organization both time and money while their resources and services are inaccessible. | ST04-015 | |||||||
125 | dependability | <of an item> ability to perform as and when required (note 1: includes availability, reliability, recoverability, maintainability, and maintenance support performance, and, in some cases, other characteristics such as durability, safety and security. Note 2: used as a collective term for the time-related quality characteristics of an item). | ISO/IEC_TS_5723:2022(en) | |||||||||||
126 | deployment | Phase of a project in which a system is put into operation and cutover issues are resolved | IEEE_Soft_Vocab | |||||||||||
127 | descriptive analytics | Insights, reporting, and information answering the question, “Why did something happen?” Descriptive analytics determines information useful to understanding the cause(s) of an event(s). | IEEE_Guide_IPA | |||||||||||
128 | deterministic | modelling [that] produces consistent outcomes for a given set of inputs, regardless of how many times the model is recalculated. The mathematical characteristics are known in this case. None of them is random, and each problem has just one set of specified values as well as one answer or solution. The unknown components in a deterministic model are external to the model. It deals with the definitive outcomes as opposed to random results and doesn’t make allowances for error. | Sourabh_Mehta_deterministic | |||||||||||
129 | deterministic algorithm | An algorithm that, given the same inputs, always produces the same outputs. | CSRC | |||||||||||
130 | developer | A general term that includes developers or manufacturers of systems, system components, or system services; systems integrators; vendors; and product resellers. Development of systems, components, or services can occur internally within organizations or through external entities. | SP800-37 | Individual or organization that performs development activities (including requirements analysis, design, testing through acceptance) during the system or software life‐cycle process. | IEEE_Soft_Vocab | |||||||||
131 | diagnostic analytics | Insights, reporting, and information answering the question, “Why did something happen?” Diagnostic analytics determines information useful to understanding the cause(s) of an event(s). | IEEE_Guide_IPA | |||||||||||
132 | diagnostics | Pertaining to the detection and isolation of faults or failures | IEEE_Software_Vocab | |||||||||||
133 | differential privacy | Differential privacy is a method for measuring how much information the output of a computation reveals about an individual. It is based on the randomised injection of "noise". Noise is a random alteration of data in a dataset so that values such as direct or indirect identifiers of individuals are harder to reveal. An important aspect of differential privacy is the concept of “epsilon” or ɛ, which determines the level of added noise. Epsilon is also known as the “privacy budget” or “privacy parameter”. | privacy-enhancing_technologies | For two datasets D and D' that differ in at most one element, a randomized algorithm $M$ guarantees \emph{$(\epsilon, \delta)$-differential privacy} for any subset of the output $S$ if $M$ satisfies: \begin{equation} Pr[M(D) \in S] \leq exp(\epsilon)*Pr[M(D') \in S] + \delta \end{equation} Furthermore, when $\delta = 0$ an algorithm M is said to guarantee \emph{$\epsilon$-differential privacy} | gong_differential_2020 | |||||||||
134 | differential validity | Differential validity states that the validities in two applicant populations are unequal, that is, pi != pa. | hunter_differential_1979 | |||||||||||
135 | digital labor | Digital automation of information technology systems and/or business processes that successfully delivers work output previously performed by human labor or new work output that would typically or alternatively have been performed by human labor. | IEEE_Guide_IPA | |||||||||||
136 | digital workforce | The collective suite of automation technologies delivering existing or new work output as applied in a business; the manifestation of digital labor. | IEEE_Guide_IPA | |||||||||||
137 | dimension | The dimension of an object is a topological measure of the size of its covering properties. Roughly speaking, it is the number of coordinates needed to specify a point on the object. | wolfram_math_2022 | Distinct components that a multidimensional construct encompasses | IEEE_Soft_Vocab | |||||||||
138 | dimension reduction | Dimensionality reduction is the process of taking data in a high dimensional space and mapping it into a new space whose dimensionality is much smaller | Shalev-Shwartz,_Shai | |||||||||||
139 | disparate impact | For Predictor Y and Sensitive Impact S. Definition 6.2 Disparate Impact (DI) = P[Yˆ = 1 | S != 1]/P[Yˆ = 1 | S = 1] | friedler_comparative_2019 | |||||||||||
140 | disparate treatment | Intentional discrimination, including (i) decisions explicitly based on protected characteristics; and (ii) intentional discrimination via proxy variables (e.g literacy tests for voting eligibility). | Lipton,_Zachary | |||||||||||
141 | distributional robustness | Optimizing the predictive accuracy for a whole class of distributions instead of just a single target distribution. | Meinshausen,_Nicolai | |||||||||||
142 | diversity | the practice of including the many communities, identities, races, ethnicities, backgrounds, abilities, cultures, and beliefs of the American people, including underserved communities. | EO_DEIA_2021 | inclusion | ||||||||||
143 | documentation | Collection of documents on a given subject; written or pictorial information describing, defining, specifying, reporting, or certifying activities, requirements, procedures, or results. | IEEE_Soft_Vocab | |||||||||||
144 | domain | Distinct scope, within which common characteristics are exhibited, common rules observed, and over which a distribution transparency is preserved. | IEEE_Soft_Vocab | A set of elements, data, resources, and functions that share a commonality in combinations of: (1) roles supported, (2) rules governing their use, and (3) protection needs. | SP800-160 | <artificial intelligence> specific field of knowledge or expertise | aime_measurement_2022, citing ISO/IEC 2382 | |||||||
145 | domain expertise | Domain expertise implies knowledge and understanding of the essential aspects of a specific field of inquiry. | McCue_Colleen | |||||||||||
146 | domain shift | Differences between the source and target domain data | Stacke,_Karin | distributional shift | ||||||||||
147 | drinking your own champagne | The practice in which tech workers use their own product consistently to see how well it works and where improvements can be made. | kelley_dogfooding_2022 | dogfooding, eating your own dogfood | ||||||||||
148 | dynamic process | The process in which one or more paths are defined and may be utilized based on the conditions present at the time of execution. | IEEE_Guide_IPA | |||||||||||
149 | edge case | a problem or situation, especially in computer programming, that only happens at the highest or lowest end of a range of possible values or in extreme situations: | cambridge_dictionary_2022 | |||||||||||
150 | embedding | An embedding is a representation of a topological object, manifold, graph, field, etc. in a certain space in such a way that its connectivity or algebraic properties are preserved. For example, a field embedding preserves the algebraic structure of plus and times, an embedding of a topological space preserves open sets, and a graph embedding preserves connectivity. One space X is embedded in another space Y when the properties of Y restricted to X are the same as the properties of X. | wolfram_math_2022 | |||||||||||
151 | emulation | The use of a data processing system to imitate another data processing system, so that the imitating system accepts the same data, executes the same programs, and achieves the same results as the imitated system. | IEEE_Soft_Vocab | |||||||||||
152 | end event | An activity, task, or output that describes or defines the conclusion of a process. | IEEE_Guide_IPA | |||||||||||
153 | engineer | n. 3a: a designer or builder of engines; b: a person who is trained in or follows as a profession a branch of engineering; c: a person who carries through an enterprise by skillful or artful contrivance; 4: a person who runs or supervises an engine or an apparatus. v. 1: to lay out, construct, or manage as an engineer. | Merriam-Webster_engineer | |||||||||||
154 | ensemble | a machine learning paradigm where multiple models (often called “weak learners”) are trained to solve the same problem and combined to get better results. The main hypothesis is that when weak models are correctly combined we can obtain more accurate and/or robust models. | Joseph_Rocca_Ensemble_methods | |||||||||||
155 | environment | Anything affecting a subject system or affected by a subject system through interactions with it, or anything sharing an interpretation of interactions with a subject system | IEEE_Soft_Vocab | |||||||||||
156 | equality of odds | (Equalized odds). We say that a predictor bY satisfies equalized odds with respect to protected attribute A and outcome Y, if bY and A are independent conditional on Y. | hardt_equality_2016 | The probability of a person in the positive class being correctly assigned a positive outcome and the probability of a person in a negative class being incorrectly assigned a positive outcome should both be the same for the protected and unprotected group members. In other words, the protected and unprotected groups should have equal rates for true positives and false positives. | Mehrabi,_Ninareh | |||||||||
157 | equality of opportunity | (Equal opportunity). We say that a binary predictor bY satisfies equal opportunity with respect to A and Y if Pr{bY = 1 | A = 0; Y = 1} = Pr{bY = 1 | A = 1; Y = 1}. | hardt_equality_2016 | The probability of a person in positive class being assigned to a positive outcome should be equal for both protected and unprotected group members. In other words, the protected and unprotected groups should have equal true positive rates. | Mehrabi,_Ninareh | |||||||||
158 | error | The difference between the observed value of an index and its “true” value. Errors maybe random or systematic. Random errors are generally referred to as “errors”. Systematic errors are called “biases”. | OECD | Difference between a computed, observed, or measured value or condition and the true, specified, or theoretically correct value or condition. | IEEE_Soft_Vocab | measured quantity value minus a reference quantity value | aime_measurement_2022, citing ISO/IEC Guide 99 | |||||||
159 | error propagation | the way in which uncertainties in the variables affect the uncertainty in the calculated results. | Dorf_2018 | propgation of uncertainty; proprgation of error | ||||||||||
160 | ethics | definition 1a: "a set of moral principles : a theory or system of moral values"; definition 1b: "the principles of conduct governing an individual or a group"; definition 1c: "a consciousness of moral importance"; definition 1d: "a guiding philosophy"; definition 2: "a set of moral issues or aspects (such as rightness)"; definition 3: "the discipline dealing with what is good and bad and with moral duty and obligation" | Merriam-Webster_ethic | n. 1. the branch of philosophy that investigates both the content of moral judgments (i.e., what is right and what is wrong) and their nature (i.e., whether such judgments should be considered objective or subjective). The study of the first type of question is sometimes termed normative ethics and that of the second metaethics. Also called moral philosophy. 2. the principles of morally right conduct accepted by a person or a group or considered appropriate to a specific field. In psychological research, for example, proper ethics requires that participants be treated fairly and without harm and that investigators report results and findings honestly. See code of ethics; professional ethics; research ethics. —ethical adj. | APA_ethics | |||||||||
161 | ethics by design | An approach to technology ethics and a key component of responsible innovation that aims to integrate ethics in the design and development stage of the technology. Sometimes formulated as "embedding values in design." Similar terms are "value-sensitive design" and "ethically aligned design." | AI_Ethics_Mark_Coeckelbergh | |||||||||||
162 | evaluation | (1) systematic determination of the extent to which an entity meets its specified criteria; (2) action that assesses the value of something | aime_measruement_2022, citing ISO/IEC 24765 | Test, Evaluation, Verification and Validation (TEVV) | ||||||||||
163 | example | definition 1: "one that serves as a pattern to be imitated or not to be imitated"; definition 3: "one that is representative of all of a group or type"; definition 4: "a parallel or closely similar case especially when serving as a precedent or model"; definition 5: "an instance (such as a problem to be solved) serving to illustrate a rule or precept or to act as an exercise in the application of a rule" | Merriam-Webster_example | |||||||||||
164 | exception | An event that occurs during the performance of the process that causes a diversion from the normal flow of the process. Exceptions are generated by an unanticipated event within a process due to an undefined or unknown input, undefined or unexpected outcome, or unforeseen sequencing of a task or event. | IEEE_Guide_IPA | |||||||||||
165 | execute | To carry out a plan, a task command, or another instruction | SP1011 | To carry out an instruction, process, or computer program; directing, managing, performing, and accomplishing the project work, providing the deliverables, and providing work performance information. | IEEE_Soft_Vocab | |||||||||
166 | experiment | a series of observations conducted under controlled conditions to study a relationship with the purpose of drawing causal inferences about that relationship. An experiment involves the manipulation of an independent variable, the measurement of a dependent variable, and the exposure of various participants to one or more of the conditions being studied. Random selection of participants and their random assignment to conditions also are necessary in experiments. | apa_experiment_2023 | A study of a fundamental physical process by the use of one or more computer simulators. Like empirical experiments, input variables (factors) are systematically changed to assess their impact upon simulator outputs (responses). Unlike empirical experiments, the simulator responses are deterministic, and this has implications: Computer experiments can appropriately have their factors with intermediate levels and the scope, especially the number of runs, can be more ambitious. Further, modeling methods based on interpolators (especially kriging) emerge as a viable approach. Good practice is to use Latin hypercubes for computer experiments, and advanced nonparametric modeling methods such as kriging, neural networks, and multivariate adaptive regression splines (MARS) in the data analysis stage. Important applications of computer experimental methods are for determining process optima and for evaluating process tolerances. | nist_statistics_2012 | |||||||||
167 | expert system | A form of AI that attempts to replicate a human's expertise in an area, such as medical diagnosis. It combines a knowledge base with a set of hand-coded rules for applying that knowledge. Machine-learning techniques are increasingly replacing hand coding. | Hutson,_Matthew | Intelligent computer program that uses knowledge and inference procedures to solve problems that are difficult enough to require significant human expertise for their solution. | Reznik,_Leon | An expert system is an intelligent computer program that uses knowledge and inference procedures to solve problems that are difficult enough to require significant human expertise for their solution. | OECD | Computer system that provides for expertly solving problems in a given field or application area by drawing inferences from a knowledge base developed from human expertise. | IEEE_Soft_Vocab | A computer system emulating the decision-making ability of a human expert through the use of reasoning, leveraging an encoding of domain-specific knowledge most commonly represented by sets of if-then rules rather than procedural code. The term “expert system” was used largely during the 1970s and ’80s amidst great enthusiasm about the power and promise of rule-based systems that relied on a “knowledge base” of domain-specific rules and rule-chaining procedures that map observations to conclusions or recommendations. | NSCAI | |||
168 | expertise | The accumulation of specialized knowledge is often called expertise. Passive expertise is a type of knowledge-based specialization that arises from experiences in life and one's position in a society or culture. Formal expertise is the result of a self-selection of a domain of knowledge that is mastered deliberately and for which there are clear benchmarks of success. | Schneider_McGrew_in_Flanagan_McDonough_2018 | |||||||||||
169 | explainability | The ability to provide a human interpretable explanation for a machine learning prediction and produce insights about the causes of decisions, potentially to line up with human reasoning. | NISTIR_8269_Draft | Within the context of AI, the extent to which AI decisioning processes and outcomes are reasonably understood. | Comptroller_Office | A characteristic of an AI system in which there is provision of accompanying evidence or reasons for system output in a manner that is meaningful or understandable to individual users (as well as to developers and auditors) and reflects the system’s process for generating the output (e.g., what alternatives were considered, but not proposed, and why not). | NSCAI | interpretability | ||||||
170 | explainer | Functionality for providing details on or causes for fairness metric results. | AI_Fairness_360 | |||||||||||
171 | explanation | Systems deliver accompanying evidence or reason(s) for all outputs. | NISTIR_8269_Draft | The explanation principle obligates AI systems to supply evidence, support, or reasoning for each output. | NISTIR_8312 | |||||||||
172 | exploratory | Exploratory Data Analysis (EDA) is an approach/philosophy for data analysis that employs a variety of techniques (mostly graphical) to 1. maximize insight into a data set; 2. uncover underlying structure; 3. extract important variables; 4. detect outliers and anomalies; 5. test underlying assumptions; 6. develop parsimonious models; and 7. determine optimal factor settings. | nist_statistics_2012 | |||||||||||
173 | external validity | the extent to which the results of research or testing can be generalized beyond the sample that generated them. The more specialized the sample, the less likely will it be that the results are highly generalizable to other individuals, situations, and time periods. | APA_external_validity | |||||||||||
174 | facial recognition (FR) | Face recognition algorithms, however, have no built-in notion of a particular person. They are not built to identify particular people; instead they include a face detector followed by a feature extraction algorithm that converts one or more images of a person into a vector of values that relate to the identity of the person. The extractor typically consists of a neural network that has been trained on ID-labeled images available to the developer. In operations, they act as generic extractors of identity-related information from photos of persons they have usually never seen before. Recognition proceeds as a differential operator: Algorithms compare two feature vectors and emit a similarity score. This is a vendor-defined numeric value expressing how similar the parent faces are. It is compared to a threshold value to decide whether two samples are from, or represent, the same person or not. Thus, recognition is mediated by persistent identity information stored in a feature vector (or “template”). | NISTIR_8280 | |||||||||||
175 | fairness metric | A quantification of unwanted bias in training data or models. | AI_Fairness_360 | A mathematical definition of “fairness” that is measurable. Some commonly used fairness metrics include: equalized odds predictive parity counterfactual fairness demographic parity Many fairness metrics are mutually exclusive; see incompatibility of fairness metrics. | google_glossary_2023 | |||||||||
176 | false negative | An example in which the predictive model mistakenly classifies an item as in the negative class. | NSCAI | an outcome where the model incorrectly predicts the negative class. | google_dev_classification-true-false-positive-negative | A false negative is denying an applicant who should be approved | Varshney,_Kush | 1. An instance in which a security tool intended to detect a particular threat fails to do so. 2. Incorrectly classifying malicious activity as benign. | CSRC_false_negative | Type II error (in statistics) | ||||
177 | false positive | An example in which the model mistakenly classifies an item as in the positive class | NSCAI | an outcome where the model incorrectly predicts the positive class. | google_dev_classification-true-false-positive-negative | A false positive is approving an applicant who should be denied | Varshney,_Kush | 1. An alert that incorrectly indicates that a vulnerability is present. 2. An alert that incorrectly indicates that malicious activity is occurring. 3. An instance in which a security tool incorrectly classifies benign content as malicious. 4. Incorrectly classifying benign activity as malicious. 5. An erroneous acceptance of the hypothesis that a statistically significant event has been observed. This is also referred to as a type 1 error. This is also referred to as a type 1 error. When “health-testing” the components of a device, it often refers to a declaration that a component has malfunctioned – based on some statistical test(s) – despite the fact that the component was actually working correctly. | CSRC_false_positive | Type I error (in statistics) | ||||
178 | fault tolerance | The ability of a system or component to continue normal operation despite the presence of hardware or software faults | SP1011 | |||||||||||
179 | favorable label | A label whose value corresponds to an outcome that provides an advantage to the recipient. The opposite is an unfavorable label. | AI_Fairness_360 | |||||||||||
180 | feature | An attribute containing information for predicting the label. | AI_Fairness_360 | |||||||||||
181 | feature extraction | a more general method in which one tries to develop a transformation of the input space onto the lowdimensional subspace that preserves most of the relevant information | khalid_feature_2014 | |||||||||||
182 | feature importance | how important the feature was for the classification performance of the model; a measure of the individual contribution of the corresponding feature for a particular classifier, regardless of the shape (e.g., linear or nonlinear relationship) or direction of the feature effect | saarela_feature_2021 | |||||||||||
183 | feature shift | Unlike joint distribution shift detection, which cannot localize which features caused the shift, we define a new hypothesis test for each feature individually. Naïvely, the simplest test would be to check if the marginal distributions have changed for each feature (as explored by [25]); however, the marginal distribution would be easy for an adversary to simulate (e.g., by looping the sensor values from a previous day). Thus, marginal tests are not sufficient for our purpose. Therefore, we propose to use conditional distribution tests. More formally, our null and alternative hypothesis for the j-th feature is that its full conditional distribution (i.e., its distribution given all other features) has not shifted for all values of the other features. | kulinski_feature_2020 | |||||||||||
184 | federated learning | An approach to machine learning which addresses problems of data governance and privacy by training algorithms collaboratively without transferring the data to a central location. Each federated device trains on data locally and shares its local model parameters instead of sharing the training data. Different federated learning systems have different topologies that involve different ways of sharing parameters. | TTC6_Taxonomy_Terminology | |||||||||||
185 | feedback loop | describes the process of leveraging the output of an AI system and corresponding end-user actions in order to retrain and improve models over time. The AI-generated output (predictions or recommendations) are compared against the final decision (for example, to perform work or not) and provides feedback to the model, allowing it to learn from its mistakes. | C3.ai_feedback_loop | closed-loop learning | ||||||||||
186 | fitting | Fitting is the process of verifying whether the data item value is in the previously specified interval. | OECD | |||||||||||
187 | firmware | Computer programs and data stored in hardware - typically in read-only memory (ROM) or programmable read-only memory (PROM) - such that the programs and data cannot be dynamically written or modified during execution of the programs. | SP800-37 | Combination of a hardware device and computer instructions or computer data that reside as read only software on the hardware device. | IEEE_Soft_Vocab | |||||||||
188 | Forecasting | Estimate or prediction of conditions and events in the project's future based on information and knowledge available at the time of the forecast. The information is based on the project's past performance and expected future performance, and includes information that could impact the project in the future, such as estimate at completion and estimate to complete. | IEEE_Soft_Vocab | |||||||||||
189 | fraud detection | Monitoring the behavior of populations of users in order to estimate, detect, or avoid undesirable behavior. | Kou,_Yufeng | detecting and recognizing fraudulent activities as they enter systems and report them to a system manager. | Behdad | |||||||||
190 | fully autonomous | Accomplishes its assigned mission, within a defined scope, without human intervention while adapting to operational and environmental conditions | SP1011 | |||||||||||
191 | generative adversarial network (GAN) | Generative Adversarial Networks, or GANs for short, are an approach to generative modeling using deep learning methods, such as convolutional neural networks. Generative modeling is an unsupervised learning task in machine learning that involves automatically discovering and learning the regularities or patterns in input data in such a way that the model can be used to generate or output new examples that plausibly could have been drawn from the original dataset. | Brownlee,_Jason | A pair of jointly trained neural networks that generates realistic new data and improves through competition. One net creates new examples (fake Picassos, say) as the other tries to detect the fakes. | Hutson,_Matthew | Generative adversarial networks (GANs) consist of two competing neural networks—a generator network that tries to create fake outputs (such as pictures), and a discriminator network that tries to determine whether the outputs are real or fake. A major advantage of this structure is that GANs can learn from less data than other deep learning algorithms. | CRS_AI | An approach to training AI models useful for applications like data synthesis, augmentation, and compression where two neural networks are trained in tandem: one is designed to be a generative network (the forger) and the other a discriminative network (the forgery detector). The objective is for each network to train and better itself off the other, reducing the need for big labeled training data. | NSCAI | |||||
192 | global | A global explanation produces a model that approximates the non-interpretable model. | NISTIR_8312_Full | |||||||||||
193 | governance | The actions to ensure stakeholder needs, conditions, and options are evaluated to determine balanced, agreed-upon enterprise objectives; setting direction through prioritization and decision-making; and monitoring performance and ompliance against agreed-upon directions and objectives. AI governance may include policies on the nature of AI applications developed and deployed versus those limited or withheld. | NSCAI | A system of laws, policies, frameworks, practices and processes at international, national and organizational levels. AI governance helps various stakeholders implement, manage, oversee and regulate the development, deployment and use of AI technology. It also helps manage associated risks to ensure AI aligns with stakeholders' objectives, is developed and used responsibly and ethically, and complies with applicable legal and regulatory requirements. | IAPP_Governance_Terms | |||||||||
194 | graph | Diagram that represents the variation of a variable in comparison with that of one or more other variables. Diagram or other representation consisting of a finite set of nodes and internode connections called edges or arcs. | IEEE_Soft_Vocab | A graph (sometimes called an undirected graph to distinguish it from a directed graph, or a simple graph to distinguish it from a multigraph) is a pair G = (V, E), where V is a set whose elements are called vertices (singular: vertex), and E is a set of paired vertices, whose elements are called edges (sometimes links or lines). | wikipedia_graph_2023 | |||||||||
195 | graphical processing unit (GPU) | A specialized chip capable of highly parallel processing. GPUs are well-suited for running machine learning and deep learning algorithms. GPUs were first developed for efficient parallel processing of arrays of values used in computer graphics. Modern-day GPUs are designed to be optimized for machine learning. | NSCAI | |||||||||||
196 | ground truth | information provided by direct observation as opposed to information provided by inference | Collins_Dictionary_ground_truth | value of the target variable for a particular item of labelled input data | aime_measurement_2022, citing ISO/IEC 22989 | |||||||||
197 | group fairness | The goal of groups defined by protected attributes receiving similar treatments or outcomes. | AI_Fairness_360 | |||||||||||
198 | hacker | Unauthorized user who attempts to or gains access to an information system. | Reznik,_Leon | Technically sophisticated computer enthusiast who uses his or her knowledge and means to gain unauthorized access to protected resources. | IEEE_Soft_Vocab | |||||||||
199 | hardware | Physical equipment used to process, store, or transmit computer programs or data | IEEE_Soft_Vocab | |||||||||||
200 | harm | An undesired outcome [whose] cost exceeds some threshold[; ...] the key points in the definition of safety are that: costs have to be sufficiently high in some human sense for events to be harmful, and that safety involves reducing both the probability of expected harms and the possibility of unexpected harms. | Engineering_safety_in_machine_learning | |||||||||||
201 | harmful bias | Harmful bias can be either conscious or unconscious. Unconscious, also known as implicit bias, involves associations outside conscious awareness that lead to a negative evaluation of a person on the basis of characteristics such as race, gender, sexual orientation, or physical ability. Discrimination is behavior; discriminatory actions perpetrated by individuals or institutions refer to inequitable treatment of members of certain social groups that results in social advantages or disadvantages | humphrey_addressing_2020 | |||||||||||
202 | human-assisted | The type of human-robot-interaction that that refers to situations during which human interactions are needed at the level of detail of task plans, i.e., during the execution of a task | SP1011 | |||||||||||
203 | human-computer interaction (HCI) | methods and approaches for designing and architecting user interfaces and the interactions between humans and computer (or information) technology. | Poore_Lawrence_ARLIS_2023-01 | |||||||||||
204 | human-cognitive bias | Human-cognitive biases relate to how an individual or group perceives AI system information to make a decision or fill in missing information, or how humans think about purposes and functions of an AI system. Human biases are omnipresent in decision-making processes across the AI lifecycle and system use, including the design, implementation, operation, and maintenance of AI. | NIST_AI_RMF_1.0 | Systematic error in judgment and decision-making common to all human beings which can be due to cognitive limitations, motivational factors, and/or adaptations to natural environments. | ||||||||||
205 | human-enabled machine learning | Detection, correlation, and pattern recognition generated through machine-based observation of human operation of software systems capturing successful or unsuccessful operations to enable the creation of a useful predictive analytics capability. | IEEE_Guide_IPA | |||||||||||
206 | human-in-the-loop | An AI system that requires human interaction. | DOD_Modeling_and_Simulation_Glossary | |||||||||||
207 | human-machine teaming (HMT) | The ability of humans and AI systems to work together to undertake complex, evolving tasks in a variety of environments with seamless handoff both ways between human and AI team members. Areas of effort include developing effective policies for controlling human and machine initiatives, computing methods that ideally complement people, methods that optimize goals of teamwork, and designs that enhance human-AI interaction. | NSCAI | methods and approaches for coordinating the functions and actions of (semi) autonomous machine capabilities and human users, which are granted equal weighting. | Poore_Lawrence_ARLIS_2023-01 | human-AI teaming | ||||||||
208 | human-operator-intervention | The need for human interaction in a normally fully autonomous behavior due to some extenuating circumstances. | SP1011 | |||||||||||
209 | human subjects | a living individual about whom an investigator (whether professional or student) conducting research: (i) Obtains information or biospecimens through intervention or interaction with the individual, and uses, studies, or analyzes the information or biospecimens; or (ii) Obtains, uses, studies, analyzes, or generates identifiable private information or identifiable biospecimens. | 45_CFR_46_2018_Requirements_(2018_Common_Rule) | participant | ||||||||||
210 | human system integration (HSI) | methods and approaches for testing and optimizing all human-related considerations from a “whole-system” or “system-of-systems” level. | Poore_Lawrence_ARLIS_2023-01 | |||||||||||
211 | hyperparameters | the parameters that are used to either configure a ML model (e.g., the penalty parameter C in a support vector machine, and the learning rate to train a neural network) or to specify the algorithm used to minimize the loss function (e.g., the activation function and optimizer types in a neural network, and the kernel type in a support vector machine). | On_Hyperparameter_Optimization | |||||||||||
212 | hypothesis testing | A term used generally to refer to testing significance when specific alternatives to the null hypothesis are considered. | OECD | |||||||||||
213 | impact assessment | a risk management tool that seeks to ensure an organization has sufficiently considered a system's relative benefits and costs before implementation. In the context of AI, an impact assessment helps to answer a simple question: alongside this system’s intended use, for whom could it fail? | Bipartisan_Policy_Center_impact_assessments | An evaluation process designed to identify, understand, document and mitigate the potential ethical, legal, economic and societal implications of an AI system in a specific use case. | IAPP_Governance_Terms | |||||||||
214 | impersonation | A malicious individual is able to impersonate a legitimate data subject to the data controller. The adversary forges a valid access request and goes through the identity verification enforced by the data controller. The data controller sends to the adversary the data of a legitimate data subject. Defeating impersonation is the primary objective of any authentication protocol. The result of this attack is a data breach (e.g. blaggers [sic] pretend to be someone they are not in order to wheedle out the information they are seeking obtaining information illegaly which they then sell for a specified price). | Security_Analysis_of_Subject_Access | |||||||||||
215 | in-processing | Techniques that modify the algorithms in order to mitigate bias during model training. Model training processes could incorporate changes to the objective (cost) function or impose a new optimization constraint. | SP1270 | Techniques that try to modify and change state-of-the-art learning algorithms to remove discrimination during the model training process. | Mehrabi,_Ninareh | |||||||||
216 | in-processing algorithm | A bias mitigation algorithm that is applied to a model during its training. | AI_Fairness_360 | |||||||||||
217 | incident | a situation in which AI systems caused, or nearly caused, real-world harm. | AI_Incident_Database | the occurrence of a technical event that affects the integrity of a Product and/or Model. | FBPML_Wiki | an alleged harm or near harm event to people, property, or the environment where an AI system is implicated. | AI_Incident_Editors | Adverse event(s) in a computer system or networks caused by a failure of a security mechanism, or an attempted or threatened breach of these mechanisms. | Hasan,_Raza | |||||
218 | incident response | a public official response to an incident ... from an entity (i.e. company, organization, individual) allegedly responsible for developing or deploying the AI or AI system involved in said incident. | AIID_incident_response | |||||||||||
219 | independence | Of software quality assurance (SQA), situation in which SQA is free from technical, managerial, and financial influences, intentional or unintentional | IEEE_Soft_Vocab | Two events are independent if the occurrence of one event does not affect the chances of the occurrence of the other event. The mathematical formulation of the independence of events A and B is the probability of the occurrence of both A and B being equal to the product of the probabilities of A and B (i.e., P(A and B) = P(A)P(B)) | nist_800_2010 | In simple terms, inclusion is getting the mix to work together. | ||||||||
220 | individual fairness | The goal of similar individuals receiving similar treatments or outcomes. | AI_Fairness_360 | Give similar predictions to similar individuals | Mehrabi,_Ninareh | A fairness metric that checks whether similar individuals are classified similarly | aime_measurement_2022 citing Machine Learning Glossary by Google | |||||||
221 | inference | The stage of ML in which a model is applied to a task. For example, a classifier model produces the classification of a test sample. | NISTIR_8269_Draft | |||||||||||
222 | information input component | One of the three components of a model. This component delivers assumptions and data to the model. | Comptroller_Office | |||||||||||
223 | information security | preservation of confidentiality, integrity and availability of information; in addition, other properties, such as authenticity, accountability, non-repudiation, and reliability can also be involved. | ISO/IEC_TS_5723:2022(en) | |||||||||||
224 | input | Data received from an external source | IEEE_Soft_Vocab | |||||||||||
225 | insider attack | Those who are within [an] organisation may have authorised access to vast amounts of sensitive company records that are essential for maintaining competitiveness and market position, and knowledge of information services and procedures that are crucial for daily operations. . . .[and] should an individual choose to act against the organisation, then with their privileged access and their extensive knowledge, they are well positioned to cause serious damage. | IEEE_Caught_in_the_Act | |||||||||||
226 | in silico | carrying out some experiment by means of a computer simulation | World_Wide_Words_In_silico | computer simulation testing | ||||||||||
227 | instance | Discrete, bounded thing with an intrinsic, immutable, and unique identity. Individual occurrence of a type | IEEE_Soft_Vocab | A single object of the world from which a model will be learned, or on which a model will be used (e.g., for prediction). | Kohavi,_Ron | |||||||||
228 | instance weight | A numerical value that multiplies the contribution of a data point in a model. | AI_Fairness_360 | |||||||||||
229 | integrity | Degree to which a system, product, or component prevents unauthorized access to, or modification of, computer programs or data. | IEEE_Soft_Vocab | Guarding against improper information modification or destruction, and includes ensuring information non-repudiation and authenticity. | CSRC | The property whereby information, an information system, or a component of a system has not been modified or destroyed in an unauthorized manner. | CISA | <data> property whereby data have not been altered in an unauthorized manner since they were created, transmitted, or stored; <systems> property of accuracy and completeness | ISO/IEC_TS_5723:2022(en) | the quality of moral consistency, honesty, and truthfulness with oneself and others. | APA_integrity | |||
230 | intelligent process automation | A preconfigured software instance that combines business rules, experience- based context determination logic, and decision criteria to initiate and execute multiple interrelated human and automated processes in a dynamic context. The goal is to complete the execution of a combination of processes, activities, and tasks in one or more unrelated software systems that deliver a result or service with minimal or no human intervention. | IEEE_Guide_IPA | |||||||||||
231 | interaction | Action that takes place with the participation of the environment of the object. | IEEE_Soft_Vocab | |||||||||||
232 | internal validity | the degree to which a study or experiment is free from flaws in its internal structure and its results can therefore be taken to represent the true nature of the phenomenon. In other words, internal validity pertains to the soundness of results obtained within the controlled conditions of a particular study, specifically with respect to whether one can draw reasonable conclusions about cause-and-effect relationships among variables. | APA_internal_validity | |||||||||||
233 | interoperability | The ability of software or hardware systems or components to operate together successfully with minimal effort by end user | SP1011 | Degree to which two or more systems, products or components can exchange information and use the information that has been exchanged. | IEEE_Soft_Vocab | The ability for tools to work together in execution, communication, and data exchange under specific conditions. | NIST_1500 | |||||||
234 | interpretability | The ability to understand the value and accuracy of system output. Interpretability refers to the extent to which a cause and effect can be observed within a system or to which what is going to happen given a change in input or algorithmic parameters can be predicted. | NSCAI | The ability to explain or to present an ML model’s reasoning in understandable terms to a human | aime_measurement_2022, citing Machine Learning Glossary by Google | explainability | ||||||||
235 | interpretable model | An interpretable machine learning model obeys a domain-specific set of constraints to allow it (or its predictions, or the data) to be more easily understood by humans. These constraints can differ dramatically depending on the domain. | rudin_interpretable_2022 | |||||||||||
236 | intervenability | the property that intervention is possible concerning all ongoing or planned privacy relevant data processing[; ...] the data subjects themselves should be able to intervene with regards to the processing of their own data ... [to ensure] that data subjects have the ability to control how their data is processed and by whom. | Covert_et_al | |||||||||||
237 | knowledge | The sum of all information derived from diagnostic, descriptive, predictive, and prescriptive analytics embedded in or available to or from a cognitive computing system. | IEEE_Guide_IPA | <artificial intelligence> abstracted information about objects, events, concepts or rules, their relationships and properties, organized for goal-oriented systematic use | aime_measurement_2022, citinig ISO/IEC 22989 | |||||||||
238 | label | A value corresponding to an outcome. | AI_Fairness_360 | target variable assigned to a sample | aime_measurement_2022, citing ISO/IEC 22989 | |||||||||
239 | label shift | Under label shift, the label distribution p(y) might change but the class-conditional distributions p(x|y) do not. ... We work with the label shift assumption, i.e., ps(x|y) = pt(x|y) | saurabh_label_2020 | |||||||||||
240 | large language model (LLM) | a class of language models that use deep-learning algorithms and are trained on extremely large textual datasets that can be multiple terabytes in size. LLMs can be classed into two types: generative or discriminatory. Generative LLMs are models that output text, such as the answer to a question or even writing an essay on a specific topic. They are typically unsupervised or semi-supervised learning models that predict what the response is for a given task. Discriminatory LLMs are supervised learning models that usually focus on classifying text, such as determining whether a text was made by a human or AI. | AI_Assurance_2022 | language model | ||||||||||
241 | language model | A language model is an approximative description that captures patterns and regularities present in natural language and is used for making assumptions on previously unseen language fragments. | Gustavii,_Ebba | large language model (LLM) | ||||||||||
242 | learning | A procedure in artificial intelligence by which an artificial intelligence program improves its performance by gaining knowledge. | Dennis_Mercadal | the acquisition of novel information, behaviors, or abilities after practice, observation, or other experiences, as evidenced by change in behavior, knowledge, or brain function. Learning involves consciously or nonconsciously attending to relevant aspects of incoming information, mentally organizing the information into a coherent cognitive representation, and integrating it with relevant existing knowledge activated from long-term memory. | APA_learning | |||||||||
243 | least privilege | The principle that a security architecture should be designed so that each entity is granted the minimum system resources and authorizations that the entity needs to perform its function. | CSRC | The security objective of granting users only those accesses they need to perform their official duties. | SP-800-12 | |||||||||
244 | lemmatization | the process of grouping together the different inflected forms of a word so they can be analyzed as a single item. | Artasanchez_Joshi_AI_with_Python | in natural language processing[, ...] working with words according to their root lexical components | Techopedia_lemmatization | grouping together words with the same root or lemma but with different inflections or derivatives of meaning so they can be analyzed as one item. | Techslang_lemmatization | |||||||
245 | linear model | [a supervised learning algorithm that uses] a simple formula to find a best-fit line through a set of data points. | dataiku_ML_and_linear_models | (linear) An operator L^~ is said to be linear if, for every pair of functions f and g and scalar t, L^~(f+g)=L^~f+L^~g and L^~(tf)=tL^~f. | wolfram_mathworld_2022 | |||||||||
246 | local | A local explanation explains a subset of decisions or is a per-decision explanation. | NISTIR_8312_Full | |||||||||||
247 | localization | Creation of a national or specific regional version of a product. | IEEE_Soft_Vocab | |||||||||||
248 | logistic model | (logistic equation) The continuous version of the logistic model is described by the differential equation (dN)/(dt)=(rN(K-N))/K, (1) where r is the Malthusian parameter (rate of maximum population growth) and K is the so-called carrying capacity (i.e., the maximum sustainable population). Dividing both sides by K and defining x=N/K then gives the differential equation (dx)/(dt)=rx(1-x), (2) which is known as the logistic equation and has solution x(t)=1/(1+(1/(x_0)-1)e^(-rt)). (3) The function x(t) is sometimes known as the sigmoid function. | wolfram_mathworld_2022 | |||||||||||
249 | machine learning | A branch of Artificial Intelligence (AI) that focuses on the development of systems capable of learning from data to perform a task without being explicitly programmed to perform that task. Learning refers to the process of optimizing model parameters through computational techniques such that the model's behaviour is optimized for the training task. | TTC6_Taxonomy_Terminology | A subcategory of artificial intelligence; a method of designing a sequence of actions to solve a problem that optimizes automatically through experience and with limited or no human intervention. | Comptroller_Office | |||||||||
250 | machine observation | Machine detection and interpretation of relevant and meaningful events and conditions that impact operation of the computer system itself or other dependent mechanisms or processes essential to the purpose of the system. | IEEE_Guide_IPA | |||||||||||
251 | malware | Hardware, firmware, or software that is intentionally included or inserted in a system for a harmful purpose. | Reznik,_Leon | Software that compromises the operation of a system by performing an unauthorized function or process. | CISA | trojan horse | ||||||||
252 | materiality | Refers to the significance of a matter in relation to a set of financial or performance information. If a matter is material to the set of information, then it is likely to be of significance to a user of that information | OECD | |||||||||||
253 | McNamara fallacy | presum[ing] that (A) quantitative models of reality are always more accurate than other models; (B) the quantitative measurements that can be made most easily must be the most relevant; and (C) factors other than those currently being used in quantitative metrics must either not exist or not have a significant influence on success. Also known as the quantitative fallacy. | McNamara_Fallacy | quantitative fallacy | ||||||||||
254 | measurement | (Quantitative) (1) act or process of assigning a number or category to an entity to describe an attribute of that entity; (2) assignment of numbers to objects in a systematic way to represent properties of the object; (3) use of a metric to assign a value (e.g., a number or category) from a scale to an attribute of an entity; (4) set of operations having the object of determining a value of a measure; (5) assignment of values and labels to aspects of software engineering work products, processes, and resources plus the models that are derived from them, whether these models are developed using statistical or other techniques; (6) figure, extent, or amount obtained by measuring | aime_measurement_2022, citing ISO/IEC 24765 | (Qualitative) (1) a way of learning about social reality [...][that uses] approaches [...] to explore, describe, or explain social phenomen[a]; unpack the meaning people ascribe to activities, situations, events, or [artifacts]; build a depth of understanding about some aspect of social life; build "thick descriptions" (see Clifford Geertz, 1973) of people in naturalistic settings; explore new or underresearched areas; or make micro-macro links (illuminate connections between individuals-groups and institutional and/or cultural contexts). (2) [approaches that] can make visible and unpick the mechanisms which link particular variables, by looking at the explanations, or accounts, provided by those involved. | Leavy_OHQR_Intro | Qualitative measurement engages research methods and techniques to provide information about the nature of phenomenon. Qualitative methods are designed for systematic collection, organization, description and interpretation of non-numeric (textual, verbal or visual) data (Hammarberg et. al, 2016). Qualitative measurement generally answers questions about why, for whom, when, and how something is (or is not) observed, whereas quantitative measurement answers questions about what is observed. Elements assessed using qualitative measurement may include contextual norms or meaning, socio-cultural dynamics, individual or collective beliefs, and complex multi-component interactions or interventions (Busetto et. al, 2020). | Hammarberg_2016_Busetto_2020 | Documentation of assumptions and methods used is a foundational element of qualitative measurement, as the choice of single or combined methods is made based on the phenomenon and its context (Russell & Gregory, 2003). When appropriately paired, qualitative and quantitative measurement can provide corroboration or elaboration, demonstrate use cases, and/or identify conditions for complementarity or contradiction (Brannen, 2005). | Russell_2003_Brannen_2005 | |||||
255 | measurement method | generic description of a logical organization of operations used in a measurement | aime_measurement_2022, citing ISO/IEC Guide 99 | logical sequence of operations, described generically, used in quantifying an attribute with respect to a specified scale | aime_measurement_2022, citing ISO/IEC 24765 | |||||||||
256 | measurement model | The initial confirmatory factory analysis (CFA) model that underlies the structural model [that] tests the adequacy (as indexed by model fit) of the specified relations whereby indicators are linked to their underlying construct. | Little_2013 | A statistical model that links unobservable theoretical constructs, operationalized as latent variables, and observable properties—i.e., data about the world | jackman_oxford_2008 | |||||||||
257 | measurability | ability to assess an attribute of an entity against a metric (note 1: "measurable" is the adjective form of "measurability") | ISO/IEC_TS_5723:2022(en) | |||||||||||
258 | membership inference | given a machine learning model and a record, determining whether the record was used as part of the model's training dataset or not. | ||||||||||||
259 | metadata | Metadata is data that defines and describes other data. | OECD | Data that describe other data. | IEEE_Soft_Vocab | Data employed to annotate other data with descriptive information, possibly including their data descriptions, data about data ownership, access paths, access rights, and data volatility. | ||||||||
260 | metric | defined measurement method and measurement scale | ISO/IEC_TS_5723:2022(en) | (1) quantitative measure of the degree to which a system, component, or process possesses a given attribute; (2) defined measurement method and the measurement scale; c.f., measure in this section above | aime_measurement_2022, citing ISO/IEC 24765 | |||||||||
261 | minimization | (Part of the ICO framework for auditing AI) AI systems generally require large amounts of data. However, organisations must comply with the minimisation principle under data protection law if using personal data. This means ensuring that any personal data is adequate, relevant and limited to what is necessary for the purposes for which it is processed. […] The default approach of data scientists in designing and building AI systems will not necessarily take into account any data minimisation constraints. Organisations must therefore have in place risk management practices to ensure that data minimisation requirements, and all relevant minimisation techniques, are fully considered from the design phase, or, if AI systems are bought or operated by third parties, as part of the procurement process due diligence | ICO_data_minimisation | a data controller should limit the collection of personal information to what is directly relevant and necessary to accomplish a specified purpose. They should also retain the data only for as long as is necessary to fulfil that purpose. In other words, data controllers should collect only the personal data they really need, and should keep it only for as long as they need it. The data minimisation principle is expressed in Article 5(1)(c) of the GDPR and Article 4(1)(c) of Regulation (EU) 2018/1725, which provide that personal data must be "adequate, relevant and limited to what is necessary in relation to the purposes for which they are processed". | EDPS_data_minimization | |||||||||
262 | mixed methods | In mixed methods, the researcher collects and analyzes both qualitative and quantitative data rigorously in response to research questions and hypotheses; integrates the two forms of data and their results; organizes these procedures into specific research designs that provide the logic and procedures for conducting the study; and frames these procedures within theory and philosophy. | Creswell_Clark_mixed_methods | research in which the inquirer or investigator collects and analyzes data, integrates the findings, and draws inferences using both qualitative and quantitative approaches or methods in a single study or a program of study. | Lisa_M._Given_SAGE | |||||||||
263 | MLOPS | MLOps (machine learning operations) stands for the collection of techniques and tools for the deployment of ML models in production. | symeonidis_MLOps_2022 | |||||||||||
264 | model | A function that takes features as input and predicts labels as output. | AI_Fairness_360 | A model is a formalised expression of a theory or the causal situation which is regarded as having generated observed data. In statistical analysis the model is generally expressed in symbols, that is to say in a mathematical form, but diagrammatic models are also found. The word has recently become very popular and possibly somewhat over-worked. | OECD | A core component of an AI system used to make inferences from inputs in order to produce outputs. A model characterizes an input-to-output transformation intended to perform a core computational task of the AI system (e.g., classifying an image, predicting the next word for a sequence, or selecting a robot's next action given its state and goals). | TTC6_Taxonomy_Terminology | A quantitative method, system, or approach that applies statistical, economic, financial, or mathematical theories, techniques, and assumptions to process input data into quantitative estimates. A model consists of three components: an information input component, which delivers assumptions and data to the model; a processing component, which transforms inputs into estimates; and a reporting component, which translates the estimates into useful business information. | Comptroller_Office | |||||
265 | model assertion | Model assertions are arbitrary functions over a model’s input and output that indicate when errors may be occurring | Kang,_Daniel | |||||||||||
266 | model card | short documents accompanying trained machine learning models that provide benchmarked evaluation in a variety of conditions, such as across different cultural, demographic, or phenotypic groups (e.g., race, geographic location, sex, Fitzpatrick skin type) and intersectional groups (e.g., age and race, or sex and Fitzpatrick skin type) that are relevant to the intended application domains. [They] also disclose the context in which models are intended to be used, details of the performance evaluation procedures, and other relevant information. | Model_Cards_for_Model_Reporting | A brief document that discloses information about an AI model, like explanations about intended use, performance metrics and benchmarked evaluation in various conditions, such as across different cultures, demographics or race. | IAPP_Governance_Terms | |||||||||
267 | model debugging | Model debugging aims to diagnose a model’s failures. | Jain_Saachi | |||||||||||
268 | model decay | Model decay depicts that the performance of the model is degrading over time | Nayak,_Pragati | |||||||||||
269 | model editing | An area of research that aims to enable fast, data-efficient updates to a pre-trained base model’s behavior for only a small region of the domain, without damaging model performance on other inputs of interest | Mitchell,_Eric | |||||||||||
270 | model extraction | Adversaries maliciously exploiting the query interface to steal the model. More precisely, in a model extraction attack, a good approximation of a sensitive or proprietary model held by the server is extracted (i.e. learned) by a dishonest user who interacts with the server only via the query interface. | Chandrasekaran,_Varun | model inversion; model stealing | ||||||||||
271 | model governance | Model Governance is the name for the overall internal framework of a firm or organization that controls the processes for Model Development, Model Validation and Model Usage, assign responsibilities and roles etc. | open_risk_2022 | |||||||||||
272 | model inventory | in the context of Risk Management, [...] a database/[management information system] developed for the purpose of aggregating quantitative model related information that is in use by a firm or organization. | ORM_model_inventory | |||||||||||
273 | model overlay | Judgmental or qualitative adjustments to model inputs or outputs to compensate for model, data, or other known limitations. A model overlay is a type of override. | Comptroller_Office | |||||||||||
274 | model risk management | model risk management encompasses governance and control mechanisms such as board and senior management oversight, policies and procedures, controls and compliance, and an appropriate incentive and organizational structure | Fed_Reserve | |||||||||||
275 | model suite | A group of models that work together. | Comptroller_Office | |||||||||||
276 | model training | the phase in the data science development lifecycle where practitioners try to fit the best combination of weights and bias to a machine learning algorithm to minimize a loss function over the prediction range | C3.ai_Model_Training | process to determine or to improve the parameters of a machine learning model, based on a machine learning algorithm, by using training data | aime_measurement_2022, citing ISO/IEC 22989 | |||||||||
277 | model validation | the set of processes and activities intended to verify that models are performing as expected. | yields.io_model_validation | the set of principles, practices and organizational arrangements supporting a rigorous (audited) model development and validation cycle. | Open_Risk_Manual_model_validation | |||||||||
278 | monitoring | Examination of the status of the activities of a supplier and of their results by the acquirer or a third party. | IEEE_Soft_Vocab | Continual checking, supervising, critically observing or determining the status in order to identify change from the performance level required or expected. | SP800-160 | |||||||||
279 | moral agency | The capacity for moral action, reasoning, judgment, and decision making, as opposed to merely having moral consequences. | AI_Ethics_Mark_Coeckelbergh | |||||||||||
280 | moral patiency | The moral standing of an entity in the sense of how that entity should be treated. | AI_Ethics_Mark_Coeckelbergh | |||||||||||
281 | naive Bayes | The naive Bayes classifier is a Bayesian learning method that has been found to be useful in many practical applications. It is called "naive" because it incorporates the simplifying assumption that attribute values are conditionally independent, given the classification of the instance. The naive Bayes classifier applies to learning tasks where each instance x is described by a conjunction of attribute values and where the target function f(x) can take on any value from some finite set V. | Mitchell,_Tom | |||||||||||
282 | natural language processing | The field concerned with machines capable of processing, analysing, and generating human language, either spoken, written or signed. | TTC6_Taxonomy_Terminology | |||||||||||
283 | neural network | A model that, taking inspiration from the brain, is composed of layers (at least one of which is hidden) consisting of simple connected units or neurons followed by nonlinearities | aime_measurement_2022, citing Machine Learnign Glossary by Google | |||||||||||
284 | nondiscrimination | the practice of treating people, companies, countries, etc. in the same way as others in order to be fair: | Cambridge Dictionary | In the context of machine learning non-discrimination can be defined as follows: (1) people that are similar in terms non-protected characteristics should receive similar predictions, and (2) differences in predictions across groups of people can only be as large as justified by non-protected characteristics. | Žliobaitė_Indrė | the practice of treating people, companies, countries, etc. in the same way as others in order to be fair | Cambridge_Dictionary_non-discrimination | |||||||
285 | normal flow | The intended flow of a process originating from a start event, continuing through all defined activities, and concluding successfully to its defined end event. | IEEE_Guide_IPA | |||||||||||
286 | normalization | Conceptual procedure in database design that removes redundancy in a complex database by establishing dependencies and relationships between database entities. Normalization reduces storage requirements and avoids database inconsistencies. | OECD | The process of converting an actual range of values into a standard range of values, typically −1 to +1 or 0 to 1 | aime_measurement_2022, citing Machine Learning Glossary by Google | |||||||||
287 | objective evidence | data supporting the existence or verity of something (note: can be obtained through observation, measurement, test, or other means). | ISO/IEC_TS_5723:2022(en) | |||||||||||
288 | observation | a piece of information received online from users, sensors, or other knowledge sources | poole_mackworth_observation | the careful, close examination of an object, process, or other phenomenon for the purpose of collecting data about it or drawing conclusions. | APA_observation | |||||||||
289 | offline learning | implies ... a static dataset that [one] know[s] from the start and the parameters of [one's] machine learning algorithm are adjusted to the whole dataset at once often loading the whole dataset into memory or in batches. | Ben_Auffarth_2021 | |||||||||||
290 | online learning | fitting [one's] model incrementally as the data flows in (streaming data). | Ben_Auffarth_2021 | |||||||||||
291 | ontology | A set of concepts and categories in a subject area or knowledge domain that shows their properties and the relationships among them to enable interoperability among disparate elements and systems and specify interfaces to independent, knowledge-based services for the purpose of enabling certain kinds of automated reasoning. | IEEE_Guide_IPA | |||||||||||
292 | opacity | The nature of some AI techniques whereby the inferential operations are complex, hidden, or otherwise opaque to their developers and end users in terms of providing an understanding of how classifications, recommendations, or actions are generated and what overall performance will be. | NSCAI | A description of some deep learning systems [that] take an input and provide an output, but the calculations that occur in between are not easy for humans to interpret. | Hutson,_Matthew | When one or more features of an AI system, such as processes, the provenance of datasets, functions, output or behaviour are unavailable or incomprehensible to all stakeholders – usually an antonym for transparency. | TTC6_Taxonomy_Terminology | black box; unexplainable | ||||||
293 | operationalization | Putting AI systems or related concepts into use so they can be measured. | ||||||||||||
294 | operator | A role assumed by the person performing remote control or teleoperation, semi-autonomous operations, or other human-in-the-loop types of operations | SP1011 | Individual or organization that performs the operations of a system. | IEEE_Soft_Vocab | Individual or organization that performs the operations of a system. | SP800-160 | |||||||
295 | opt-in | an individual makes an active affirmative indication of choice via a user interface signaling a desire to share their information with third parties. | IAPP_Privacy_Glossary | privacy; consent; opt-out | ||||||||||
296 | opt-out | an individual makes an active affirmative indication of choice via a user interface signaling a desire not to share their information with third parties. | IAPP_Privacy_Glossary | privacy; consent; opt-in | ||||||||||
297 | outcome | something that follows as a result or consequence | merriam_webster_outcome | |||||||||||
298 | outlier | An outlier is a data point that is far from other points. | Russell_and_Norvig | An outlier is a data value that lies in the tail of the statistical distribution of a set of data values. | OECD | Values distant from most other values. In machine learning, any of the following are outliers: • Weights with high absolute values • Predicted values relatively far away from the actual values • Input data whose values are more than roughly 3 standard deviations from the mean Outliers often cause problems in model training. Clipping is one way of managing outliers | aime_measurement_2022 citing Machine Learning Glossary by Google | |||||||
299 | output | Data transmitted to an external destination | IEEE_Soft_Vocab | Process by which an information processing system, or any of its parts, transfers data outside of that system or part | IEEE_Soft_Vocab | |||||||||
300 | overfitting | Given a hypothesis space H, a hypothesis h element of H is said to overfit the training data if there exists some alternative hypothesis h' element of H, such that h has smaller error than h' over the training examples, but h' has a smaller error than h over the entire distribution of instance. | Mitchell,_Tom | |||||||||||
301 | package | a folder with all the code and metadata needed to train and serve a machine learning model. | about_ML_packages | |||||||||||
302 | parametric | A learning model that summarizes data with a set of parameters of fixed size (independent of the number of training examples) | Russell_and_Norvig | |||||||||||
303 | parent process | A process that may contain one or more sub-processes, activities, and tasks. | IEEE_Guide_IPA | |||||||||||
304 | parity | Bit(s) used to determine whether a block of data has been altered. Rationale: Term has been replaced by the term “parity bit”. | NIST_CSRC_parity | the quality or state of being equal or equivalent | Merriam-Webster_parity | |||||||||
305 | participation | engag[ing] multiple stakeholders in deliberative processes in order to achieve consensus. | Sloane_et_al_2020 | |||||||||||
306 | participant | A computer system, data, input, business rule, human intervention, and other contributor to the flow of a process. | IEEE_Guide_IPA | a living individual about whom an investigator (whether professional or student) conducting research: (i) Obtains information or biospecimens through intervention or interaction with the individual, and uses, studies, or analyzes the information or biospecimens; or (ii) Obtains, uses, studies, analyzes, or generates identifiable private information or identifiable biospecimens. | 45_CFR_46_2018_Requirements_(2018_Common_Rule) | human subject | ||||||||
307 | passive learning agent | A passive learning agent has a fixed policy that determines its behavior. An active learning agent gets to decide what actions to take. | Russell_and_Norvig | active learning agent | ||||||||||
308 | personal data | ‘Personal data’ means any information relating to an identified or identifiable natural person (‘data subject’); an identifiable natural person is one who can be identified, directly or indirectly, in particular by reference to an identifier such as a name, an identification number, location data, an online identifier or to one or more factors specific to the physical, physiological, genetic, mental, economic, cultural or social identity of that natural person. | GDPR | (1) “Personal information” means information that identifies, relates to, describes, is reasonably capable of being associated with, or could reasonably be linked, directly or indirectly, with a particular consumer or household. Personal information includes, but is not limited to, the following if it identifies, relates to, describes, is reasonably capable of being associated with, or could be reasonably linked, directly or indirectly, with a particular consumer or household: (A) Identifiers such as a real name, alias, postal address, unique personal identifier, online identifier, Internet Protocol address, email address, account name, social security number, driver’s license number, passport number, or other similar identifiers. (B) Any personal information described in subdivision (e) of Section 1798.80. (C) Characteristics of protected classifications under California or federal law. (D) Commercial information, including records of personal property, products or services purchased, obtained, or considered, or other purchasing or consuming histories or tendencies. (E) Biometric information. (F) Internet or other electronic network activity information, including, but not limited to, browsing history, search history, and information regarding a consumer’s interaction with an internet website application, or advertisement. (G) Geolocation data. (H) Audio, electronic, visual, thermal, olfactory, or similar information. (I) Professional or employment-related information. (J) Education information, defined as information that is not publicly available personally identifiable information as defined in the Family Educational Rights and Privacy Act (20 U.S.C. Sec. 1232g; 34 C.F.R. Part 99). (K) Inferences drawn from any of the information identified in this subdivision to create a profile about a consumer reflecting the consumer’s preferences, characteristics, psychological trends, predispositions, behavior, attitudes, intelligence, abilities, and aptitudes. (L) Sensitive personal information. (2) “Personal information” does not include publicly available information or lawfully obtained, truthful information that is a matter of public concern. For purposes of this paragraph, “publicly available” means: information that is lawfully made available from federal, state, or local government records, or information that a business has a reasonable basis to believe is lawfully made available to the general public by the consumer or from widely distributed media; or information made available by a person to whom the consumer has disclosed the information if the consumer has not restricted the information to a specific audience. “Publicly available” does not mean biometric information collected by a business about a consumer without the consumer’s knowledge. (3) “Personal information” does not include consumer information that is deidentified or aggregate consumer information. | CCPA | |||||||||
309 | policy | The general principles by which a government is guided in its management of public affairs, or the legislature in its measures. This term, as applied to a law, ordinance, or rule of law, denotes its general purpose or tendency considered as directed to the POLICY | law_policy_2023 | A policy defines the learning agent’s way of behaving at a given time | sutton_reinforcement_2018 | |||||||||
310 | positionality | the researcher's starting points and standpoints before and during inquiry, as well as the conditions shaping the research situation, process, and product. | Charmaz_Henwood | reflexivity | ||||||||||
311 | post-hoc explanation | Post-hoc explainability targets models that are not readily interpretable by design by resorting to diverse means to enhance their interpretability, such as text explanations, visual explanations, local explanations, explanations by example, explanations by simplification and feature relevance explanations techniques. Each of these techniques covers one of the most common ways humans explain systems and processes by themselves. | NISTIR_8312_Full | Post-hoc explainability targets models that are not readily inter- pretable by design by resorting to diverse means to enhance their in- terpretability, such as text explanations, visual explanations, local expla- nations, explanations by example, explanations by simplification and feature relevance explanations techniques. Each of these techniques covers one of the most common ways humans explain systems and processes by themselves. | barredo_explainable_2020 | |||||||||
312 | post-processing | Typically performed with the help of a holdout dataset (data not used in the training of the model). Here, the learned model is treated as a black box and its predictions are altered by a function during the post-processing phase. The function is deduced from the performance of the black box model on the holdout dataset. | SP1270 | Performed after training by accessing a holdout set that was not involved during the training of the model. If the algorithm can only treat the learned model as a black box without any ability to modify the training data or learning algorithm, then only post-processing can be used in which the labels assigned by the black-box model initially get reassigned based on a function during the post-processing phase. | Mehrabi,_Ninareh | Steps performed after a machine learning model has been run to adjust its output. This can include adjusting a model's outputs or using a holdout dataset — data not used in the training of the model — to create a function run on the model's predictions to improve fairness or meet business requirements. | IAPP_Governance_Terms | |||||||
313 | post-processing algorithm | A bias mitigation algorithm that is applied to predicted labels. | AI_Fairness_360 | |||||||||||
314 | practical significance | a conceptual framework for evaluating discrimination cases developed primarily on statistical evidence that is the subject of increasing interest and discussion by some in the equal employment opportunity (EEO) field. | DOL_Practical_Significance | statistical significance (often paired in contrast to this); substantive significance (synonym) | ||||||||||
315 | pre-processing algorithm | A bias mitigation algorithm that is applied to training data. | AI_Fairness_360 | |||||||||||
316 | precision | A metric for classification models. Precision identifies the frequency with which a model was correct when classifying the positive class. | NSCAI | closeness of agreement between indications or measured quantity values obtained by replicate measurements on the same or similar objects under specified conditions | aime_measurement_2022, citing ISO/IEC Guide 99 | A metric for classification models. Precision identifies the frequency with which a model was correct when predicting the positive class. That is: Precision = True Positive /(True Positive + False Positive) | aime_measurement_2022, citing Machine Learning Glossary by Google | Closeness of agreement between independent test results obtained under prescribed conditions. It is generally dependent on analyte concentration, and this dependence should be determined and documented. The measure of precision is usually expressed in terms of imprecision and computed as a standard deviation of the test results. Higher imprecision is reflected by a larger standard deviation. Independent test results means results obtained in a manner not influenced by any previous results on the same or similar material. Precision covers repeatability and reproducibility [19]. Alternatively, precision is a measure for the reproducibility of measurements within a set, that is, of the scatter or dispersion of a set about its central value. Precision depends only on the distribution of random errors and does not relate to the true value or specified value. | UNODC_Glossary_QA_GLP | |||||
317 | prediction | Forecasting quantitative or qualitative outputs through function approximation, applied on input data or measurements. | NSCAI | primary output of an AI system when provided with input data or information | aime_measurement_2022, citing ISO/IEC 22989 | |||||||||
318 | predictive analysis | The organization of analyses of structured and unstructured data for inference and correlation that provides a useful predictive capability to new circumstances or data. | IEEE_Guide_IPA | |||||||||||
319 | predictive analytics | Insights, reporting, and information answering the question, "What is likely to happen?" Predictive analytics support high confidence foretelling of future event(s). | IEEE_Guide_IPA | |||||||||||
320 | preprocessing | Transforming the data so that the underlying discrimination is mitigated. This method can be used if a modeling pipeline is allowed to modify the training data. | SP1270 | |||||||||||
321 | prescriptive analytics | Insights, reporting, and information answering the question, “What should I do about it?" Prescriptive analytics determines information that provides high confidence actions necessary to recover from an event or fulfill a need. | IEEE_Guide_IPA | |||||||||||
322 | privacy | freedom from intrusion into the private life or affairs of an individual | ISO/IEC_TS_5723:2022(en) | freedom from intrusion into the private life or affairs of an individual when that intrusion results from undue or illegal gathering and use of data about that individual | aime_measurement_2022, citing ISO/IEC TR 24029-1 | |||||||||
323 | privacy-by-design | Embedding privacy measures and privacy enhancing technologies directly into the design of information technologies and systems. | ENISA | data-protection-by-design (def: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A02016R0679-20160504&qid=1532348683434) | ||||||||||
324 | privacy-enhancing technology | A coherent system of ICT (Information and Communications Technology) measures that protects privacy by eliminating or reducing personal data or by preventing unnecessary and/or undesired processing of personal data, all without losing the functionality of the information system. | PET_Handbook | |||||||||||
325 | privileged protected attribute | A value of a protected attribute indicating a group that has historically been at systematic advantage. | AI_Fairness_360 | |||||||||||
326 | procedure | Information item that presents an ordered series of steps to perform a process, activity, or task. | IEEE_Soft_Vocab | |||||||||||
327 | process | A sequence or flow of activities in an organization with the objective of carrying out work, which may include a set of activities, events, tasks, and decisions in a sequenced flow that adhere to finite execution semantics. Process levels will generally follow structure at the capability maturity model integration (CMMI) level. | IEEE_Guide_IPA | Set of interrelated or interacting activities that transforms inputs into outputs | IEEE_Soft_Vocab | |||||||||
328 | process flow | The defined representation of the overall progression of how a process is intended to be performed, including all exceptions. | IEEE_Guide_IPA | |||||||||||
329 | processing | ‘Processing’ means any operation or set of operations which is performed on personal data or on sets of personal data, whether or not by automated means, such as collection, recording, organisation, structuring, storage, adaptation or alteration, retrieval, consultation, use, disclosure by transmission, dissemination or otherwise making available, alignment or combination, restriction, erasure or destruction. | GDPR | “Processing” means any operation or set of operations that are performed on personal information or on sets of personal information, whether or not by automated means. | CCPA | personal data; processing | ||||||||
330 | processing environment | the combination of software and hardware on which the Application runs. | Law_Insider_processing_environment | |||||||||||
331 | processor | ‘Processor’ means a natural or legal person, public authority, agency or other body which processes personal data on behalf of the controller. | GDPR | “Processing” means any operation or set of operations that are performed on personal information or on sets of personal information, whether or not by automated means. | CCPA | personal data; processing; controller | ||||||||
332 | product manager | a specialized product management professional whose job is to manage the planning, development, launch, and success of products/solutions powered by AI, machine learning, and deep learning technologies. | productmanagerHQ_Josh_Fechter | |||||||||||
333 | product owner | [person who is] focused on providing direction and prioritization for the cross-functional AI team, ensuring everyone remains focused on the overall vision and road map. This role is responsible for unifying individuals with diverse skills and backgrounds toward a common goal. | Forbes_Tracy_Kemp | |||||||||||
334 | productization | [turning the best performing model] into an actual "data product," ready to be used in live services. | Towards_Productizing | |||||||||||
335 | profiling | ‘Profiling’ means any form of automated processing of personal data consisting of the use of personal data to evaluate certain personal aspects relating to a natural person, in particular to analyse or predict aspects concerning that natural person's performance at work, economic situation, health, personal preferences, interests, reliability, behaviour, location or movements. | GDPR | “Profiling” means any form of automated processing of personal information, as further defined by regulations pursuant to paragraph (16) of subdivision (a) of Section 1798.185, to evaluate certain personal aspects relating to a natural person and in particular to analyze or predict aspects concerning that natural person’s performance at work, economic situation, health, personal preferences, interests, reliability, behavior, location, or movements. | CCPA | Measuring the characteristics of expected activity so that changes to it can be more easily identified. | CSRC | personal data; processing | ||||||
336 | protected attribute | An attribute that partitions a population into groups whose outcomes should have parity. Examples include race, gender, caste, and religion. Protected attributes are not universal, but are application specific. | AI_Fairness_360 | |||||||||||
337 | protected class | [a feature] that may not be used as the basis for decisions [and] could be chosen because of legal mandates or because of organizational values. Some common protected [classes] include race, religion, national origin, gender, marital status, age, and socioeconomic status. | MIT_Protected_Attributes | A group of people with a common characteristic who are legally protected from [...] discrimination on the basis of that characteristic. Protected classes are created by both federal and state law. | Practical_Law_protected_class | |||||||||
338 | prototype | A prototype is an original model constructed to include all the technical characteristics and performances of the new product. | OECD | |||||||||||
339 | provisioning | The granting of access rights and executional privilege to an agent (human or machine) within an application(s) or system(s). | IEEE_Guide_IPA | |||||||||||
340 | proxy | A variable that can stand in for another, usually not directly observable or measurable, variable. | SP1270 | |||||||||||
341 | pseudo-anonymization (pseudonymization) | ‘Pseudonymisation’ means the processing of personal data in such a manner that the personal data can no longer be attributed to a specific data subject without the use of additional information, provided that such additional information is kept separately and is subject to technical and organisational measures to ensure that the personal data are not attributed to an identified or identifiable natural person; | GDPR | “Pseudonymize” or “Pseudonymization” means the processing of personal information in a manner that renders the personal information no longer attributable to a specific consumer without the use of additional information, provided that the additional information is kept separately and is subject to technical and organizational measures to ensure that the personal information is not attributed to an identified or identifiable consumer. | CCPA | A data management technique to strip identifiers linking data to an individual. | NSCAI | personal data; processing | ||||||
342 | quality | The totality of features and characteristics of a product or service that bear on its ability to satisfy stated or implied needs. | OECD | <data> degree to which the characteristics of data satisfy stated and implied needs when used under specified conditions; <system> degree to which a set of inherent characteristics of an object fulfils requirements (an object can be a product, process or service) | ISO/IEC_TS_5723:2022(en) | |||||||||
343 | racialized | A socio-political process by which groups are ascribed a racial identity, whether or not members of the group self-identify as such | AAAS_AI_and_Bias_2022-09 | |||||||||||
344 | ranking | a type of machine learning that sorts data in a relevant order[; often used by companies] to optimize search and recommendations. | DEV_ranking | position, order, or standing within a group : RANK | Merriam-Webster_ranking | |||||||||
345 | recall | A metric for classification models; identifies the frequency with which a model correctly classifies the true positive items. | NSCAI | A metric for classification models that answers the following question: Out of all the possible positive labels, how many did the model correctly identify? That is: Recall = True Positive/( True Positive + false Negative) | aime_measurement_2022, citing Machine Learning Glossary by Google | |||||||||
346 | recognition | the automatic discovery of regularities in data through the use of computer algorithms and with the use of these regularities to take actions such as classifying the data into different categories. | Pattern_Recognition_and_Machine_Learning | a sense of awareness and familiarity experienced when one encounters people, events, or objects that have been encountered before or when one comes upon material that has been learned in the past. | APA_recognition | to transfer prior learning or past experience to current consciousness: that is, to retrieve and reproduce information; to remember. | APA_recall | |||||||
347 | recommendation system | A software tool and techniques that provide suggestion based on the customer's taste to discover new appropriate thing for them by filtering personalized information based on the user's preferences from a large volume of information | Das,_Debashis | A subclass of information filtering system that seek to predict ‘rating’ or ‘preference’ that a user would give to an item (such as music, books or movies) or social element (e.g. people or group) they had not yet considered, using a model built from the characteristics of an item (content based approaches) or the user’s social environment (collaborative filtering approaches) | Sharma,_Lalita | |||||||||
348 | rectification | An individual’s right to have personal data about them corrected or amended by a business or other organization if it is inaccurate. | IAPP_Privacy_Glossary | |||||||||||
349 | red-team | A group of people authorized and organized to emulate a potential adversary’s attack or exploitation capabilities against an enterprise’s security posture. The Red Team’s objective is to improve enterprise cybersecurity by demonstrating the impacts of successful attacks and by demonstrating what works for the defenders (i.e., the Blue Team) in an operational environment. Also known as Cyber Red Team. | CSRC | |||||||||||
350 | reference class | A class which is intended to describe structure and behavior of object identifiers. Its instances, called references, are passed by-value and indirectly represent objects by substituting for some primitive reference. | IGI_Global_reference_class | |||||||||||
351 | reflexivity | A form of critical thinking that prompts us to consider the ‘whys’ and ‘hows’ of research, critically questioning the utility, ethics, and value of what, whom, and how we study | Jamieson_Govaart_Pownall | in qualitative research, the self-referential quality of a study in which the researcher reflects on the assumptions behind the study and especially the influence of his or her own motives, history, and biases on its conduct. | APA_reflexivity | positionality | ||||||||
352 | regression | Regression is a process of predicting the value to a yes or no label provided it falls on a continuous spectrum of input values, subcategory of supervised learning. | Ranschaert,_Erik | the prediction of an exact value using a given set of data | Saleh_Alkhalifa_ML_in_Biotech | |||||||||
353 | reinforcement learning | A method of training algorithms to make suitable actions by maximizing rewarded behavior over the course of its actions. This type of learning can take place in simulated environments, such as game-playing, which reduces the need for real-world data. | NSCAI | Reinforcement learning (RL) is a subset of machine learning that allows an artificial system (sometimes referred to as an agent) in a given environment to optimize its behaviour. Agents learn from feedback signals received as a result of their actions, such as rewards or punishments, with the aim of maximizing the received reward. Such signals are computed based on a given reward function, which constitutes an abstract representation of the system's goal. The goal could be, for example, to earn a high video game score or to minimize idle worker time in a factory | TTC6_Taxonomy_Terminology | |||||||||
354 | reliability | Reliability refers to the closeness of the initial estimated value(s) to the subsequent estimated values. | OECD | ability of an item to perform as required, without failure, for a given time interval, under given conditions. Note 1 to <system> definition: The time interval duration can be expressed in units appropriate to the item concerned (e.g. calendar time, operating cycles, distance run, etc.) and the units should always be clearly stated. Note 2 to <system> definition: Given conditions include aspects that affect reliability, such as: mode of operation, stress levels, environmental conditions, and maintenance. | ISO/IEC_TS_5723:2022(en) | property of consistent intended behaviour and results | aime_measurement_2022, citing ISO/IEC 22989 | |||||||
355 | remediation | The process of treating data by cleaning, organizing, and migrating it to a safe and secure environment for optimized usage is called data remediation. Generally [understood] as a process involving deleting unnecessary or unused data. However, the actual process . . . is very detailed and includes several steps, including replacing, updating, or modifying data along with cleaning it, organizing it, and getting rid of unnecessary data. | CPO_Magazine_Amar_Kanagaraj | |||||||||||
356 | reproducibility | Closeness of the agreement between the results of measurements of the same measurand carried out under changed conditions of measurement. | IEEE_Soft_Vocab | |||||||||||
357 | requirement | something essential to the existence or occurrence of something else : CONDITION | Merriam-Webster_requirement | |||||||||||
358 | residual | Residuals are differences between the one-step-predicted output from the model and the measured output from the validation data set. Thus, residuals represent the portion of the validation data not explained by the model. | MathWorks_Residual | |||||||||||
359 | resilience | The ability to prepare for and adapt to changing conditions and withstand and recover rapidly from disruptions. Resilience includes the ability to withstand and recover from deliberate attacks, accidents, or naturally occurring threats or incidents. The ability of a system to adapt to and recover from adverse conditions. | NISTIR_8269_Draft | <governance> ability to anticipate and adapt to, resist, or quickly recover from a potentially disruptive event, whether natural or man-made; <system> capability of a system to maintain its functions and structure in the face of internal and external change, and to degrade gracefully when this is necessary | ISO/IEC_TS_5723:2022(en) | ability of a system to recover operational condition quickly following an incident | aime_measurement_2022, citing ISO/IEC 22989 | |||||||
360 | responsible AI | An AI system that aligns development and behavior to goals and values. This includes developing and fielding AI technology in a manner that is consistent with democratic values. | NSCAI | |||||||||||
361 | result | The consequential outcome of completing a process. | IEEE_Guide_IPA | |||||||||||
362 | retention limit | refers to the amount of information that is stored long-term, and can be measured in volume (the size of the total collected logs in bytes) and time (the number of months or years that logs are stored for). | Industrial_Network_Security_2011 | |||||||||||
363 | risk | The composite measure of an event’s probability of occurring and the magnitude or degree of the consequences of the corresponding event. The impacts, or consequences, of AI systems can be positive, negative, or both and can result in opportunities or threats (Adapted from: iso 31000:2018 ) | NIST_AI_RMF_1.0 | A measure of the extent to which an entity is threatened by a potential circumstance or event, and typically a function of: (i) the adverse impacts that would arise if the circumstance or event occurs; and (ii) the likelihood of occurrence. | SP800-12 | An uncertain event or condition that, if it occurs, has a positive or negative effect on a project's objectives | IEEE_Soft_Vocab | effect of uncertainty on objectives | ISO_IEC_38507 | |||||
364 | risk control | mechanisms at the design, implementation, and evaluation stages [that can be taken] into consideration when developing responsible AI for organizations that includes security risks (cyber intrusion risks, privacy risks, and open source software risk), economic risks (e.g., job displacement risks), and performance risks (e.g., risk of errors and bias and risk of black box, and risk of explainability). | Toward_an_understanding_of_responsible_artificial_intelligence_practices | |||||||||||
365 | risk tolerance | Risk tolerance refers to the organization’s or AI actor’s ... readiness to bear the risk in order to achieve its objectives. Risk tolerance can be influenced by legal or regulatory requirements. | NIST_AI_RMF_1.0 | |||||||||||
366 | robotic desktop automation (RDA) | The computer application that makes available to a human operator a suite of predefined activity choreography to complete the execution of processes, activities, transactions, and tasks in one or more unrelated software systems to deliver a result or service in the course of human-initiated or -managed workflow. | IEEE_Guide_IPA | |||||||||||
367 | robotic process automation (RPA) | A preconfigured software instance that uses business rules and predefined activity choreography to complete the autonomous execution of a combination of processes, activities, transactions, and tasks in one or more unrelated software systems to deliver a result or service with human exception management. | IEEE_Guide_IPA | Software to help in the automation of tasks, especially those that are tedious and repetitive. | NSCAI | |||||||||
368 | robust AI | An AI system that is resilient in real-world settings, such as an object-recognition application that is robust to significant changes in lighting. The phrase also refers to resilience when it comes to adversarial attacks on AI components. | NSCAI | |||||||||||
369 | robustness | ability of a system to maintain its level of performance under a variety of circumstances | ISO/IEC_TS_5723:2022(en) | The ability of a machine learning model/algorithm to maintain correct and reliable performance under different conditions (e.g., unseen, noisy, or adversarially manipulated data). | NISTIR_8269_Draft | |||||||||
370 | root-mean-square deviation (RMSD) | of an estimator of a parameter[; ...] the square-root of the mean squared error (MSE) of the estimator. In symbols, if X is an estimator of the parameter t, then RMSE(X) = ( E( (X−t)2 ) )½. The RMSE of an estimator is a measure of the expected error of the estimator. The units of RMSE are the same as the units of the estimator. | Glossary_of_Statistical_Terms | a frequently used measure of the differences between values (sample or population values) predicted by a model or an estimator and the values observed | Wikipedia_RMSD | root-mean-square error (RMSE) | ||||||||
371 | row | describes a single entity or observation and the columns describe properties about that entity or observation. The more rows you have, the more examples from the problem domain that you have. | Machine_Learning_Mastery_Jason_Brownlee | |||||||||||
372 | safety | property of a system such that it does not, under defined conditions, lead to a state in which human life, health, property, or the environment is endangered; [safety involves reducing both the probability of expected harms and the possibility of unexpected harms]. | ISO/IEC_TS_5723:2022(en) | freedom from risk which is not tolerable | aime_measurement_2022, citinig ISO/IEC TR 24029-1 | |||||||||
373 | scalability | The ability to increase or decrease the computational resources required to execute a varying volume of tasks, processes, or services. | IEEE_Guide_IPA | |||||||||||
374 | score | A continuous value output from a classifier. Applying a threshold to a score results in a predicted label. | AI_Fairness_360 | |||||||||||
375 | screen out | Screen-out discrimination occurs when “a disability prevents a job applicant or employee from meeting—or lowers their performance on—a selection criterion, and the applicant or employee loses a job opportunity as a result.” | EEOC_ADA_AI | |||||||||||
376 | security | resistance to intentional, unauthorized act(s) designed to cause harm or damage to a system | ISO/IEC_TS_5723:2022(en) | degree to which a product or system (3.38) protects information (3.20) and data (3.11) so that persons or other products or systems have the degree of data access appropriate to their types and levels of authorization | aime_measurement_2022, citing ISO/IEC TR 24029-1 | |||||||||
377 | segmentation | The process of identifying homogeneous subgroups within a data table. | Raynor | |||||||||||
378 | self-aware system | A computing platform imbued with sufficient knowledge and analytic capability to make useful conclusions about its inputs, its own processing, and the use of its output so that it is capable of self- judgment and improvement consistent with its purpose. | IEEE_Guide_IPA | |||||||||||
379 | self-diagnosis | Ability of a system to adequately take measurement information from sensors, validate the data, and communicate the processes and results to other devices | SP1011 | |||||||||||
380 | self-healing system | A computing system able to perceive that it is not operating correctly and, without human intervention, make the necessary adjustments to restore itself to normalcy. | IEEE_Guide_IPA | |||||||||||
381 | semantic mapping | A strategic schema or framework of metadata labels applied to all data, data groups, data fields, data types, or data content used to introduce new or raw data into a corpus or data fabric to give machine learning algorithms direction for investigating known or potential relationships between data. A semantic map provides a structure for the introduction of new data, information, or knowledge | IEEE_Guide_IPA | |||||||||||
382 | sensitivity analysis | A “what-if” type of analysis to determine the sensitivity of the outcomes to changes in parameters. If a small change in a parameter results in relatively large changes in the outcomes, the outcomes are said to be sensitive to that parameter. | OECD | |||||||||||
383 | sensory digitization | The conversion of typically analog or human sensory perception (e.g., vision, speech) to a digital format useful for machine-to-human interaction or machine processing of traditionally analog sensory information [e.g., optical character recognition (OCR)]. | IEEE_Guide_IPA | |||||||||||
384 | service | A collection of coordinated processes that takes one or more kinds of input, performs a value-added transformation, and creates an output that fulfills the needs of a customer [or shareholder]. | IEEE_Guide_IPA | |||||||||||
385 | signal detection theory | a framework for interpreting data from experiments in which accuracy is measured. | Signal_Detection_Theory | |||||||||||
386 | shallow learning | Techniques that separate the process of feature extraction from learning itself. | Reznik,_Leon | |||||||||||
387 | situational awareness | Perception of elements in the system and/or environment and a comprehension of their meaning, which could include a projection of the future status of perceived elements and the uncertainty associated with that status. | SP800-160 | |||||||||||
388 | socio-technical system | how humans interact with technology within the broader societal context | NIST SP1270 | system that includes a combination of technical and human or natural elements | ISO/IEC_TS_5723:2022(en) | |||||||||
389 | software testing | Activity in which a system or component is executed under specified conditions, the results are observed or recorded, and an evaluation is made of some aspect of the system or component. | IEEE_Soft_Vocab | |||||||||||
390 | sparsity | refers to a matrix of numbers that includes many zeros or values that will not significantly impact a calculation. | Dave_Salvator_sparsity | |||||||||||
391 | specification | A document that specifies, in a complete, precise, verifiable manner, the requirements, design, behavior, or other characteristics of a system or component and often the procedures for determining whether these provisions have been satisfied. | SP800-37 | |||||||||||
392 | stakeholder | Individual or organization having a right, share, claim, or interest in a system or in its possession of characteristics that meet their needs and expectations. An individual, group, or organization who may affect, be affected by, or perceive itself to be affected by a decision, activity, or outcome of a project. | IEEE_Soft_Vocab | any individual, group, or organization that can affect, be affected by, or perceive itself to be affected by a decision or activity | ISO/IEC_TS_5723:2022(en) | |||||||||
393 | standard deviation | The most widely used measure of dispersion of a frequency distribution introduced by K. Pearson (1893). It is equal to the positive square root of the variance. The standard deviation should not be confused with the root mean square deviation. | OECD | |||||||||||
394 | start event | An activity, task, or input that describes or defines the beginning of a process. | IEEE_Guide_IPA | |||||||||||
395 | statistical bias | A systematic tendency for estimates or measurements to be above or below their true values. Statistical biases arise from systematic as opposed to random error. Statistical bias can occur in the absence of prejudice, partiality, or discriminatory intent. | SP1270 | |||||||||||
396 | statistical parity | The independence between the protected attribute and the outcome of the decision rule | Besse,_Philippe | |||||||||||
397 | statistical significance | When the probability of obtaining a statistic of a given size due strictly to random sampling error, or chance, is less than the selected alpha level [or the probability of a type I error]; also represents a rejection of the null hypothesis. | Statistics_in_Plain_English | refers to whether a relationship between two or more variables exists beyond a probability expected by chance | The_SAGE_Encyclopedia_of_Communication_Research_Methods | |||||||||
398 | statistics | Numerical data relating to an aggregate of individuals; the science of collecting, analysing and interpreting such data | OECD | |||||||||||
399 | stereotype | a set of cognitive generalizations (e.g., beliefs, expectations) about the qualities and characteristics of the members of a group or social category. Stereotypes, like schemas, simplify and expedite perceptions and judgments, but they are often exaggerated, negative rather than positive, and resistant to revision even when perceivers encounter individuals with qualities that are not congruent with the stereotype. | APA_stereotype | Contemporary social psychology typically defines stereotypes as mental representations of a group and its members, and stereotyping as the cognitive activity of treating individual elements in terms of higher level categorial properties | Augoustinos_Walker_1998 | |||||||||
400 | stochastic | The adjective “stochastic” implies the presence of a random variable; e.g. stochastic variation is variation in which at least one of the elements is a variate and a stochastic process is one wherein the system incorporates an element of randomness as opposed to a deterministic system. | OECD | |||||||||||
401 | straight-through processing (STP) | The successful execution of a service, process, or transaction performed entirely through traditional application platforms with predefined interfaces (i.e., application programming interfaces [APIs]). | IEEE_Guide_IPA | |||||||||||
402 | strawperson | a fallacious argument which irrelevantly attacks a position that appears similar to, but is actually different from, an opponent's position, and concludes that the opponent's real position has thereby been refuted. | Hughes_Lavery_Critical_Thinking | |||||||||||
403 | stress test | Type of performance efficiency testing conducted to evaluate a test item's behavior under conditions of loading above anticipated or specified capacity requirements, or of resource availability below minimum specified requirements | IEEE_Soft_Vocab | |||||||||||
404 | structured data | Data that has a predefined data model or is organized in a predefined way. | NIST_1500 | |||||||||||
405 | sub-process | A subordinate process that can be included within a parent process. It can be present and/or repeated within other parent processes. | IEEE_Guide_IPA | |||||||||||
406 | supervised learning | A type of machine learning in which the algorithm compares its outputs with the correct outputs during training. In unsupervised learning, the algorithm merely looks for patterns in a set of data. | Hutson,_Matthew | Algorithms, which develop a mathematical model from the input data and known desired outputs. | Reznik,_Leon | For a computer to process a set of data whose attributes have been divided into two groups and derive a relationship between the values of one and the values of the other. These two groups are sometimes called predictor and targets, respectively. In statistical terminology, they are called independent and dependent variables. Respectively. The learning Is "supervised because the distinction between the predictors and the target variables is chosen by the investigator or some other outside agency. | Raynor | a general subset of machine learning in which data, like its associated labels, is used to train models that can learn or generalize from the data to make predictions, preferably with a high degree of certainty. | Saleh_Alkhalifa_ML_in_Biotech | |||||
407 | support vector machines | A supervised machine learning model for data classification and regression analysis. One of the most used classifiers in machine learning. It optimizes the width of the gap between the points of separate categories in feature space. | Ranschaert,_Erik | |||||||||||
408 | system | combination of interacting elements organized to achieve one or more stated purposes | ISO/IEC_TS_5723:2022(en) | |||||||||||
409 | systemic bias | Systemic biases result from procedures and practices of particular institutions that operate in ways which result in certain social groups being advantaged or favored and others being disadvantaged or devalued. This need not be the result of any conscious prejudice or discrimination but rather of the majority following existing rules or norms. | D. Chandler and R. Munday, A Dictionary of Media and Communication. Oxford University Press, Jan. 2011, publication Title: A Dictionary of Media and Communication | |||||||||||
410 | system of systems | set of systems and system elements that interact to provide a unique capability that none of the constituent systems can accomplish on its own (note: can be necessary to facilitate interaction of the constituent systems in the system of systems) | ISO/IEC_TS_5723:2022(en) | |||||||||||
411 | target | a method for solving a problem that an AI algorithm parses its training data to find. Once an algorithm finds its target function, that function can be used to predict results (predictive analysis). The function can then be used to find output data related to inputs for real problems where, unlike training sets, outputs are not included. | TechTarget_target_function | target variable, target value | ||||||||||
412 | task | The performance of a discrete activity with a defined start, stop, and outcome that cannot be broken down to a finer level of detail. | IEEE_Guide_IPA | Required, recommended, or permissible action, intended to contribute to the achievement of one or more outcomes of a process | IEEE_Soft_Vocab | set of activities undertaken in order to achieve a specific goal | aime_measurement_2022, citing ISO/IEC TR 24030 | |||||||
413 | taxonomy | Taxonomy refers to classification according to presumed natural relationships among types and their subtypes. | OECD | |||||||||||
414 | technical control | Security controls (i.e., safeguards or countermeasures) for an information system that are primarily implemented and executed by the information system through mechanisms contained in the hardware, software, or firmware components of the system. | NIST_SP_800-30_Rev_1 | |||||||||||
415 | technochauvinism | The belief that technology is always the solution | M. Broussard, Artificial Unintelligence: How Computers Misunderstand the World. MIT Press, 2018. | techno-solutionism | ||||||||||
416 | test | Technical operation to determine one or more characteristics of or to evaluate the performance of a given product, material, equipment, organism, physical phenomenon, process or service according to a specified procedure. | UNODC_Glossary_QA_GLP | any activity aimed at evaluating an attribute or capability of a program or system and deteermining that it meets its required results. | William_Hetzel | (1) activity in which a system or component is executed under specified conditions, the results are observed or recorded, and an evaluation is made of some aspect of the system or component; (2) to conduct an activity as in (1); (3) set of one or more test cases and procedures. | aime_measurement_2022, citing ISO/IEC 24765 | the process of executing a program with the intent of finding errors. | The_Art_of_Software_Testing | Test, Evaluation, Verification and Validation (TEVV) | ||||
417 | Test and Evaluation, Verification and Validation (TEVV) | A framework for assessing, incorporating methods and metrics to determine that a technology or system satisfactorily meets its design specifications and requirements, and that it is sufficient for its intended use. | NSCAI_Report | |||||||||||
418 | third party | an entity that is involved in some way in an interaction that is primarily between two other entities. [Please see note, especially regarding NIST CSRC terms that we might incorporate into this definition.] | TechTarget_third_party | |||||||||||
419 | three lines of defense | Most financial institutions follow a three-lines-of-defense model, which separates front line groups, which are generally accountable for business risks (the First Line), from other risk oversight and independent challenge groups (the Second Line) and assurance (the Third Line) | AIRS_Penn | |||||||||||
420 | traceability | Ability to trace the history, application or location of an entity by means of recorded identification. ["Chain of custody" is a related term.] Alternatively, traceability is a property of the result of a measurement or the value of a standard whereby it can be related with a stated uncertainty, to stated references, usually national or international standards, i.e. through an unbroken chain of comparisons. In this context, The standards referred to here are measurement standards rather than written standards. | UNODC_Glossary_QA_GLP | A characteristic of an AI system enabling a person to understand the technology, development processes, and operational capabilities (e.g., with transparent and auditable methodologies along with documented data sources and design procedures). | NSCAI | |||||||||
421 | training data | A dataset from which a model is learned. | AI_Fairness_360 | samples for training used to fit a machine learning model | aime_measurement_2022, citing ISO/IEC 22989 | |||||||||
422 | transaction | Enactment of a process represented by a set of coordinated activities carried out by multiple systems and/or participants in accordance with defined relationships. This coordination leads to an intentional, consistent, and verifiable result across all participants. | IEEE_Guide_IPA | |||||||||||
423 | transfer learning | A technique in machine learning in which an algorithm learns to perform one task, such as recognizing cars, and builds on that knowledge when learning a different but related task, such as recognizing cats. | Hutson,_Matthew | |||||||||||
424 | transformer | A procedure that modifies a dataset. | AI_Fairness_360 | |||||||||||
425 | transparency | <information> open, comprehensive, accessible, clear and understandable presentation of information; <systems> property of a system or process to imply openness and accountability | ISO/IEC_TS_5723:2022(en) | Understanding the working logic of the model. | NISTIR_8269_Draft | <organization> property of an organization that appropriate activities and decisions are communicated to relevant stakeholders (3.5.13) in a comprehensive, accessible and understandable manner Note 1 to entry: Inappropriate communication of activities and decisions can violate security, privacy or confidentiality requirements. | iso_22989_2022 | <system> property of a system that appropriate information about the system is made available to relevant stakeholders (3.5.13) Note 1 to entry: Appropriate information for system transparency can include aspects such as features, performance, limitations, components, procedures, measures, design goals, design choices and assumptions, data sources and labelling protocols. Note 2 to entry: Inappropriate disclosure of some aspects of a system can violate security, privacy or confidentiality requirements. | iso_22989_2022 | |||||
426 | true negative | outcome where the model correctly predicts the negative class. | google_dev_classification-true-false-positive-negative | |||||||||||
427 | true positive | an outcome where the model correctly predicts the positive class. | google_dev_classification-true-false-positive-negative | |||||||||||
428 | trust | the system status in the mind of human beings based on their perception of and experience with the system; concerns the attitude that a person or technology will help achieve specific goals in a situation characterized by uncertainty and vulnerability. | DOD_TEVV | degree to which a user or other stakeholder has confidence that a product or system will behave as intended | aime_measurement_2022, citing ISO/IEC TR 24029-1 | |||||||||
429 | trustworthiness | The degree to which an information system (including the information technology components that are used to build the system) can be expected to preserve the confidentiality, integrity, and availability of the information being processed, stored, or transmitted by the system across the full range of threats and individuals’ privacy. | SP800-37 | Worthy of being trusted to fulfill whatever critical requirements may be needed for a particular component, subsystem, system, network, application, mission, enterprise, or other entity. | SP800-160 | ability to meet stakeholders' expectations in a verifiable way; an attribute that can be applied to services, products, technology, data and information as well as to organizations. | ISO/IEC_TS_5723:2022(en) | |||||||
430 | trustworthy AI | Characteristics of trustworthy AI systems include: valid and reliable, safe, secure and resilient, accountable and transparent, explainable and interpretable, privacy-enhanced, and fair with harmful bias managed. | NIST_AI_RMF_1.0 | Trustworthy AI has three components: (1) it should be lawful, ensuring compliance with all applicable laws and regulations (2) it should be ethical, demonstrating respect for, and ensure adherence to, ethical principles and values and (3) it should be robust, both from a technical and social perspective, since, even with good intentions, AI systems can cause unintentional harm. Trustworthy AI concerns not only the trustworthiness of the AI system itself but also comprises the trustworthiness of all processes and actors that are part of the system’s life cycle. | european_ethics_2019 | Trustworthy AI has three components: (1) it should be lawful, ensuring compliance with all applicable laws and regulations (2) it should be ethical, demonstrating respect for, and ensure adherence to, ethical principles and values and (3) it should be robust, both from a technical and social perspective, since, even with good intentions, AI systems can cause unintentional harm. Characteristics of Trustworthy AI systems include: valid and reliable, safe, secure and resilient, accountable and transparent, explainable and interpretable, privacy-enhanced, and fair with harmful bias managed. Trustworthy AI concerns not only the trustworthiness of the AI system itself but also comprises the trustworthiness of all processes and actors that are part of the AI system’s life cycle. Trustworthy AI is based on respect for human rights and democratic values. | TTC6_Taxonomy_Terminology | |||||||
431 | type I error | The null hypothesis H0 is rejected, even though it is [true] | berthold_guide_2020 | false positive rate | james_statistical_2014 | |||||||||
432 | type II error | The null hypothesis H0 is accepted, even though it is [false] | berthold_guide_2020 | true positive rate | james_statistical_2014 | |||||||||
433 | uncertainty | Result of not having accurate or sufficient knowledge of a situation; state, even partial, of deficiency of information related to understanding or knowledge of an event, its consequence, or likelihood | IEEE_Soft_Vocab | |||||||||||
434 | underfitting | Underfitting occurs when a statistical model cannot adequately capture the underlying structure of the data. | Ranschaert,_Erik | |||||||||||
435 | underrepresentation | inadequately represented. (See note.) | Merriam-Webster_underrepresented | when members of discernible groups are not consistently present in representative bodies and among measures of well-being in numbers roughly proportionate to their numbers within the population. | Encyclopedia.com_underrepresentation | |||||||||
436 | unexplainable | impossibility of providing an explanation for certain decisions made by an intelligent system which is both 100% accurate and comprehensible. | Roman_V._Yampolskiy_Unexplainability | black box; opacity | ||||||||||
437 | unstructured data | Data that does not have a predefined data model or is not organized in a predefined way | ||||||||||||
438 | unsupervised learning | A learning strategy that consists in observing and analyzing different entities and determining that some of their subsets can be grouped into certain classes, without any correctness test being performed on acquired knowledge through feedback from external knowledge sources. Note 1 to entry: Once a concept is formed, it is given a name that may be used in subsequent learning of other concepts. | iso_2382_1997 | |||||||||||
439 | usability | extent to which a system product or service can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use (note 1: The “specified” users, goals and context of use refer to the particular combination of users, goals and context of use for which usability is being considered; note 2: used as a qualifier to refer to the design knowledge, competencies, activities and design attributes that contribute to usability, such as usability expertise, usability professional, usability engineering, usability method, usability evaluation, usability heuristic). [See also: ISO/IEC 9241-11 Ergonomic of Human-System Interaction — Part 11: Usability: Definitions and Concepts. ISO, Geneva, Switzerland, 2018, https://www.iso.org/standard/63500.html.] | ISO/IEC_TS_5723:2022(en) | |||||||||||
440 | usability testing | refers to evaluating a product or service by testing it with representative users. Typically, during a test, participants will try to complete typical tasks while observers watch, listen and takes notes. The goal is to identify any usability problems, collect qualitative and quantitative data and determine the participant's satisfaction with the product. | Usabilitygov | |||||||||||
441 | user | individual or group that interacts with a system or benefits from a system during its utilization | IEEE_Soft_Vocab | A person, organization, or other entity which requests access to and uses the resources of a computer system or network. | CSRC | |||||||||
442 | user-centered design | the practice of the following principles, the active involvement of users for a clear understanding of user and task requirements, iterative design and evaluation, and a multi-disciplinary approach | Vredenburg,_Karel | Approach to system design and development that aims to make interactive systems more usable by focusing on the use of the system; applying human factors, ergonomics and usability knowledge and techniques. | IEEE_Soft_Vocab | |||||||||
443 | validation | Confirmation by examination and provision of objective evidence that the particular requirements for a specific intended use are fulfilled. | UNODC_Glossary_QA_GLP | Confirmation, through the provision of objective evidence, that the requirements for a specific intended use or application have been fulfilled. | IEEE_Soft_Vocab | provides objective evidence that the capability provided by the system complies with stakeholder performance requirements, achieving its use in its intended operational environment; answers the question, "Is it the right solution to the problem?" [C]onsists of evaluating the operational effectiveness, operational suitability, sustainability, and survivability of the system or system elements under operationally realistic conditions. | DOD_TEVV | A continuous monitoring of the process of compilation and of the results of this process. | OECD | Test and Evaluation, Verification, and Validation (TEVV) | ||||
444 | value sensitive design | a theoretically grounded approach to the design of technology that accounts for human values in a principled and systematic manner throughout the design process. | Friedman_et_al_2017 | |||||||||||
445 | variable | A variable is a characteristic of a unit being observed that may assume more than one of a set of values to which a numerical measure or a category from a classification can be assigned. | OECD | Quantity or data item whose value can change | IEEE_Soft_Vocab | |||||||||
446 | variance | The variance is the mean square deviation of the variable around the average value. It reflects the dispersion of the empirical values around its mean. | OECD | A quantifiable deviation, departure, or divergence away from a known baseline or expected value | IEEE_Soft_Vocab | |||||||||
447 | verifiable | can be checked for correctness by a person or tool | ISO/IEC_TS_5723:2022(en) | provides evidence that the system or system element performs its intended functions and meets all performance requirements listed in the system performance specification and functional and allocated baselines; answers the question, "Did you build the system correctly?" | DOD_TEVV | Test and Evaluation, Verification and Validation (TEVV) | ||||||||
448 | word embedding | a popular framework to represent text data as vectors which has been used in many machine learning and natural language processing tasks. . . . A word embedding, trained on word co-occurrence in text corpora, represents each word (or common phrase) w as a d-dimensional word vector w~ 2 Rd. It serves as a dictionary of sorts for computer programs that would like to use word meaning. First, words with similar semantic meanings tend to have vectors that are close together. Second, the vector differences between words in embeddings have been shown to represent relationships between words. | Bolukbasi_et_al_Debiasing_Word_Embeddings |
1 | ID | Title of article, chapter, or page | Author(s) and/or Editor(s) | Publication or website (either the main domain or major subdomain) | Volume | Issue | Page(s) | Year | URL | |
|---|---|---|---|---|---|---|---|---|---|---|
2 | GDPR | Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation) | https://eur-lex.europa.eu/eli/reg/2016/679/oj | |||||||
3 | CCPA | California Consumer Privacy Act of 2018 | https://leginfo.legislature.ca.gov/faces/codes_displayText.xhtml?division=3.&part=4.&lawCode=CIV&title=1.81.5 | |||||||
4 | AI_Incident_Database | What is an AI incident? | AI Incident Database | AI Incident Database | 2022 | https://incidentdatabase.ai/research/1-criteria | ||||
5 | Shubendhu_and_Vijay | Applicability of Artificial Intelligence in Different Fields of Life | Shubhendu, Shukla S. and Jaiswal Vijay | International Journal of Scientific Engineering and Research (IJSER) | 1 | 1 | 28-35 | 2013 | https://www.ijser.in/archives/v1i1/MDExMzA5MTU=.pdf | |
6 | Raynor | Glossary of Computer System Software Development Terminology | Raynor, William J., Jr. | The International Dictionary of Artificial Intelligence | 1999 | https://archive.org/details/internationaldic0000rayn | ||||
7 | AI_Fairness_360 | Glossary | AI Fairness 360 | AI Fairness 360 | https://aif360.mybluemix.net/resources#glossary | |||||
8 | Mitchell,_Tom | Machine Learning | Mitchell, Tom | Machine Learning | 1997 | http://www.cs.cmu.edu/~tom/mlbook.html | ||||
9 | Brookings_Institution | The Brookings glossary of AI and emerging technologies | Allen, John R. and Darrell M. West | Brookings Institution | 2021 | https://www.brookings.edu/blog/techtank/2020/07/13/the-brookings-glossary-of-ai-and-emerging-technologies/ | ||||
10 | Brownlee,_Jason | A Gentle Introduction to Generative Adversarial Networks (GANs) | Brownlee, Jason | Machine Learning Mastery | 2019 | https://machinelearningmastery.com/what-are-generative-adversarial-networks-gans/ | ||||
11 | Pyle_and_San_José | An executive’s guide to machine learning | Pyle, Dorian and Cristina San José | McKinsey Quarterly | 2015 | https://www.mckinsey.com/industries/technology-media-and-telecommunications/our-insights/an-executives-guide-to-machine-learning | ||||
12 | Hutson,_Matthew | AI Glossary: Artificial intelligence, in so many words | Hutson, Matthew | Science | 357 | 6346 | 19 | 2017 | https://www.science.org/doi/10.1126/science.357.6346.19 | |
13 | FBPML_Wiki | Definitions | Foundation for Best Practices in Machine Learning | FBPML Wiki | https://wiki.fbpml.org/wiki/Definitions | |||||
14 | IAPP_Privacy_Glossary | Glossary of Privacy Terms | https://iapp.org/resources/glossary/ | |||||||
15 | IAPP_Governance_Terms | Glossary of Governance Terms | ||||||||
16 | Reznik,_Leon | Introduction I.5 Glossary of Basic Terms | Reznik, Leon | Intelligent Security Systems: How Artificial Intelligence, Machine Learning and Data Science Work for and Against Computer Security | xv-xxiv | 2022 | ||||
17 | IEEE_Guide_IPA | IEEE Guide for Terms and Concepts in Intelligent Process Automation | IEEE Standards Association | IEEE Guide for Terms and Concepts in Intelligent Process Automation | ||||||
18 | Russell_and_Norvig | Stuart Russell and Peter Norvig | Artificial Intelligence: A Modern Approach (Fourth Edition) | 2021 | ||||||
19 | SP1270 | Towards a Standard for Identifying and Managing Bias in Artificial Intelligence | Schwartz, Reva; Apostol Vassilev; Kristen Greene; Lori Perine; Andrew Burt; Patrick Hall | NIST Special Publication 1270 | https://nvlpubs.nist.gov/nistpubs/SpecialPublications/NIST.SP.1270.pdf | |||||
20 | SP1011 | Autonomy Levels for Unmanned Systems (ALFUS) Framework | Autonomy Levels for Unmanned Systems Working Group Participants | NIST Special Publication 1011 | 2008 | https://www.nist.gov/system/files/documents/el/isd/ks/NISTSP_1011-I-2-0.pdf | ||||
21 | Gartner | Gartner Glossary | Gartner Group | https://www.gartner.com/en/glossary/all-terms | ||||||
22 | Varshney,_Kush | Trustworthy Machine Learning | Varshney, Kush R. | |||||||
23 | Munir,_Arslan | Artificial Intelligence and Data Fusion at the Edge | Munir, Arslan, Erik Blasch, Jisu Kwon, Joonho Kong, and Alexander Aved | IEEE A&E SYSTEMS MAGAZINE | 36 | 7 | 62-78 | 2021 | https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9475883 | |
24 | Wallace,_Brian | Introduction to Artificial Intelligence for Security Professionals | Wallace, Brian; Sepehr Akhavan-Masouleh; Andrew Davis; Mike Wojnowicz; John H. Brock | 2017 | http://book.itep.ru/depository/AI/IntroductionToArtificialIntelligenceForSecurityProfessionals_Cylance.pdf | |||||
25 | NSCAI | National Security Commission on Artificial Intelligence: The Final Report | National Security Commission on Artificial Intelligence | National Security Commission on Artificial Intelligence Final Report | 2021 | https://www.nscai.gov/2021-final-report/ | ||||
26 | OECD | Glossary of Statistical Terms | Organisation for Economic Co-operation and Development | 2007 | https://ec.europa.eu/eurostat/ramon/coded_files/OECD_glossary_stat_terms.pdf / https://stats.oecd.org/glossary/ | |||||
27 | OECD_CAI_recommendation | Recommendation of the Council on Artificial Intelligence | OECD | OECD Legal Instruments | 2019 | https://legalinstruments.oecd.org/en/instruments/oecd-legal-0449 | ||||
28 | NISTIR_8269_Draft | A Taxonomy and Terminology of Adversarial Machine Learning | Tabassi, Elham;Kevin J. Burns; Michael Hadjimichael; Andres D. Molina-Markham; Julian T. Sexton | Draft NISTIR 8269 | 2019 | https://nvlpubs.nist.gov/nistpubs/ir/2019/NIST.IR.8269-draft.pdf | ||||
29 | SP800-37 | Risk Management Framework for Information Systems and Organizations: A System Life Cycle Approach for Security and Privacy | Joint Task Force Interagency Working Group | NIST Special Publication 800-37 Revision 2 | 2 (revision 2) | 2018 | https://nvlpubs.nist.gov/nistpubs/SpecialPublications/NIST.SP.800-37r2.pdf | |||
30 | IEEE_Soft_Vocab | Systems and software engineering —Vocabulary | ISO/IEC/IEEE 24765 | 2017 | https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8016712 | |||||
31 | Kohavi,_Ron | Glossary of Terms: Special Issue on Applications of Machine Learning and the Knowledge Discovery Process | Kohavi, Ron; Foster Provost | Machine Learning | 30 | 271-274 | 1998 | http://robotics.stanford.edu/~ronnyk/glossary.html | ||
32 | Mitchell,_Tom | Machine Learning | Mitchell, Tom M. | McGraw-Hill Science/Engineering/Math | 1997 | https://www.cin.ufpe.br/~cavmj/Machine%20-%20Learning%20-%20Tom%20Mitchell.pdf | ||||
33 | Cyber_Guide | Cyber Security Planning Guide | Federal Communications Commision | https://www.fcc.gov/sites/default/files/cyberplanner.pdf | ||||||
34 | CSRC | Information Technology Laboratory Computer Security Resource Center Glossary | NIST | https://csrc.nist.gov/glossary | ||||||
35 | AIMA | Artificial Inelligence: A Modern Approach | Russell, Stuart; Peter Norvig | Pearson | 2010 | https://zoo.cs.yale.edu/classes/cs470/materials/aima2010.pdf | ||||
36 | Breiman_Leo | Bagging Predictors | Breiman, Leo | Machine Learning | 24 | 123-140 | 1996 | https://link.springer.com/content/pdf/10.1007/BF00058655.pdf | ||
37 | NISTIR_8312 | Four Principles of Explainable Artificial 3 Intelligence | Phillips, P. Jonathon; Carina A. Hahn; Peter C. Fontana; David A. Broniatowski; Mark A. Przybocki | Draft NISTIR 8312 | 2020 | https://nvlpubs.nist.gov/nistpubs/ir/2020/NIST.IR.8312-draft.pdf | ||||
38 | SP800-12 | An Introductin to Information Security | Nieles, Michael; Kelley Dempsey; Victoria Yan Pillitteri | NIST SP 800-12 | 2017 | https://nvlpubs.nist.gov/nistpubs/SpecialPublications/NIST.SP.800-12r1.pdf | ||||
39 | Steinhardt,_Jacob | Certified Defenses for Data Poisoning Attacks | Steinhardt_Jacob; Pang Wei Koh; Percy Liang | 31st Conference on Neural Information Processing Systems | 2017 | https://proceedings.neurips.cc/paper/2017/file/9d7311ba459f9e45ed746755a32dcd11-Paper.pdf | ||||
40 | Ranschaert,_Erik | Artificial Intelligence in Medical Imaging: Opportunities, Applications and Risks | Ranschaert, Erik R.; Sergey Morozov; Paul R. Algra | Springer | 2019 | https://link.springer.com/content/pdf/10.1007/978-3-319-94878-2.pdf | ||||
41 | Blank,_Abagayle_Lee | Computer Vision Machine Learning and Future-Oriented Ethics | Blank, Abagayle Lee | Seattle Pacific University | https://digitalcommons.spu.edu/cgi/viewcontent.cgi?article=1100&context=honorsprojects | |||||
42 | Crawford,_Kate | The Trouble with Bias | Crawford, Kate | Neural Information Processing Systems, Long Beach | 2017 | https://www.youtube.com/watch?v=fMym_BKWQzk | ||||
43 | COE_AI_Glossary | Artificial Intelligence Glossary | Council of Europe | https://www.coe.int/en/web/artificial-intelligence/glossary | ||||||
44 | Kuehn,_Andreas | Analyzing Bug Bounty Programs: An Institutional Perspective on the Economics of Software Vulnerabilities | Kuehn, Andreas; Milton Mueller | 2014 TPRC Conference Paper | 2014 | https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2418812 | ||||
45 | Kang,_Daniel | Model Assertions for Monitoring and Improving ML Models | Kang, Daniel; Deepti Raghavan; Peter Baili; Matei Zaharia | 3rd MLSys Conference | 2020 | https://arxiv.org/pdf/2003.01668.pdf | ||||
46 | MathWorks_Residual | What Is Residual Analysis? | MathWorks | https://www.mathworks.com/help/ident/ug/what-is-residual-analysis.html | ||||||
47 | Nayak,_Pragati | Concept Drift and Model Decay Detection using Machine Learning Algorithm | Nayak, Pragati Aravind; Pavithra Sriganesh; Rakshitha K.M; Manoj Kumar M.V; Prashanth B S; Sneha H R | 12th International Conference on Computing Communication and Networking Technologies (ICCCNT) | 2021 | https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9580110 | ||||
48 | Hasan,_Raza | Artificial Intelligence Based Model for Incident Response | Hasan, Raza; Salman Mahmood; Akshyadeep Raghav; M. Asim Hasan | 2011 International Conference on Information Management, Innovation Management and Industrial Engineering | 2011 | https://ieeexplore.ieee.org/abstract/document/6114714 | ||||
49 | McCue_Colleen | Data Mining and Predictive Analysis: Intelligence Gathering and Crime Analysis | McCue, Colleen | Butterworth-Heinemann | 2007 | https://www.sciencedirect.com/topics/computer-science/domain-expertise#:~:text=2.1%20Domain%20Expertise,need%20to%20know%20your%20stuff. | ||||
50 | Besse,_Philippe | A Survey of Bias in Machine Learning Through the Prism of Statistical Parity | Besse, Philippe; Eustasio del Barrio; Paula Gordaliza; Jean-Michel Loubes; Laurent Risser | The American Statistician | 76 | 2 | 188-198 | 2021 | https://www.tandfonline.com/doi/full/10.1080/00031305.2021.1952897 | |
51 | Muller,_Michael | Designing Ground Truth and the Social Life of Labels | Muller, Michael; Christine T. Wolf; Josh Andres; Michael Desmond; Narendra Nath Joshi; Zahra Ashktorab; Aabhas Sharma; Kristina Brimijoin; Qian Pan; Evelyn Duesterwald; Casey Dugan | Proceedings of the 2021 CHI Conference on Human Factors in Computing System | 1-16 | 2021 | https://doi.org/10.1145/3411764.3445402 | |||
52 | Shalev-Shwartz,_Shai | Understanding Machine Learning: From Theory to Algorithms | Shalev-Shwartz, Shai; Shai Ben-David | Cambridge Unversity Press | 2014 | https://www.cs.huji.ac.il/w~shais/UnderstandingMachineLearning/understanding-machine-learning-theory-algorithms.pdf | ||||
53 | SP800-160 | Engineering Trustworthy Secure Systems | Ross, Ron; Mark Winstead; Michael McEvilley | NIST SP 800-160 | 2022 | https://nvlpubs.nist.gov/nistpubs/SpecialPublications/NIST.SP.800-160v1r1.fpd.pdf | ||||
54 | Hard choices in artificial intelligence, | Roel Dobbe, Thomas Krendl Gilbert, Yonatan Mintz, | https://www.sciencedirect.com/science/article/pii/S0004370221001065?via%3Dihub | |||||||
55 | Khanna,_Anirudh | A Study of Today's A.I. through Chatbots and Rediscovery of Machine Intelligence | Khanna, Anirudh; Bishwajeet, Pandey; Kushagra, Vashishta; Kartik, Kalia; Bhale, Pradeepkumar; Teerath, Das | International Journal of u-and e-Service, Science and Technology | 8 | 7 | 277-284 | 2015 | http://article.nadiapub.com/IJUNESST/vol8_no7/28.pdf | |
56 | NBSIR_82-2582 | An Overview of Computer Vision | Gevarter, William B. | NIST 82-2582 | 1982 | https://nvlpubs.nist.gov/nistpubs/Legacy/IR/nbsir82-2582.pdf | ||||
57 | Kou,_Yufeng | Survey of fraud detection techniques | Kou, Yufeng; Chang-Tien, Lu; Sirirat, Sirwongwattana; Yo-Ping, Huang | IEEE International Conference on Networking, Sensing and Control | 2 | 749-754 | 2004 | https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=1297040 | ||
58 | Merritt,_Linda | Human capital management: More than HR with a new name. | Merritt, Linda | People and Strategy | 30 | 2 | 14-16 | 2007 | https://www.proquest.com/docview/224596559?pq-origsite=gscholar&fromopenview=true | |
59 | CRS_AI | Artificial Intelligence: Background, Selected Issues, and Policy Considerations | Harris, Laurie A. | Congressional Research Service | 2021 | https://crsreports.congress.gov/product/pdf/R/R46795 | ||||
60 | IJMAE | A Review of the Role of Marketing in Recruitment and Talent Acquisition. | Alashmawy, Ahmad; Rashad, Yazdanifard | International Journal of Management, Accounting and Economics | 6 | 7 | 2019 | https://www.academia.edu/41261685/A_Review_of_the_Role_of_Marketing_in_Recruitment_and_Talent_Acquisition?from=cover_page | ||
61 | Das,_Debashis | A survey on recommendation system. | Das, Debashis; Laxman, Sahoo; Sujoy, Datta. | International Journal of Computer Applications | 160 | 7 | 2017 | https://www.researchgate.net/profile/Debashis-Das-17/publication/313787463_A_Survey_on_Recommendation_System/links/5d7de0474585155f1e4de908/A-Survey-on-Recommendation-System.pdf | ||
62 | Hyndman,_Rob | Forecasting: principles and practice | Hyndman, Rob J.; George, Athanasopoulos | 14 | 2018 | https://books.google.com/books?hl=en&lr=&id=_bBhDwAAQBAJ&oi=fnd&pg=PA7&dq=Forecasting&ots=Tij_xmXIMJ&sig=c8LjAcmbLDC5QeH_xQno2l_gTr0#v=onepage&q=Forecasting&f=false | ||||
63 | Ustun,_Berk | Actionable Recourse in Linear Classification | Ustun, Berk; Spangher, Alexander; Liu, Yang | Association of Computing Machinery | ||||||
64 | Voight,_Paul | The EU General Data Protection Regulation: A Practical Guide | Voight,_Paul; von_dem_Bussche,_Axel | Springer | ||||||
65 | ECOA | 12 CFR Part 1002 - Equal Credit Opportunity Act (Regulation B) | Consumer Financial Protection Bureau | |||||||
66 | Gill,_Navdeep | A Responsible Machine Learning Workflow with Focus on Interpretable Models, Post-hoc Explanation, and Discrimination Testing | Gill, Navdeep; Hall, Patrick; Montgomery, Kim; Schmidt, Nicholas | MDPI | ||||||
67 | ISO_IEC_38507 | Information Technology - Governance of IT - Governance implications of the use of artificial intelligence by organizations | ISO/IEC | ISO | 1 | 2022 | https://www.iso.org/obp/ui/#iso:std:iso-iec:38507:ed-1:v1:en | |||
68 | Darnell_Coss_Hall | The Future of Analytics | Dan Darnell, Rafael Coss, Patrick Hall | O'Reilly Media Inc. | Ch. 4 | 2020 | https://www.oreilly.com/library/view/the-future-of/9781492091769/ch04.html | |||
69 | Fed_Reserve | Guidance on Model Risk Management | Patrick M. Parkinson | The Federal Reserve | 2011 | https://www.federalreserve.gov/supervisionreg/srletters/sr1107a1.pdf | ||||
70 | Jennifer,_Hill | Causal Inference: Overview | Jennifer Hill, Elizabeth A. Stuart | International Encyclopedia of the Social & Behavioral Sciences (Second Edition) | 255-260 | 2015 | https://www.sciencedirect.com/science/article/pii/B9780080970868420957 | |||
71 | AIRS_Penn | Artificial Intelligence Risk & Governance | AIRS | The Warton School, University of Pennslyvania | 2022 | https://ai.wharton.upenn.edu/artificial-intelligence-risk-governance/ | ||||
72 | ENISA | Privacy by Design | European Union Agency for Cybersecurity | https://www.enisa.europa.eu/topics/data-protection/privacy-by-design | ||||||
73 | Furche,_Tim | Data wrangling for big data: Challenges and opportunities. | Furche, Tim; George, Gottlob; Leonid, Libkin; Giorgio, Orsi; Norman, Paton | Advances in Database Technology—EDBT 2016: Proceedings of the 19th International Conference on Extending Database Technology | 473-478 | 2016 | https://www.research.manchester.ac.uk/portal/files/50447231/paper_94_1_.pdf | |||
74 | Enrique | Towards an integrated crowdsourcing definition. | Estellés-Arolas, Enrique; Fernando, González-Ladrón-de-Guevara | Journal of Information science | 38 | 2 | 189-200 | 2012 | https://journals.sagepub.com/doi/full/10.1177/0165551512437638 | |
75 | Behdad | Nature-inspired techniques in the context of fraud detection. | Behdad, Mohammad; Luigi, Barone; Mohammed, Bennamoun; Tim, French. | EEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) | 42 | 6 | 1273-1290 | 2012 | https://ieeexplore.ieee.org/abstract/document/6392447?casa_token=-mPJh2Do05MAAAAA:c5Eyg4__i64XlBowloZbwwwKNe0KnqAQvjg5romygO6ymRKDl70np3DiDL0mipMXmdmeboDj1hGwa9I | |
76 | Woodward | Biometrics: A look at facial recognition. | Woodward Jr, John D., Christopher Horn, Julius Gatune, and Aryn Thomas | RAND CORP SANTA MONICA CA | 2003 | https://apps.dtic.mil/sti/citations/ADA414520 | ||||
77 | Sharma,_Lalita | A survey of recommendation system: Research challenges. | Sharma, Lalita; Anju, Gera | International Journal of Engineering Trends and Technology (IJETT) | 4 | 5 | 1989-1992 | 2013 | https://d1wqtxts1xzle7.cloudfront.net/38584474/IJETT-V4I5P132_1_-with-cover-page-v2.pdf?Expires=1656295756&Signature=QAnv0QzAEvSK2TSOMFygnk1AGUQrGWtz7PD7~bal6kX9SbiWAwd18feH3nB0kH4EQDA0rEPGrm3V9E38s4eY2C5i52NHA-jY0h2zBYAnLETt5PB1cAMjSZf4qaqNWZCPvQtOpaxTkhV6YB1MLDTmaFCAjKcqQfqm6WPQoax5VLh0hIbF-hlc8p5wXiW7fE9z~OeYpmTJld4doW94bG3OrDUY75EN9cptH-IHlldQRs~jF1POAkJUO5PL91PKVJatYAjeWQn7eNchB2TszrfnDbs6pjCyPXIIvi1WdnQzkKVN0F6N-CA~YtZ6yGKIxTjDuxdcJh0AtfD2cjxLDvNFCA__&Key-Pair-Id=APKAJLOHF5GGSLRBV4ZA | |
78 | Žliobaitė_Indrė | A survey on measuring indirect discrimination in machine learning | Žliobaitė, Indrė | CoRR | 2018 | https://arxiv.org/abs/1511.00148 | ||||
79 | Vorobeychik | Adversarial machine learning | Vorobeychik, Yevgeniy; Murat, Kantarcioglu | Synthesis Lectures on Artificial Intelligence and Machine Learning | 12 | 3 | 2018 | https://www.morganclaypool.com/doi/abs/10.2200/S00861ED1V01Y201806AIM039?casa_token=bcr3UzYRz6AAAAAA:M-sh4ANwQuRFYcXk18O4x_x6zu7Qq3P5ZC12MrCgTckeNFm9sXOCAkAFvHtMce7t1A3lpUt4MFA | ||
80 | Zhang,_Yonggang | Principal component adversarial example | Zhang,_Yonggang; Xinmei, Tian; Ya, Li; Xinchao, Wang; Dacheng, Tao | IEEE Transactions on Image Processing 29 | 4804-4815 | 2020 | https://ieeexplore.ieee.org/abstract/document/9018372?casa_token=MFIULJJsFBEAAAAA:GVCQa1Ccivt9ETPlYlBmLvK74iIDNzODP-6mo2B4o4nkZG69ORI-HliXK0iXb3GG-Q8csl2vxtBorQ | |||
81 | NIST_SP_800 | Sp 800-66 rev. 1. an introductory resource guide for implementing the health insurance portability and accountability act (hipaa) security rule | Scholl, Matthew A.; Kevin M. Stine; Joan Hash; Pauline Bowen; L. Arnold Johnson; Carla Dancy Smith; Daniel I. Steinberg | National Institute of Standards & Technology | 2008 | https://dl.acm.org/doi/pdf/10.5555/2206281 | ||||
82 | Jain_Saachi | Missingness Bias in Model Debugging | Jain, Saachi; Hadi Salman; Eric Wong; Pengchuan Zhang; Vibhav Vineet; Sai Vemprala; Aleksander Madry | ICLR | 2022 | https://arxiv.org/abs/2204.08945 | ||||
83 | Mehrabi,_Ninareh | A Survey on Bias and Fairness in Machine Learning | Mehrabi, Ninareh ; Fred Morstatter; Nripsuta Saxena; Kristina Lerman; Aram Galstyan | ACM Computing Surveys | 54 | 6 | 1-35 | 2022 | https://dl.acm.org/doi/abs/10.1145/3457607 | |
84 | Lipton,_Zachary | Does mitigating ML’s impact disparity require treatment disparity? | Lipton, Zachary C.; Alexandra Chouldechova; Julian McAuley | 32nd Conference on Neural Information Processing Systems | 2018 | https://doi.org/10.48550/arXiv.1711.07076 | ||||
85 | Gustavii,_Ebba | A Swedish Grammar for Word Prediction | Gustavii, Ebba; Eva Pettersson | Uppsala University - Department of Linguistics | 2003 | https://www.researchgate.net/publication/2838153_A_Swedish_Grammar_for_Word_Prediction/link/00b4951a5f2645ca02000000/download | ||||
86 | Comptroller_Office | Comptroller's Handbook: Model Risk Management, Version 1.0 | Office of the Comptroller of the Currency | Comptroller's Handbook: Model Risk Management, Version 1.0 | 2021 | https://www.occ.gov/publications-and-resources/publications/comptrollers-handbook/files/model-risk-management/index-model-risk-management.html | ||||
87 | CISA | A Glossary of Common Cybersecurity Words and Phrases | National Initiative for Cybersecurity Careers and Studies | 2022 | https://niccs.cisa.gov/cybersecurity-career-resources/glossary#D | |||||
88 | GWUC | Cyber Glossary | The George Washington University | Natural Security Archive - The Cyber Vault Project | 2018 | https://nsarchive.gwu.edu/cyber-glossary-b | ||||
89 | SP-800-12 | Sp 800-12. an introduction to computer security: The nist handbook. | Guttman, Barbara; Edward A. Roback | 1995 | https://dl.acm.org/doi/pdf/10.5555/2206203 | |||||
90 | Thomas_Edgar | Research Methods for Cyber Security | Thomas W. Edgar; David O. Manz | 367-392 | 2017 | https://www.sciencedirect.com/science/article/pii/B9780128053492000157 | ||||
91 | Vredenburg,_Karel | A survey of user-centered design practice | Vredenburg, Karel; Ji-Ye, Ma; Paul W., Smith; Tom, Carey | Proceedings of the SIGCHI conference on Human factors in computing systems | 471-478 | 2002 | https://dl.acm.org/doi/abs/10.1145/503376.503460 | |||
92 | ST04-015 | Understanding Denial-of-Service Attacks | CISA | https://www.cisa.gov/uscert/ncas/tips/ST04-015 | ||||||
93 | Chandrasekaran,_Varun | Chandrasekaran,_Varun; Kamalika, Chaudhuri; Irene, Giacomelli; Somesh, Jha; Songbai, Yan | 29th USENIX Security Symposium (USENIX Security 20) | 1309-1326 | 2020 | https://www.usenix.org/conference/usenixsecurity20/presentation/chandrasekaran | ||||
94 | FDA_Glossary | Glossary of Computer System Software Development Terminology | FDA | 1995 | https://www.fda.gov/inspections-compliance-enforcement-and-criminal-investigations/inspection-guides/glossary-computer-system-software-development-terminology-895#_top | |||||
95 | Meinshausen,_Nicolai | Causality from a distributional robustness point of view | Meinshausen, Nicolai | 2018 IEEE Data Science Workshop (DSW) | 6-10 | 2018 | https://ieeexplore.ieee.org/abstract/document/8439889?casa_token=8tga5hcskjQAAAAA:PlpvmJtJNGKSNXiBdghGmy670MxN91PXc3ekZRVEXwOcLoJkh0sxDuWseVzr0EowGRCf8WR-eYLWeU4 | |||
96 | Stacke,_Karin | Measuring domain shift for deep learning in histopathology. | Stacke, Karin; Gabriel, Eilertsen; Jonas, Unger; Claes, Lundström | IEEE journal of biomedical and health informatics | 25 | 2 | 325-336 | 2020 | https://ieeexplore.ieee.org/abstract/document/9234592?casa_token=RIQcYxte8lIAAAAA:4t6IwNomEw95f3c1ir73BRReG7OzKecUzpVQS_Bk5zIEWA5R75uG-66g9irlblzDDVwu7ut4jAo2i_8 | |
97 | NASA_Soft_Standards | Software Assurance and Software Safety Standard | NASA Standard | 2020 | https://standards.nasa.gov/standard/nasa/nasa-std-87398 | |||||
98 | PET_Handbook | Handbook of privacy and privacy-enhancing technologies. | Van Blarkom, G. W.; John J. Borking; JG Eddy Olk | Privacy Incorporated Software Agent (PISA) Consortium, The Hague 198 | 2003 | https://andrewpatrick.ca/pisa/handbook/Handbook_Privacy_and_PET_final.pdf | ||||
99 | NIST_1500 | NIST Big Data Interoperability Framework | Wo L. Chang; Nancy Grady | NIST | 1 | 2019 | https://www.nist.gov/publications/nist-big-data-interoperability-framework-volume-1-definitions?pub_id=918927 | |||
100 | Microsoft_Azure_documentation_Detect_data_drift | Detect data drift (preview) on datasets | Microsoft | Azure documentation | 2022 | https://docs.microsoft.com/en-us/azure/machine-learning/how-to-monitor-datasets?tabs=python | ||||
101 | Egnyte | Egnyte | Egnyte | Data Control: Definition and Benefits | 2022 | https://www.egnyte.com/guides/governance/data-control | ||||
102 | IG1190M_AIOps_Decommission_v1.0.0 | IG1190M AIOps Decommission v1.0.0 | AI Operations | IG1190M AIOps Decommission v1.0.0 | 2022 | https://www.tmforum.org/resources/reference/ig1190m-aiops-decommission-v1-0-0/ | ||||
103 | peak.ai | AI decision making: the future of business intelligence | Peak.AI | AI decision making: the future of business intelligence | 2022 | https://peak.ai/hub/blog/ai-decision-making-the-future-of-business-intelligence/ | ||||
104 | Hochreiter,_Sepp | Toward a Broad AI | Hochreiter, Sepp | Communications of the ACM | 65 | 4 | 56-57 | 2022 | https://cacm.acm.org/magazines/2022/4/259402-toward-a-broad-ai/fulltext | |
105 | Mitchell,_Eric | Memory-Based Model Editing at Scale. | Mitchell, Eric; Charles, Lin; Antoine, Bosselut; Christopher D., Manning; Chelsea, Finn | International Conference on Machine Learning, PMLR | 15817-15831 | 2022 | https://proceedings.mlr.press/v162/mitchell22a.html | |||
106 | ISO/IEC_TS_5723:2022(en) | ISO/IEC TS 5723:2022(en) Trustworthiness — Vocabulary | ISO/IEC | ISO/IEC | 2022 | https://www.iso.org/obp/ui/#iso:std:iso-iec:ts:5723:ed-1:v1:en | ||||
107 | H20.ai_glossary | H20.ai Glossary | H20.ai | H20.ai | 2022 | https://docs.h2o.ai/h2o/latest-stable/h2o-docs/glossary.html | ||||
108 | TechTarget_Ivy_Wigmore | AI Washing | Ivy Wigmore | TechTarget | 2017 | https://www.techtarget.com/searchenterpriseai/definition/AI-washing | ||||
109 | Roman_V._Yampolskiy_Unexplainability | Unexplainability and Incomprehensibility of Artificial Intelligence | Roman V. Yampokskiy | PhilArchive | 2019 | https://philarchive.org/archive/YAMUAI | ||||
110 | Forbes_Kayvan_Alikhani | Remember 'Cloud Washing'? It's Happening In RegTech | Kayvan Alikhani | Forbes | 2019 | https://www.forbes.com/sites/forbestechcouncil/2019/10/14/remember-cloud-washing-its-happening-in-regtech/?sh=2a52bd3a796c | ||||
111 | Ripley,_Brian | Introduction and Examples | Brian D. Ripley | Pattern Recognition and Neural Networks | 6 | 1996 | https://archive.org/details/patternrecogniti0000ripl/page/6/mode/2up?q=training&view=theater | |||
112 | C3.ai_Model_Training | Model Training | C3.ai | C3.ai Glossary | https://c3.ai/glossary/data-science/model-training/ | |||||
113 | Pyle,_Dorian_Data_Preparation_as_a_Process | Data Preparation as a Process | Dorian Pyle | Data Preparation for Data Mining | 89-124 | 1999 | https://www.google.com/books/edition/Data_Preparation_for_Data_Mining/hhdVr9F-JfAC?hl=en&gbpv=1&dq=Binning%20is%20a%20technique&pg=PA110&printsec=frontcover | |||
114 | Wieringa,_Roel_J. | Conceptual Frameworks | Roel J. Wieringa | Design Science Methodology for Information Systems and Software Engineering | 73-92 | 2014 | https://www.google.com/books/edition/Design_Science_Methodology_for_Informati/xLKLBQAAQBAJ?hl=en&gbpv=1&dq=%22Construct+validity+is+defined+by+Shadish+et+al+24+p+506+as+the+degree+to+which+inferences+from+phenomena+to+constructs+are+warranted%22&pg=PA87&printsec=frontcover | |||
115 | York,_Dan_Internet_Society | What Is the Splinternet? And Why You Should Be Paying Attention | Dan York | Internet Society | 2022 | https://www.internetsociety.org/blog/2022/03/what-is-the-splinternet-and-why-you-should-be-paying-attention/ | ||||
116 | Splinternets | Key Definitions | European Parliament, Directorate-General for Parliamentary Research Services, Perarnaud, C., Rossi, J., Musiani, F., et al. | 'Splinternets': Addressing the Renewed Debate on Internet Fragmentation | 2022 | https://op.europa.eu/en/publication-detail/-/publication/5a5bfaed-0d52-11ed-b11c-01aa75ed71a1/language-en | ||||
117 | Regularization_for_Deep_Learning | Regularization for Deep Learning | Ian Goodfellow, Yoshua Bengio, and Aaron Courville | Deep Learning | 221-266 | 2016 | https://www.google.com/books/edition/Deep_Learning/omivDQAAQBAJ?hl=en&gbpv=1&dq=%22Sparsity+in+this+context+refers+to+the+fact+that+some+parameters+have+an+optimal+value+of+zero%22&pg=PA229&printsec=frontcover | |||
118 | Statistics_in_Plain_English | Statistical Significance and Effect Size | Timothy C. Urdan | Statistics in Plain English | 43-56 | 2001 | https://www.google.com/books/edition/Statistics_in_Plain_English/MwCK52n_wBEC?hl=en&gbpv=1&dq=%22Statistical+significance+When+the+probability+of+obtaining+a+statistic+of+a+given+size+due+strictly+to%22&pg=PA55&printsec=frontcover | |||
119 | The_SAGE_Encyclopedia_of_Communication_Research_Methods | Relationships Between Variables | Mike Allen, ed. | The SAGE Encyclopedia of Communication Research Methods, Volume 1 | 2017 | https://www.google.com/books/edition/The_SAGE_Encyclopedia_of_Communication_R/4GFCDgAAQBAJ?hl=en&gbpv=1&dq=%22Statistical+significance+refers+to+whether+a+relationship+between+two+or+more+variables+exists+beyond+a+probability+expected+by+chance%22&pg=PA1413&printsec=frontcover | ||||
120 | The_Science_of_Algorithmic_Trading_and_Portfolio_Management | Evaluation | Robert Kissell | The Science of Algorithmic Trading and Portfolio Management | 2013 | https://www.google.com/books/edition/The_Science_of_Algorithmic_Trading_and_P/FKPND2zz9OoC?hl=en&gbpv=1&dq=%22Back+testing+is+the+quantitative+evaluation+of+a+model%E2%80%99s+performance+both+from+a+statistical+and+trading+perspective%22&pg=PA446&printsec=frontcover | ||||
121 | Introduction_to_Information_Systems | Artificial Intelligence | R. Kelly Rainer, Reiner R. Kelly, and Brad Prince | Introduction to Information Systems: International Adaptation | 410-450 | 2022 | https://www.google.com/books/edition/Introduction_to_Information_Systems/Y75VEAAAQBAJ?hl=en&gbpv=1&dq=%22An+autonomous+vehicle+automobile+bus+tractor+combine+boat+forklift+etc+is+a+vehicle+capable+of+sensing+its+environment+and+moving+safely+with+little+or+no+human+input%22&pg=PA437&printsec=frontcover | |||
122 | OED_snake_oil | Snake oil | Oxford English Dictionary | Oxford English Dictionary | 2022 | https://www-oed-com.proxygw.wrlc.org/view/Entry/95490133?redirectedFrom=%22snake+oil%22 | ||||
123 | Nick_Higham_1 | What Is Rounding? | Nick Higham | Nick Higham | 2020 | https://nhigham.com/2020/04/28/what-is-rounding/ | ||||
124 | Nick_Higham_2 | What Is Stochastic Rounding? | Nick Higham | Nick Higham | 2020 | https://nhigham.com/2020/07/07/what-is-stochastic-rounding/ | ||||
125 | pwc_Model_Risk_Management_of_AI_and_ML_Systems | Model Risk Management of AI and Machine Learning Systems | PricewaterhouseCoopers | Model Risk Management of AI and Machine Learning Systems | 2020 | https://www.pwc.co.uk/data-analytics/documents/model-risk-management-of-ai-machine-learning-systems.pdf | ||||
126 | Toward_an_understanding_of_responsible_artificial_intelligence_practices | Toward an understanding of responsible artificial intelligence practices | Yichuan Wang, Mengran Xiong, and Hossein G. T. Olya | In: Bui, T.X., (ed.) Proceedings of the 53rd Hawaii International Conference on System Sciences. Hawaii International Conference on System Sciences (HICSS 2020), 20202-01-07 - 2020-01-10, Maui, Hawaii, USA. Hawaii International Conference on System Sciences (HICSS) | 2020 | https://eprints.whiterose.ac.uk/162719/8/Toward%20an%20Understanding%20of%20Responsible%20Artificial%20Intelligence%20Practices.pdf | ||||
127 | Comparing_scores_and_reason_codes | Comparing scores and reason codes in credit scoring systems: NeuroDecision vs. unconstrained neural networks | Equifax | Comparing scores and reason codes in credit scoring systems: NeuroDecision vs. unconstrained neural networks | 2020 | https://assets.equifax.com/marketing/US/assets/comparing_scores_whitepaper.pdf | ||||
128 | Machine_Learning_Interpretability_with_H20_Driverless_AI | Machine Learning Interpretability with H20 Driverless AI | Patrick Hall, Navdeep Gill, Megan Kurka, and Wen Phan; edited by Angela Bartz | Machine Learning Interpretability with H20 Driverless AI | 2022 | https://docs.h2o.ai/driverless-ai/latest-stable/docs/booklets/MLIBooklet.pdf | ||||
129 | Pattern_Recognition_and_Machine_Learning | Introduction | Christopher M. Bishop | Pattern Recognition and Machine Learning | 1-66 | 2006 | ||||
130 | DOD_TEVV | Technology Investment Strategy 2015-2018 | United States Department of Defense's Test and Evaluation, Verification and Validation (TEVV) Working Group | Technology Investment Strategy 2015-2018 | 2015 | https://defenseinnovationmarketplace.dtic.mil/wp-content/uploads/2018/02/OSD_ATEVV_STRAT_DIST_A_SIGNED.pdf | ||||
131 | Fundamentals_of_Information_Systems_Security | Auditing, Testing, and Monitoring | David Kim and Michael G. Solomon | Fundamentals of Information Systems Security | 216-250 | 2016 | https://www.google.com/books/edition/Fundamentals_of_Information_Systems_Secu/Yb4eDQAAQBAJ?hl=en&gbpv=1&dq=%22Audit+logs+Defined+events+that+provide+additional+input+to+audit+activities%22&pg=PA233&printsec=frontcover | |||
132 | AI_Ethics_Mark_Coeckelbergh | Glossary | Mark Coeckelbergh | AI Ethics | 203-206 | 2020 | https://www.google.com/books/edition/AI_Ethics/Gs_XDwAAQBAJ?hl=en&gbpv=1&dq=%22Trustworthy+AI+Al+that+can+be+trusted+by+humans%22&pg=PA206&printsec=frontcover | |||
133 | Hands-On_Smart_Contract_Dev | Fundamental Concepts of Blockchain | Matt Zand, Xun (Brian) Wu, and Mark Anthony Morris | Hands-On Smart Contract Development with Hyperledger Fabric V2 | ||||||
134 | TechTarget_target_function | target function | TechTarget | TechTarget | 2018 | https://www.techtarget.com/whatis/definition/target-function | ||||
135 | IGI_Global_reference_class | What is Reference Class | IGI Global | IGI Global | https://www.igi-global.com/dictionary/reference-class/35564 | |||||
136 | CPO_Magazine_Amar_Kanagaraj | Data Remediation and Its Role in Data Security and Privacy | CPO Magazine | CPO Magazine | 2022 | https://www.cpomagazine.com/data-protection/data-remediation-and-its-role-in-data-security-and-privacy/ | ||||
137 | DEV_ranking | Machine learning (ML) applications: ranking | DEV Community | DEV Community | 2022 | https://dev.to/mage_ai/machine-learning-ml-applications-ranking-238d | ||||
138 | productmanagerHQ_Josh_Fechter | What Does an AI Product Manager Do? | Product Manager HQ | Product Manager HQ | https://productmanagerhq.com/ai-product-manager/ | |||||
139 | Proxy_Discrimination | Proxy Discrimination in the Age of Artificial Intelligence and Big Data | Anya E. R. Prince; Daniel Schwarcz | Iowa Law Review | 105 | 3 | 2020 | https://ilr.law.uiowa.edu/print/volume-105-issue-3/proxy-discrimination-in-the-age-of-artificial-intelligence-and-big-data | ||
140 | Forbes_Tracy_Kemp | Four Skills Every Successful AI Product Owner Should Possess | Tracy Kemp | Forbes | 2021 | https://www.forbes.com/sites/forbestechcouncil/2021/08/24/four-skills-every-successful-ai-product-owner-should-possess/?sh=65dbfe423d3d | ||||
141 | Merriam-Webster_underrepresented | underrepresented | Merriam-Webster | Merriam-Webster Dictionary | https://www.merriam-webster.com/dictionary/underrepresented | |||||
142 | HBR_Andrew_Burt_how_to_ensure | How to Ensure Your AI Doesn’t Discriminate | Andrew Burt | Harvard Business Review | https://hbr.org/2020/08/how-to-ensure-your-ai-doesnt-discriminate | |||||
143 | Cadient_EEOC | Understanding and Avoiding Adverse Impact in Employment Practices | Michael Baysinger; Kristin Worrell | Cadient | https://cadienttalent.com/resources/understanding-and-avoiding-adverse-impact | |||||
144 | Ben_Green_Yiling_Chen | Algorithm-in-the-Loop Decision Making | Ben Green; Yiling Chen | The Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20) | https://ojs.aaai.org/index.php/AAAI/article/view/7115 | |||||
145 | IT_Governance_Blog_Luke_Irwin | Personal data vs Sensitive Data: What’s the Difference? | Luke Irwin | IT Governance Blog | https://www.itgovernance.co.uk/blog/the-gdpr-do-you-know-the-difference-between-personal-data-and-sensitive-data | |||||
146 | OED_stereotype | Stereotype | Oxford English Dictionary | Oxford English Dictionary | https://www-oed-com.proxygw.wrlc.org/view/Entry/189956?rskey=JmZ8YE&result=1#eid | |||||
147 | Machine_Learning_Mastery_Jason_Brownlee | Machine Learning Terminology from Statistics and Computer Science | Jason Brownlee | Machine Learning Mastery | 2016 | https://machinelearningmastery.com/data-terminology-in-machine-learning/#:~:text=Row%3A%20A%20row%20describes%20a,problem%20domain%20that%20you%20have. | ||||
148 | Banking_on_Your_Data_Christopher_Gilliard | Prepared Testimony and Statement for the Record of Christopher Gilliard, PhD. Hearing on "Banking on Your Data: the Role of Big Data in Financial Services" before the House Financial Services Committee Task Force on Financial Technology | Christopher Gilliard | Prepared Testimony and Statement for the Record of Christopher Gilliard, PhD. Hearing on "Banking on Your Data: the Role of Big Data in Financial Services" before the House Financial Services Committee Task Force on Financial Technology | https://www.congress.gov/116/meeting/house/110251/witnesses/HHRG-116-BA00-Wstate-GillardC-20191121.pdf | |||||
149 | Merriam-Webster_pseudoscience | pseudoscience | Merriam-Webster | Merriam-Webster Dictionary | https://www.merriam-webster.com/dictionary/pseudoscience | |||||
150 | Cost_Management_ch15 | Lean Accounting and Productivity Measurement | Don R. Hansen; Maryanne M. Mowen; Dan L. Heitger | Cost Management | 2021 | https://www.google.com/books/edition/Cost_Management/HhQcEAAAQBAJ?hl=en&gbpv=1&dq=%22Velocity+has+to+do+with+how+fast+a+product+can+be+delivered+to+the+market+and+quality+is+concerned+with+providing+a+nondefective+product+with+the+desired+features+to+customers%22&pg=PA783&printsec=frontcover | ||||
151 | Towards_Productizing | Towards Productizing AI/ML Models: An Industry Perspective from Data Scientists | Filippo Lanubile, Fabio Calefato, Luigi Quaranta, Maddalena Amoruso, Fabio Fumarola, and Michele Filannino | arXiv | https://arxiv.org/abs/2103.10548 | |||||
152 | The_Art_of_Software_Testing | The Psychology and Economics of Program Testing | Glenford J. Myers | The Art of Software Testing | 1979 | https://archive.org/details/artofsoftwaretes0000myer/page/4/mode/2up | ||||
153 | William_Hetzel | An Introduction | William C. Hetzel | The Complete Guide to Software Testing, 2nd edition | 1988 | https://archive.org/details/completeguidetos0000hetz/page/6/mode/2up?view=theater | ||||
154 | On_Hyperparameter_Optimization | On Hyperparameter Optimization of Machine Learning Algorithms: Theory and Practice | Li Yang and Abdallah Shami | arXiv | https://arxiv.org/pdf/2007.15745.pdf | |||||
155 | Security_Analysis_of_Subject_Access | Security Analysis of Subject Access Request Procedures: How to Authenticate Data Subjects Safely When They Request for Their Data | Coline Boniface, Imane Fouad, Nataliia Bielova, Cédric Lauradoux, and Cristiana Santos | Privacy Technologies and Policy (7th Annual Privacy Forum, APF 2019, Rome, Italy, June 13–14, 2019, Proceedings) | 2019 | https://www.google.com/books/edition/Privacy_Technologies_and_Policy/SW2cDwAAQBAJ?hl=en&gbpv=1&dq=%22i+Impersonation+data+breach+A+malicious+individual+is+able+to+impersonate+a+legitimate+data+subject+to+the+data+controller%22&pg=PA186&printsec=frontcover | ||||
156 | IEEE_Caught_in_the_Act | Caught in the Act of an Insider Attack: Detection and Assessment of Insider Threat | Philip A. Legg, Oliver Buckley, Michael Goldsmith, and Sadie Creese | 2015 IEEE International Symposium on Technologies for Homeland Security (HST | 2015 | https://ieeexplore-ieee-org.proxygw.wrlc.org/stamp/stamp.jsp?tp=&arnumber=7446229 | ||||
157 | Moradi_Samwald | Post-hoc explanation of black-box classifiers using confident itemsets | Milad Moradi; Matthias Samwald | Expert Systems with Applications | 165 | 2021 | https://reader.elsevier.com/reader/sd/pii/S0957417420307302?token=858E09A321B5727ECF889090AFB0B943768A26AFE15FB920B20176BD22F82449CE42841047FD99C51A01659C2ECE9695&originRegion=us-east-1&originCreation=20220918190335#b0035 | |||
158 | Mind_on_Statistics | Chapter 4 | Jessica M. Utts and Robert F. Heckard | Mind on Statistics (6th Edition) | 2021 | https://www.google.com/books/edition/Mind_on_Statistics/npQMEAAAQBAJ?hl=en&gbpv=1&dq=%22Practical+Versus+Statistical+Significance+Statistical+significance+does+not+necessarily+mean+that+the+relationship+between+the+two+variables+has+practical+significance%22&pg=PA138&printsec=frontcover | ||||
159 | Jenna_Burrell | How the machine 'thinks': Understanding opacity in machine learning algorithms | Jenna Burrell | Big Data & Society | 1-12 | 2016 | https://journals.sagepub.com/doi/pdf/10.1177/2053951715622512 | |||
160 | Hughes_Lavery_Critical_Thinking | Glossary | William Hughes and Jonathan Lavery | Critical Thinking - Concise Edition | 2015 | https://www.google.com/books/edition/Critical_Thinking_Concise_Edition/k0idCgAAQBAJ?hl=en&gbpv=1&dq=%222+7+2+straw+man+a+fallacious+argument+which+irrelevantly+attacks+a+position+that+appears+similar+to+but+is+actually+different+from+an+opponent%E2%80%99s+position+and+concludes+that+the+opponent%E2%80%99s+real+position+has+thereby+been+refuted%22&pg=PA271&printsec=frontcover | ||||
161 | NIST_SP_800-30_Rev_1 | NIST Special Publication 800-30 Revision 1: Guide for Conducting Risk Assessments | NIST | NIST Special Publication 800-30 Revision 1: Guide for Conducting Risk Assessments | 2012 | https://nvlpubs.nist.gov/nistpubs/Legacy/SP/nistspecialpublication800-30r1.pdf | ||||
162 | TechTarget_third_party | third party | TechTarget | TechTarget Glossary | 2014 | https://www.techtarget.com/whatis/definition/third-party | ||||
163 | Law_Insider_processing_environment | Processing Environment | Insider Law | https://www.lawinsider.com/dictionary/processing-environment | ||||||
164 | wachter_counterfactual_2018 | “Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPR.” | Wachter, S., B. D. M. Mittelstadt, and C. Russell. | Harvard Journal of Law and Technology | 31 | 2 | 2018 | https://ora.ox.ac.uk/objects/uuid:86dfcdac-10b5-4314-bbd1-08e6e78b9094 | ||
165 | mills_study_2010 | Proposed Internet Congestion Control Mechanisms. | Mills, Kevin L, James J Filliben, Dong Yeon Cho, Edward Schwartz, and Daniel Genin. | NIST SP 500-282. | 2010 | https://doi.org/10.6028/NIST.SP.500-282 | ||||
166 | friedman_additive_2000 | Additive logistic regression: a statistical view of boosting (With discussion and a rejoinder by the authors) | Friedman, Jerome, Trevor Hastie, and Robert Tibshirani. | The Annals of Statistics | 28 | 2 | 337–407 | 2000 | https://doi.org/10.1214/aos/1016218223 | |
167 | kusner_counterfactual_2017 | Counterfactual Fairness | Kusner, Matt J, Joshua Loftus, Chris Russell, and Ricardo Silva. | Advances in Neural Information Processing Systems (NIPS) | 2017 | https://proceedings.neurips.cc/paper/2017/hash/a486cd07e4ac3d270571622f4f316ec5-Abstract.html | ||||
168 | cronbach_construct_1955 | Construct Validity in Psychological Tests. | Cronbach, Lee J., and Paul E. Meehl. | Psychological Bulletin | 52 | 281–302 | 1955 | https://doi.org/10.1037/h0040957 | ||
169 | fink_survey_2010 | Survey Research Methods | Fink, A. | International Encyclopedia of Education (Third Edition) | 152–160 | 2010 | https://doi.org/10.1016/B978-0-08-044894-7.00296-7 | |||
170 | bordens_research_2010 | Research Design and Methods: A Process Approach | Kenneth S. Bordens, Bruce B. Abbott | Book (Eighth Edition) | 2011 | https://www.amazon.com/Research-Design-Methods-Process-Approach/dp/B008BLHYQ8 | ||||
171 | nist_statistics_2012 | NIST/SEMATECH e-Handbook of Statistical Methods | https://doi.org/10.18434/M32189 | |||||||
172 | symeonidis_MLOps_2022 | MLOps - Definitions, Tools and Challenges | Symeonidis, Georgios, Evangelos Nerantzis, Apostolos Kazakis, and George A. Papakostas | In 2022 IEEE 12th Annual Computing and Communication Workshop and Conference (CCWC) | 453–460 | 2022 | https://ieeexplore.ieee.org/document/9720902 | |||
173 | hardt_equality_2016 | Equality of Opportunity in Supervised Learning | Hardt, Moritz, Eric Price, and Nati and Srebro | Advances in Neural Information Processing Systems (NIPS) | 3315-3323 | 2016 | http://papers.nips.cc/paper/6374-equality-of-opportunity-in-supervised-learning.pdf | |||
174 | EEOC_Q&A_Employee_Selection | Questions and Answers to Clarify and Provide a Common Interpretation of the Uniform Guidelines on Employee Selection Procedures | Equal Employment Opportunity Commission | Questions and Answers to Clarify and Provide a Common Interpretation of the Uniform Guidelines on Employee Selection Procedures | https://www.eeoc.gov/laws/guidance/questions-and-answers-clarify-and-provide-common-interpretation-uniform-guidelines | |||||
175 | Engineering_safety_in_machine_learning | Engineering safety in machine learning | Kush R. Varshney | Information Theory and Applications Workshop (ITA), 2016 | 2016 | https://ieeexplore-ieee-org.proxygw.wrlc.org/document/7888195 | ||||
176 | DOD_Modeling_and_Simulation_Glossary | DoD Modeling and Simulation (M&S) Glossary | United States Department of Defense | DoD Modeling and Simulation (M&S) Glossary | 1998 | https://web.archive.org/web/20070710104756/http://www.dtic.mil/whs/directives/corres/pdf/500059m.pdf | ||||
177 | Model_Cards_for_Model_Reporting | Model Cards for Model Reporting | Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, Timnit Gebru | arXiv | https://arxiv.org/abs/1810.03993 | |||||
178 | David_Leslie_Morgan_Briggs | Explaining Decisions Made with AI: A Workbook (Use Case 1: AI-Assisted Recruitment Tool) | David Leslie; Morgan Briggs | Explaining Decisions Made with AI: A Workbook (Use Case 1: AI-Assisted Recruitment Tool) | 2021 | https://arxiv.org/ftp/arxiv/papers/2104/2104.03906.pdf | ||||
179 | deeplearningbook_intro | Introduction | Ian Goodfellow, Yoshua Bengio; Aaron Courville | Deep Learning | 2016 | https://www.deeplearningbook.org/contents/intro.html | ||||
180 | privacy-enhancing_technologies | Chapter 5: Privacy-enhancing technologies (PETs) | UK Information Commissioner's Office | DRAFT Anonymisation, pseudonymisation and privacy enhancing technologies guidance | 2022 | https://ico.org.uk/media/about-the-ico/consultations/4021464/chapter-5-anonymisation-pets.pdf | ||||
181 | Joseph_Rocca_Ensemble_methods | Ensemble methods: bagging, boosting and stacking | Joseph Rocca | Towards Data Science | 2019 | https://towardsdatascience.com/ensemble-methods-bagging-boosting-and-stacking-c9214a10a205 | ||||
182 | google_dev_classification-true-false-positive-negative | Classification: True vs. False and Positive vs. Negative | Google Machine Learning Education Foundational Courses | https://developers.google.com/machine-learning/crash-course/classification/true-false-positive-negative | ||||||
183 | Public_Health_and_Informatics_MIE_2021 | A Preliminary Scoping Study of Federated Learning for the Internet of Medical Things | Arshad Farhad; Sandra I. Woolley; Peter Andras | Public Health and Informatics: Proceedings of MIE 2021 | 504-505 | 2021 | https://www.google.com/books/edition/Public_Health_and_Informatics/81A2EAAAQBAJ?hl=en&gbpv=1&dq=%22Federated+learning+1+2+is+a+learning+model+which+addresses+the+problem+of+data+governance+and+privacy+by+training+algorithms+collaboratively+without+transferring+the+data+to+another+location%22&pg=PA504&printsec=frontcover | |||
184 | Black's_Law_Dictionary_harm | harm | The Law Dictionary / Black’s Law Dictionary Second Edition | The Law Dictionary / Black’s Law Dictionary Second Edition | https://thelawdictionary.org/harm/ | |||||
185 | dataiku_ML_and_linear_models | Machine Learning and Linear Models: How They Work (In Plain English) | Katie Gross | Dataiku | 2020 | https://blog.dataiku.com/top-machine-learning-algorithms-how-they-work-in-plain-english-1 | ||||
186 | ORM_model_inventory | Model Inventory | Open Risk Manual | https://www.openriskmanual.org/wiki/Model_Inventory | ||||||
187 | yields.io_model_validation | What Is Model Validation? | Eimee V | Yields.io | 2020 | https://www.yields.io/blog/what-is-model-validation/ | ||||
188 | Open_Risk_Manual_model_validation | Model Validation | Open Risk Manual | Open Risk Manual | https://www.openriskmanual.org/wiki/Model_Validation | |||||
189 | misuse_of_public_data | Implicit data crimes: Machine learning bias arising from misuse of public data | Efrat Shimron; Jonathan I. Tamir; Ke Wang; Michael Lustig | PNAS | 119 | 13 | 2022 | https://www.pnas.org/doi/full/10.1073/pnas.2117203119 | ||
190 | MIT_Protected_Attributes | Module 3: Pedagogical Framework for Addressing Ethical Challenges - Protected Attritbutes and "Fairness Through Unawareness" | MIT Open Courseware | Exploring Fairness in Machine Learning for International Development | 2020 | https://ocw.mit.edu/courses/res-ec-001-exploring-fairness-in-machine-learning-for-international-development-spring-2020/pages/module-three-framework/protected-attributes/ | ||||
191 | Practical_Law_protected_class | Protected Class | Thomson Reuters Practical Law | Thomson Reuters Practical Law | https://content.next.westlaw.com/practical-law/document/Ibb0a38daef0511e28578f7ccc38dcbee/Protected-Class?viewType=FullText&transitionType=Default&contextData=(sc.Default)&firstPage=true0law. | |||||
192 | Dave_Salvator_sparsity | How Sparsity Adds Umph to AI Inference | Dave Salvator | NVIDIA Blogs | 2020 | https://blogs.nvidia.com/blog/2020/05/14/sparsity-ai-inference/ | ||||
193 | saurabh_label_2020 | A Unified View of Label Shift Estimation | Garg, Saurabh, Yifan Wu, Sivaraman Balakrishnan, and Zachary Lipton | Advances in Neural Information Processing Systems | 2020 | https://proceedings.neurips.cc/paper/2020/hash/219e052492f4008818b8adb6366c7ed6-Abstract.html | ||||
194 | provost_data_2013 | Data Science and its Relationship to Big Data and Data-Driven Decision Making | Provost, Foster and Tom Fawcett | Big Data | 1 | 1 | 51–59 | 2013 | https://www.liebertpub.com/doi/full/10.1089/big.2013.1508 | |
195 | hameed_data_2020 | Data Preparation: A Survey of Commercial Tools | Hameed, Mazhar and Felix Naumann | ACM SIGMOD Record | 49 | 3 | 18–29 | 2020 | https://doi.org/10.1145/3444831.3444835 | |
196 | Merriam-Webster_ranking | ranking | Merriam-Webster | Merriam-Webster Dictionary | https://www.merriam-webster.com/dictionary/ranking | |||||
197 | hunter_differential_1979 | Differential validity of employment tests by race: A comprehensive review and analysis | Hunter, John E. and Frank L. Schmidt and Ronda Hunter | Psychological Bulletin | 86 | 721–735 | 1979 | https://psycnet.apa.org/record/1979-30107-001 | ||
198 | kelley_dogfooding_2022 | ‘Dogfooding’ | Kelley, Lora | The New York Times | 2022 | https://www.nytimes.com/2022/11/14/business/dogfooding.html | ||||
199 | wolfram_math_2022 | Wolfram MathWorld: The Web's Most Extensive Mathematics Resource | 2022 | https://mathworld.wolfram.com/ | ||||||
200 | aivodji_fairwashing_2019 | Fairwashing: the risk of rationalization | Aivodji, Ulrich, Hiromi Arai, Olivier Fortineau, Sébastien Gambs, Satoshi Hara, and Alain Tapp | Proceedings of the 36th International Conference on Machine Learning | 2019 | https://proceedings.mlr.press/v97/aivodji19a.html | ||||
201 | khalid_feature_2014 | A survey of feature selection and feature extraction techniques in machine learning | Khalid, Samina, Tehmina Khalil, and Shamila Nasreen. | 2014 Science and Information Conference | 372–378 | 2014 | https://ieeexplore.ieee.org/abstract/document/6918213 | |||
202 | tabassi_adversarial_2019 | A Taxonomy and Terminology of Adversarial Machine Learning | Tabassi, Elham, Kevin Burns, Michael Hadjimichael, Andres Molina-Markham, and Julian Sexton. | NIST Internal or Interagency Report (NISTIR) 8269 (Draft) | 2019 | https://doi.org/10.6028/NIST.IR.8269-draft | ||||
203 | measurement_iso22989_2022 | ISO/IEC 22989:2022 Information technology — Artificial intelligence — Artificial intelligence concepts and terminology | ISO/IEC 22989:2022 | 2022 | https://www.iso.org/standard/74296.html | |||||
204 | aime_measruement_2022 | Notes on Measurement | NIST AIME Team | Unpublished Manuscript | 2022 | <None> | ||||
205 | saarela_feature_2021 | Comparison of feature importance measures as explanations for classification models | Mirka Saarela and Susanne Jauhiainen | SN Applied Sciences | 3 | 2021 | https://link.springer.com/article/10.1007/s42452-021-04148-9 | |||
206 | poole_mackworth_observation | 5.3.1 Background Knowledge and Observations | David Poole and Alan Mackworth | Artificial Intelligence: Foundations of Computational Agents | 2010 | https://artint.info/html/ArtInt_112.html | ||||
207 | kathleen_walch_operationalization | Operationalizing AI | Kathleen Walch | Forbes | 2020 | https://www.forbes.com/sites/cognitiveworld/2020/01/26/operationalizing-ai/?sh=42ea4b2733df | ||||
208 | about_ML_packages | About ML Packages | UiPath | UiPath AI Center Guide | 2021 | https://docs.uipath.com/ai-fabric/v0/docs/about-ml-packages | ||||
209 | TechTarget_data_point | data point | Katie Terrell Hanna and Ivy Wigmore | TechTarget | 2022 | https://www.techtarget.com/whatis/definition/data-point | ||||
210 | Morris_John_data_point | What is a data point in a machine learning model? | John Morris | VProexpert | 2022 | https://www.vproexpert.com/what-is-a-data-point-in-a-machine-learning-model/ | ||||
211 | Artasanchez_Joshi_AI_with_Python | Natural Language Processing | Alberto Artasanchez and Prateek Joshi | Artificial Intelligence with Python: Your Complete Guide to Building Intelligent Apps Using Python 3.x, 2nd Edition | 351-378 | 2020 | https://www.google.com/books/edition/Artificial_Intelligence_with_Python/P0fODwAAQBAJ?hl=en&gbpv=1&dq=%22Lemmatization+is+the+process+of+grouping+together+the+different+inflected+forms+of+a+word+so+they+can+be+analyzed+as+a+single+item%22&pg=PA356&printsec=frontcover | |||
212 | Techopedia_lemmatization | Lemmatization | Techopedia | Techopedia | https://www.techopedia.com/definition/33256/lemmatization | |||||
213 | Techslang_lemmatization | What is Lemmatization? | Techslang | Techslang | https://www.techslang.com/definition/what-is-lemmatization/ | |||||
214 | TechTarget_lemmatization | Lemmatization | TechTarget contributor | TechTarget | 2018 | https://www.techtarget.com/searchenterpriseai/definition/lemmatization | ||||
215 | Lim_Swee_Kiat_harms | Understanding Bias Part I | Lim Sweet Kiat | Machines Gone Wrong | 2019 | https://machinesgonewrong.com/bias_i/#two-types-of-harms | ||||
216 | ICO_data_minimisation | Data minimisation and privacy-preserving techniques in AI systems | Information Commissioner's Office | ICO AI Blog | 2022 | https://ico.org.uk/about-the-ico/media-centre/ai-blog-data-minimisation-and-privacy-preserving-techniques-in-ai-systems/ | ||||
217 | EDPS_data_minimization | Data Minimization | European Data Protection Supervisor | Data Protection Glossary | https://edps.europa.eu/data-protection/data-protection/glossary/d_en | |||||
218 | Arjun_Subramonian_bias_mitigation | An Introduction to Fairness and Bias Mitigation with AllenNLP | Arjun Subramonian | AI2Blog | 2021 | https://blog.allenai.org/an-introduction-to-fairness-and-bias-mitigation-with-allennlp-d1b478d44d4c | ||||
219 | Chi,_Gao,_Ma | Tik Tok Unwrapped | Nicole Chi, Keming Gao, Joanne Ma | Tik Tok Unwrapped | 2022 | https://www.ischool.berkeley.edu/sites/default/files/sproject_attachments/tiktok_unwrapped_zine_final.pdf | ||||
220 | TechTarget_decision_support_system | decision support system | TechTarget | TechTarget | 2021 | https://www.techtarget.com/searchcio/definition/decision-support-system | ||||
221 | Burstein_Holsapple | Spreadsheet-Based Decision Support Systems | Frada Burstein and Clyde W. Holsapple | Handbook on Decision Support Systems 1: Basic Themes | 2008 | https://www.google.com/books/edition/Handbook_on_Decision_Support_Systems_1/q_3sRkRKZQwC?hl=en&gbpv=0 | ||||
222 | Sourabh_Mehta_deterministic | Deterministic vs Stochastic Machine Learning | Sourabh Mehta | Analytics India Magazine | 2022 | https://analyticsindiamag.com/deterministic-vs-stochastic-machine-learning/ | ||||
223 | jansen_graphical_1998 | The Graphical User Interface. | Jansen, Bernard J. | ACM SIGCHI Bulletin | 30 | 2 | 22–26 | 1998 | https://doi.org/10.1145/279044.279051 | |
224 | rudin_interpretable_2022 | Interpretable Machine Learning: Fundamental Principles and 10 Grand Challenges. | Rudin, Cynthia, Chaofan Chen, Zhi Chen, Haiyang Huang, Lesia Semenova, and Chudi Zhong. | Statistics Surveys | 16 | 1–85 | 2022 | https://doi.org/10.1214/21-SS133 | ||
225 | NISTIR_8312_Full | Four Principles of Explainable Artificial Intelligence | Phillips, P. Jonathon; Carina A. Hahn; Peter C. Fontana; David A. Broniatowski; Mark A. Przybocki | NISTIR 8312 | 2021 | https://nvlpubs.nist.gov/nistpubs/ir/2021/NIST.IR.8312.pdf | ||||
226 | arun_opportunities_2020 | Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Survey. | Das, Arun, and Paul Rad. | Arxiv | 2020 | https://doi.org/10.48550/arXiv.2006.11371 | ||||
227 | open_risk_2022 | Open Risk Manual: Midel Governancde | Open Risk Manual | 2022 | https://www.openriskmanual.org/wiki/Model_Governance | |||||
228 | merriam_webster_outcome | outcome | Merriam-Webster | Merriam-Webster Dictionary | 2022 | https://www.merriam-webster.com/dictionary/outcome | ||||
229 | sutton_reinforcement_2018 | Reinforcement Learning: An Introduction | Sutton, Richard, and Andrew Barto | Book, Published by MIT Press | 2018 | |||||
230 | Covert_et_al | Towards a Triad for Data Privacy | Quentin Covert, Mary Francis, Dustin Steinhagen, and Kevin Streff | Proceedings of the 53rd Hawaii International Conference on System Sciences | 2020 | https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/5486a250-cc3c-4227-a752-7d08378afbdf/content | ||||
231 | Cami_Rosso | The Human Bias in the AI Machine: How artificial intelligence is subject to cognitive bias | Cami Rosso | Psychology Today | 2018 | https://www.psychologytoday.com/us/blog/the-future-brain/201802/the-human-bias-in-the-ai-machine | ||||
232 | NIST_CSRC_man-in-the-middle_attack | man-in-the-middle attack (MitM) | NIST Computer Security Resource Center | NIST Computer Security Resource Center | https://csrc.nist.gov/glossary/term/man_in_the_middle_attack | |||||
233 | cambridge_dictionary_2022 | Cambridge Dictionary | 2022 | https://dictionary.cambridge.org/us/ | ||||||
234 | kulinski_feature_2020 | Feature Shift Detection: Localizing Which Features Have Shifted via Conditional Distribution Tests | Kulinski, Sean M., Saurabh Bagchi, and David I. Inouye | NIPS | 2020 | https://proceedings.neurips.cc/paper/2020/file/e2d52448d36918c575fa79d88647ba66-Paper.pdf | ||||
235 | settles_active_2009 | Active Learning Literature Survey | Burr Settles | Technical Report, University of Wisconsim-Madison, Department of Computer Sciences | 2009 | https://minds.wisconsin.edu/handle/1793/60660 | ||||
236 | informs_analytics_2022 | Operations Research & Analytics | INFORMS | 2022 | https://www.informs.org/Explore/Operations-Research-Analytics | |||||
237 | guresen_definition_2011 | Definition of Artificial Neural Networks with Comparison to Other Networks | Guresen, Erkam, and Gulgun Kayakutlu | Procedia Computer Science, World Conference on Information Technology | 3 | 2011 | https://doi.org/10.1016/j.procs.2010.12.071 | |||
238 | olson_pmlb_2017 | PMLB: A Large Benchmark Suite for Machine Learning Evaluation and Comparison. | Olson, Randal S., William La Cava, Patryk Orzechowski, Ryan J. Urbanowicz, and Jason H. Moore | BioData Mining | 10 | 1 | 2017 | https://doi.org/10.1186/s13040-017-0154-4 | ||
239 | devore_probability_2004 | Probability and Statistics for Engineering and the Sciences | Jay L. Devore | Book, Published by Thompson, Brooks/Cole, Sixth Edition | 2004 | |||||
240 | aggarwal_clustering_2013 | Data Clustering: Algorithms and Applications | Aggarwal, Charu C., and Chandan K. Reddy | Book, Published by Chapman & Hall/CRC, First Edition | 2013 | |||||
241 | techopedia_column_2022 | Database Column | Techopedia | 2022 | https://www.techopedia.com/definition/8/database-column#:~:text=In%20the%20context%20of%20relational,documents%20or%20even%20video%20clips. | |||||
242 | box_statistics_2005 | Statistics for Experimenters: Design, Innovation, and Discovery | George E. P. Box, J. Stuart Hunter, William G. Hunter | Book, Published by Wiley, Second Edition | 2005 | |||||
243 | james_statistical_2014 | An Introduction to Statistical Learning: With Applications in R | James, Gareth, Daniela Witten, Trevor Hastie, and Robert Tibshirani | Book, Published by Springer | 2014 | http://www-bcf.usc.edu/~gareth/ISL/ | ||||
244 | friedler_comparative_2019 | A Comparative Study of Fairness-Enhancing Interventions in Machine Learning | Friedler, Sorelle A., Carlos Scheidegger, Suresh Venkatasubramanian, Sonam Choudhary, Evan P. Hamilton, and Derek Roth | In Proceedings of the Conference on Fairness, Accountability, and Transparency | 2019 | https://doi.org/10.1145/3287560.3287589 | ||||
245 | gong_differential_2020 | A Survey on Differentially Private Machine Learning [Review Article]. | Gong, Maoguo, Yu Xie, Ke Pan, Kaiyuan Feng, and A.K. Qin | IEEE Computational Intelligence Magazine | 15 | 2 | 2020 | https://doi.org/10.1109/MCI.2020.2976185 | ||
246 | Bolukbasi_et_al_Debiasing_Word_Embeddings | Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings | Tolga Bolukbasi, Kai-Wei Chang, James Zou, Venkatesh Saligrama, and Adam Kalai | 30th Conference on Neural Information Processing Systems (NIPS 2016), Barcelona, Spain | 2016 | https://papers.nips.cc/paper/2016/file/a486cd07e4ac3d270571622f4f316ec5-Paper.pdf | ||||
247 | google_glossary_2023 | Machine Learning Glossary | 2023 | https://developers.google.com/machine-learning/glossary | ||||||
248 | wikipedia_graph_2023 | Graph (discrete mathematics) | Wikipedia | Wikipedia | 2023 | https://en.wikipedia.org/wiki/Graph_(discrete_mathematics)#Definitions | ||||
249 | Mark_Ciampa_2021 | Utilizing Threat Data and Intelligence | Mark Ciampa | CompTIA CySA+ Guide to Cybersecurity Analyst (CS0-002) | 2021 | https://www.google.com/books/edition/CompTIA_CySA+_Guide_to_Cybersecurity_Ana/NwpIEAAAQBAJ?hl=en&gbpv=1&dq=%22In+cybersecurity+a+threat+actor+is+a+term+used+to+describe+individuals+or+entities+who+are+responsible+for+cyber+incidents+against+enterprises+governments+and+users%22&pg=PA29&printsec=frontcover | ||||
250 | David_Lyon_2007 | Security, Suspicion, Social Sorting | David Lyon | Surveillance Studies: An Overview | 2007 | https://www.google.com/books/edition/Surveillance_Studies/_dTHJgh3-f0C?hl=en&gbpv=1&bsq=surveillance%20is | ||||
251 | Hartley_and_Zisserman_2003 | Projective Geometry and Transformations of 2D | Richard Hartley; Andrew Zisserman | Multiple View Geometry in Computer Vision | 2003 | https://www.google.com/books/edition/Multiple_View_Geometry_in_Computer_Visio/si3R3Pfa98QC?hl=en&gbpv=1&dq=%22Projection+along+rays+through+a+common+point+the+centre+of+pro+jection+defines+a+mapping+from+one+plane+to+another%22&pg=PA34&printsec=frontcover | ||||
252 | Sloane_et_al_2020 | Participation is not a Design Fix for Machine Learning | Mona Sloane, Emanuel Moss, Olaitan Awomolo, Laura Forlano | Proceedings of the 37th International Conference on Machine Learning, PMLR | 2020 | https://arxiv.org/ftp/arxiv/papers/2007/2007.02423.pdf | ||||
253 | NIST_CSRC_parity | parity | NIST Computer Security Resource Center | NIST Computer Security Resource Center | https://csrc.nist.gov/glossary/term/parity | |||||
254 | Dennis_Mercadal | L | Dennis Mercadal | Dictionary of Artificial Intelligence | 1990 | https://archive.org/details/dictionaryofarti0000merc/page/162/mode/2up?view=theater | ||||
255 | Ekaterina_et_al_2020 | Why Are We Averse towards Algorithms? A Comprehensive Literature Review on Algorithmic Aversion | Ekaterina Jussupow, Izak Benbasat, and Armin Heinzl | Proceedings of the 28th European Conference on Information Systems (ECIS), An Online AIS Conference | 2020 | https://aisel.aisnet.org/ecis2020_rp/168/ | ||||
256 | Gabriel_2020 | Artificial Intelligence, Values, and Alignment | Iason Gabriel | Minds and Machines | 30 | 2020 | https://link.springer.com/article/10.1007/s11023-020-09539-2 | |||
257 | nist_800_2010 | A Statistical Test Suite for Random and Pseudorandom Number Generators for Cryptographic Applications. | Rukhin, Andrew, Juan Soto, James Nechvatal, Miles Smid, Elaine Barker, Stefan Leigh, Mark Levenson, et al. | NIST SP-800-22ra | 2010 | https://doi.org/10.6028/NIST.SP.800-22r1a | ||||
258 | iso_2382_1997 | Information technology — Vocabulary — Part 31: Artificial intelligence — Machine learning | ISO | ISO/IEC 2382-31 | 1997 | |||||
259 | iso_22989_2022 | Information technology — Artificial intelligence — Artificial intelligence concepts and terminology | ISO | ISO/IEC 22989 | 2022 | https://www.iso.org/standard/74296.html | ||||
260 | european_ethics_2019 | Ethics Guidelines for Trustworthy AI | High-Level Expert Group on Artificial Intelligence | Draft Report | 2019 | https://ec.europa.eu/futurium/en/ai-alliance-consultation.1.html | ||||
261 | Friedman_et_al_2017 | A Survey of Value Sensitive Design Methods | Batya Friedman, David G. Hendry, and Alan Borning | Foundations and Trends® in Human–Computer Interaction | 2017 | https://www.nowpublishers.com/article/Details/HCI-015 | ||||
262 | Bipartisan_Policy_Center_impact_assessments | Explainer: Impact Assessments for Artificial Intelligence | Sean Long, Jeremy Pesner, and Tom Romanoff | Bipartisan Policy Center | 2022 | https://bipartisanpolicy.org/blog/impact-assessments-for-ai/ | ||||
263 | Kimiz_Dalkir_2011 | The Value of Knowledge Management | Kimiz Dalkir | Knowledge Management in Theory and Practice | 2011 | https://www.google.com/books/edition/Knowledge_Management_in_Theory_and_Pract/_MrxCwAAQBAJ?hl=en&gbpv=1&dq=%22Qualitative+measures+provide+more+context+and+details+about+the+value+e+g+perceptions+which+are+often+difficult+to+measure+quantitatively%22&pg=PA343&printsec=frontcover | ||||
264 | Cost_Management_ch2 | Basic Cost Management Concepts | Don R. Hansen; Maryanne M. Mowen; Dan L. Heitger | Cost Management | 2021 | https://www.google.com/books/edition/Cost_Management/HhQcEAAAQBAJ?hl=en&gbpv=1&dq=%22Qualitative+measurement+implies+the+use+of+data+expressed+in+categories+such+as+customer+reviews+of+new+model+jet+skis%22&pg=PA38&printsec=frontcover | ||||
265 | Virginia_Dignum_Responsibility_and_Artificial_Intelligence | Responsibility and Artificial Intelligence | Virginia Dignum | The Oxford Handbook of Ethics of AI | 215-232 | 2020 | https://www.google.com/books/edition/The_Oxford_Handbook_of_Ethics_of_AI/8PQTEAAAQBAJ?hl=en&gbpv=1&dq=%22Understanding+the+values+behind+the+technology+and+deciding+on+how+we+want+our+values+to+be+incorporated+in+AI+systems+requires+that+we+are+also+able+to+decide+on+how+and+what+we+want+AI+to+mean+in+our+societies%22&pg=PA221&printsec=frontcover | |||
266 | yeom_avoiding_2021 | Avoiding Disparity Amplification under Different Worldviews | Yeom, Samuel, and Michael Carl Tschantz | FAccT 2021: In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency | 273-283 | 2021 | https://doi.org/10.1145/3442188.3445892 | |||
267 | Merriam-Webster_context | context | Merriam-Webster | Merriam-Webster Dictionary | https://www.merriam-webster.com/dictionary/context | |||||
268 | jacobs_measurement_2023 | Measurement and Fairness | Jacobs, Abigail Z., and Hanna Wallach | FAccT 2021: In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency | 2021 | https://doi.org/10.1145/3442188.3445901 | ||||
269 | Merriam-Webster_impact | impact | Merriam-Webster | Merriam-Webster | https://www.merriam-webster.com/dictionary/impact | |||||
270 | Lisa_M._Given_SAGE | M: Mixed Methods Research | Lisa M. Given | The SAGE Encyclopedia of Qualitative Research Methods | 491-538 | 2008 | https://www.google.com/books/edition/The_SAGE_Encyclopedia_of_Qualitative_Res/byh1AwAAQBAJ?hl=en&gbpv=1&dq=Mixed+methods+is+defined+as+research+in+which+the+inquirer+or+investigator+collects+and+analyzes+data,+integrates+the+findings,+and+draws+inferences+using+both+qualitative+and+quantitative+approaches+or+methods+in+a+single+study+or+a+program+of+study.&pg=PT584&printsec=frontcover | |||
271 | NIST_AI_RMF_1.0 | NIST AI RMF 1.0 | NIST | NIST AI RMF 1.0 | 2023 | https://nvlpubs.nist.gov/nistpubs/ai/NIST.AI.100-1.pdf | ||||
272 | 45_CFR_46_2018_Requirements_(2018_Common_Rule) | 2018 Requirements (2018 Common Rule) | United States Department of Health and Human Services (HHS) | 45 CFR 46 | 2018 | https://www.hhs.gov/ohrp/regulations-and-policy/regulations/45-cfr-46/revised-common-rule-regulatory-text/index.html | ||||
273 | cambridge_causative_2023 | Cambridge Dictionary: causative | Cambridge | Cambridge Dictionary | 2023 | https://dictionary.cambridge.org/us/dictionary/english/causative | ||||
274 | lyons_contestability_2021 | Conceptualising Contestability: Perspectives on Contesting Algorithmic Decisions | Lyons, Henrietta, Eduardo Velloso, and Tim Miller | Proceedings of the ACM on Human-Computer Interaction | 2021 | https://doi.org/10.1145/3449180 | ||||
275 | cambridge_contestable_2023 | Contestable | Cambridge Dictionary | 2023 | https://dictionary.cambridge.org/us/dictionary/english/contestable | |||||
276 | Saleh_Alkhalifa_ML_in_Biotech | Supervised Machine Learning | Saleh Alkhalifa | Machine Learning in Biotechnology and Life Sciences: Build Machine Learning Models Using Python and Deploy Them on the Cloud | 168-233 | 2022 | https://www.google.com/books/edition/Machine_Learning_in_Biotechnology_and_Li/KUVWEAAAQBAJ?hl=en&gbpv=1&dq=%22We+can+define+supervised+learning+as+a+general+subset+of+machine+learning+in+which+data+like+its+associated+labels+is+used+to+train+models+that+can+learn+or+generalize+from+the+data+to+make+predictions+preferably+with+a+high+degree+of+certainty%22&pg=PA168&printsec=frontcover | |||
277 | Schneider_McGrew_in_Flanagan_McDonough_2018 | The Cattell-Horn-Carroll Theory of Cognitive Abilities | W. Joel Schneider and Kevin S. McGrew; edited by Dawn P. Flanagan and Erin M. McDonough | Contemporary Intellectual Assessment: Theories, Tests, and Issues | 73-163 | 2018 | https://www.google.com/books/edition/Contemporary_Intellectual_Assessment/JA1mDwAAQBAJ?hl=en&gbpv=1&dq=%22Formal+expertise+is+the+result+of+a+selfselection+of+a+domain+of+knowledge+that+is+mastered+deliberately+and+for+which+there+are+clear+benchmarks+of+success+Fisher+Keil+2016%22&pg=PA117&printsec=frontcover | |||
278 | Little_2013 | The Measurement Model | Todd D. Little | Longitudinal Structural Equation Modeling | 71-105 | 2013 | https://www.google.com/books/edition/Longitudinal_Structural_Equation_Modelin/gzeCu3FjZf4C?hl=en&gbpv=1&dq=%22Measurement+model%22&pg=PA103&printsec=frontcover | |||
279 | Merriam-Webster_executive | executive | Merriam-Webster | Merriam-Webster Dictionary | https://www.merriam-webster.com/dictionary/executive | |||||
280 | Dorf_2018 | Measurement and Instrumentation | Richard C. Dorf | The Engineering Handbook | 151-160 | 2018 | https://www.google.com/books/edition/The_Engineering_Handbook/l_TLBQAAQBAJ?hl=en&gbpv=1&dq=%22The+propagation+of+uncertainty+is+defined+as+the+way+in+which+uncertainties+in+the+variables+affect+the+uncertainty+in+the+calculated+results%22&pg=SA99-PA711&printsec=frontcover | |||
281 | Merriam-Webster_example | example | Merriam-Webster | Merriam-Webster Dictionary | https://www.merriam-webster.com/dictionary/example | |||||
282 | Merriam-Webster_ethic | ethic | Merriam-Webster | Merriam-Webster Dictionary | https://www.merriam-webster.com/dictionary/ethic | |||||
283 | Merriam-Webster_anthropomorphism | anthropomorphism | Merriam-Webster | Merriam-Webster Dictionary | https://www.merriam-webster.com/dictionary/anthropomorphism | |||||
284 | berthold_guide_2020 | Guide to Intelligent Data Science: How to Intelligently Make Use of Real Data | Berthold, Michael R., Christian Borgelt, Frank Höppner, Frank Klawonn, and Rosaria Silipo | Springer International Publishing | 2020 | https://doi.org/10.1007/978-3-030-45574-3 | ||||
285 | alon-barkat_human_2023 | Human–AI Interactions in Public Sector Decision Making: ‘Automation Bias’ and ‘Selective Adherence’ to Algorithmic Advice. | Alon-Barkat, Saar, and Madalina Busuioc | Journal of Public Administration Research and Theory | 33 | 1 | 153–169 | 2023 | https://doi.org/10.1093/jopart/muac007 | |
286 | humphrey_addressing_2020 | Addressing Harmful Bias and Eliminating Discrimination in Health Professions Learning Environments: An Urgent Challenge. | Humphrey, Holly J., Dana Levinson, Marc A. Nivet, and Stephen C. Schoenbaum | Academic Medicine | 95 | 12S | 2020 | https://doi.org/10.1097/ACM.0000000000003679 | ||
287 | knuth_art_1981 | The Art of Computer Programming, Volume 2: Seminumerical Algorithms | Donald Knuth | Addison-Wesley | 2 | 1981 | ||||
288 | garey_computers_1979 | Computers and Intractability: A Guide to the Theory of NP-Completeness | Michael Garey and David Johnson | W. H. Freeman | 1979 | |||||
289 | cambridge_impact_2023 | Impact | Cambridge Dictionary | 2023 | https://dictionary.cambridge.org/us/dictionary/english/impact | |||||
290 | law_policy_2023 | Policy | The Law Dictionary | 2023 | https://thelawdictionary.org/policy/#:~:text=Definition%20%26%20Citations%3A,as%20directed%20to%20the%20POLICY | |||||
291 | fernandez_residual_1992 | Residual Analysis and Data Transformations: Important Tools in Statistical Analysis | Fernandez, George C. J. | HortScience | 27 | 4 | 297–300 | 1992 | https://journals.ashs.org/hortsci/view/journals/hortsci/27/4/article-p297.xml | |
292 | Leavy_OHQR_Intro | Introduction | Patricia Leavy | The Oxford Handbook of Qualitative Research | 1-13 | 2014 | https://academic.oup.com/edited-volume/38166/chapter-abstract/332997092?redirectedFrom=fulltext | |||
293 | Barbour_2014 | The scope and contribution of qualitative research | Rosaline S. Barbour | Introducing Qualitative Research: A Student's Guide, Second Edition | 11-27 | 2008; 2014 | https://archive.org/details/introducingquali0000barb_j9h1/page/12/mode/2up?view=theater | |||
294 | Merriam-Webster_engineer | engineer | Merriam-Webster | Merriam-Webster Dictionary | https://www.merriam-webster.com/dictionary/engineer | |||||
295 | AI_Incident_Editors | Editor's Guide | AI Incident Database | AI Incident Database | 2023 | https://incidentdatabase.ai/editors-guide/ | ||||
296 | interaction_context_2023 | Context of Use | Interaction Design: The Glossary of Human Computer Interaction | Interaction Design Foundation | 2023 | https://www.interaction-design.org/literature/book/the-glossary-of-human-computer-interaction/context-of-use | ||||
297 | AAAS_AI_and_Bias_2022-09 | Artificial Intelligence and Bias – An Evaluation | M. Karanicolas and M. Knodel | Artificial Intelligence and the Courts: Materials for Judges | 2022 | https://doi.org/10.1126/aaas.adf0788 | ||||
298 | Seth_Boden_2020 | Start Here: A Primer on Diversity and Inclusion (Part 1 of 2) | Seth Boden | Harvard Business Publishing | 2020 | https://www.harvardbusiness.org/start-here-a-primer-on-diversity-and-inclusion-part-1-of-2/ | ||||
299 | GWU_diversity_and_inclusion | Diversity and Inclusion Defined | George Washington University | George Washington University Office for Diversity, Equity and Community Engagement | https://diversity.gwu.edu/diversity-and-inclusion-defined | |||||
300 | HUD_diversity_and_inclusion | Diversity and Inclusion Definitions | U.S. Department of Housing and Urban Development | U.S. Department of Housing and Urban Development | https://www.hud.gov/program_offices/administration/admabout/diversity_inclusion/definitions | |||||
301 | Jamieson_Govaart_Pownall | Reflexivity in quantitative research: A rationale and beginner's guide | Michelle K. Jamieson, Gisela H. Govaart, and Madeleine Pownall | Social and Personality Psychology Compass | e12735 | 2023 | https://doi.org/10.1111/spc3.12735 | |||
302 | Industrial_Network_Security_2011 | Monitoring Enclaves | Eric D. Knapp and Joel Langill | Industrial Network Security: Securing Critical Infrastructure Networks for Smart Grid, SCADA, and Other Industrial Control Systems | 2011 | https://www.google.com/books/edition/Industrial_Network_Security/PlOtqouTwaUC?hl=en&gbpv=1&dq=%22Data+retention+refers+to+the+amount+of+information+that+is+stored+long-term,+and+can+be+measured+in+volume+(the+size+of+the+total+collected+logs+in+bytes)+and+time+(the+number+of+months+or+years+that+logs+are+stored+for).%22&pg=PA243&printsec=frontcover | ||||
303 | ChatGPT | ChatGPT | OpenAI | https://chat.openai.com/chat | ||||||
304 | Merriam-Webster_parity | Parity | Merriam-Webster Dictionary | 2023 | https://www.merriam-webster.com/dictionary/parity | |||||
305 | barredo_explainable_2020 | Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI | Barredo Arrieta, Alejandro, Natalia Díaz-Rodríguez, Javier Del Ser, Adrien Bennetot, Siham Tabik, Alberto Barbado, Salvador Garcia, et al. | Information Fusion | 58 | 82–115 | 2020 | https://doi.org/10.1016/j.inffus.2019.12.012 | ||
306 | jackman_oxford_2008 | Measurement | Simon Jackman | The Oxford Handbook of Political Methodology | 2008 | |||||
307 | Hammarberg_2016_Busetto_2020 | 1. Qualitative research methods: when to use them and how to judge them; 2. How to use and assess qualitative research methods | 1. K. Hammarberg, M. Kirkman, and S. de Lacey; 2. Loraine Busetto, Wolfgang Wick, and Christoph Gumbinger | 1. Human Reproduction; 2. Neurological Research and Practice | 1. 31 | 1. 3; 2. 14 | 1. 2016; 2. 2020 | 1. https://academic.oup.com/humrep/article/31/3/498/2384737; 2. https://neurolrespract.biomedcentral.com/articles/10.1186/s42466-020-00059-z | ||
308 | Russell_2003_Brannen_2005 | 1. Evaluation of qualitative research studies; 2. Mixing Methods: The Entry of Qualitative and Quantitative Approaches into the Research Process | 1. Cynthia K. Russell and David M. Gregory; 2. Julia Brannen | 1. Evidence-Based Nursing; 2. International Journal of Social Research Methodology | 1. 6; 2. 8 | 2. 8 | 1. 36-40; 2. 173-184 | 1. 2003; 2. 2007 | 1. http://dx.doi.org/10.1136/ebn.6.2.36; 2. https://www.tandfonline.com/doi/full/10.1080/13645570500154642 | |
309 | Pamela_Goh_2021 | Humans as the Weakest Link in Maintaining Cybersecurity: Building Cyber Resilience in Humans | Pamela Goh. Edited by Majeed Khader, Loo Seng Neo, and Whistine Xiau Ting Chai | Introduction to Cyber Forensic Psychology: Understanding the Mind of the Cyber Deviant Perpetrators | 287-305 | 2021 | https://www.worldscientific.com/doi/abs/10.1142/9789811232411_0014 | |||
310 | Annie_Jacobsen_2015 | Total Information Awareness | Annie Jacobsen | The Pentagon's Brain: An Uncensored History of DARPA, America's Top-Secret Military Research Agency | 336-352 | 2015 | https://archive.org/details/pentagonsbrainun0000jaco_c8o3/page/342/mode/2up?q=%22a+role-playing+exercise+in+which+a+problem+is+examined+from+an+adversary%E2%80%99s+or+enemy%E2%80%99s+perspective.%22 | |||
311 | Ben_Auffarth_2021 | Online Learning for Time-Series | Ben Auffarth | Machine Learning for Time-Series with Python: Forecast, Predict, and Detect Anomalies with State-of-the-art Machine Learning Methods | 209-259 | 2021 | https://www.google.com/books/edition/Machine_Learning_for_Time_Series_with_Py/a7tLEAAAQBAJ?hl=en&gbpv=1&dq=%22On+the+other+hand+offline+learning+the+more+commonly+known+approach+implies+that+you+have+a+static+dataset+that+you+know+from+the+start+and+the+parameters+of+your+machine+learning+algorithm+are+adjusted+to+the+whole+dataset+at+once+often+loading+the+whole+dataset+into+memory+or+in+batches%22&pg=PA210&printsec=frontcover | |||
312 | FWS_062_FW_1 | 062 FW 1, Affirmative Employment Program and Plans | Office for Human Resources of the U.S. Fish & Wildlife Service | U.S. Fish & Wildlife Service | 1996 | https://www.fws.gov/policy/062fw1.html | ||||
313 | Merriam-Webster_assessment | assessment | Merriam-Webster | Merriam-Webster Dictionary | https://www.merriam-webster.com/dictionary/assessment | |||||
314 | Anthropomorphism_in_AI_2020 | anthropomorphism | Arleen Salles, Kathinka Evers, and Michele Farisco | AJOB Neuroscience | 2 | 88-95 | 2020 | https://doi.org/10.1080/21507740.2020.1740350 | ||
315 | OECD_Artificial_Intelligence_in_Society | The technical landscape | OECD | Artificial Intelligence in Society | 19-34 | 2019 | https://www.google.com/books/edition/Artificial_Intelligence_in_Society/eRmdDwAAQBAJ?hl=en&gbpv=1&dq=%22Artificial+narrow+intelligence+ANI+or+applied+AI+is+designed+to+accomplish+a+specific+problem+solving+or+reasoning+task%22&pg=PA22&printsec=frontcover | |||
316 | AI_in_Medical_Imaging_glossary | Glossary | Erik R. Ranschaert, Sergey Morozov, and Paul R. Algra, eds. | Artificial Intelligence in Medical Imaging: Opportunities, Applications and Risks | 349-364 | 2019 | https://www.google.com/books/edition/Artificial_Intelligence_in_Medical_Imagi/ss6FDwAAQBAJ?hl=en&gbpv=1&dq=%22The+definition+of+artificial+narrow+intelligence+is+in+contrast+to+that+of+strong+AI+or+artificial+general+intelligence+which+aims+at+providing+a+system+with+consciousness+or+the+ability+to+solve+any+problems%22&pg=PA350&printsec=frontcover | |||
317 | DOL_Practical_Significance | Practical Significance in EEO Analysis Frequently Asked Questions | U.S. Department of Labor Office of Federal Contract Compliance Programs | U.S. Department of Labor Office of Federal Contract Compliance Programs | 2021 | https://www.dol.gov/agencies/ofccp/faqs/practical-significance | ||||
318 | Cambridge_Dictionary_non-discrimination | non-discrimination | Cambridge Dictionary | Cambridge Dictionary | https://dictionary.cambridge.org/us/dictionary/english/non-discrimination | |||||
319 | Signal_Detection_Theory | Signal Detection Theory | N.A. Macmillan | International Encyclopedia of the Social & Behavioral Sciences | 14075-14078 | 2001 | https://doi.org/10.1016/B0-08-043076-7/00677-X | |||
320 | Techopedia_kill_switch | Kill Switch | Techopedia | Techopedia | 2019 | https://www.techopedia.com/definition/4001/kill-switch | ||||
321 | Batya_Friedman_VSD_Introduction | Introduction | Batya Friedman and David G. Hendry | Value Sensitive Design: Shaping Technology with Moral Imagination | 1-17 | 2019 | https://doi-org.proxy.library.georgetown.edu/10.7551/mitpress/7585.003.0002 | |||
322 | C3.ai_feedback_loop | What Is a Feedback Loop? | C3.ai | C3.ai | https://c3.ai/glossary/features/feedback-loop/ | |||||
323 | Collins_Dictionary_ground_truth | ground truth | Collins Dictionary | Collins Dictionary | https://www.collinsdictionary.com/us/dictionary/english/ground-truth | |||||
324 | Wikipedia_Decision-making | Decision-making | Wikipedia | Wikipedia | https://en.wikipedia.org/wiki/Decision-making | |||||
325 | Shevlin_et_al_2019 | The limits of machine intelligence | Henry Shevlin, Karina Vold, Matthew Crosby, and Marta Halina | EMBO Reports | 20 | 10 | e49177 | 2019 | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6776890/ | |
326 | EEOC_ADA_AI | The Americans with Disabilities Act and the Use of Software, Algorithms, and Artificial Intelligence to Assess Job Applicants and Employees | U.S. Equal Employment Opportunity Commission | U.S. Equal Employment Opportunity Commission | 2022 | https://www.eeoc.gov/laws/guidance/americans-disabilities-act-and-use-software-algorithms-and-artificial-intelligence | ||||
327 | Merriam-Webster_screen_out | screen out | Merriam-Webster | Merriam-Webster Dictionary | https://www.merriam-webster.com/dictionary/screen%20out | |||||
328 | apa_experiment_2023 | experiment | American Psychological Association (APA) | APA Dictionary of Psychology | 2023 | https://dictionary.apa.org/experiment | ||||
329 | APA_DoP_laboratory_research | laboratory research | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/laboratory-research | |||||
330 | UNODC_Glossary_QA_GLP | Glossary of Terms for Quality Assurance and Good Laboratory Practices | Laboratory and Scientific Section of the United Nations Office on Drugs and Crime | Glossary of Terms for Quality Assurance and Good Laboratory Practices | 2009 | https://www.unodc.org/documents/scientific/ST_NAR_26_E.pdf | ||||
331 | World_Wide_Words_In_silico | In silico | World Wide Words | World Wide Words | http://www.worldwidewords.org/weirdwords/ww-ins1.htm | |||||
332 | Bassiouni_Baffes_Evrard | An Appraisal of Human Experimentation in International Law and Practice: The Need for International Regulation of Human Experimentation | M. Cheriff Bassiouni, Thomas G. Baffes, and John T. Evrard | Journal of Criminal Law and Criminology | 72 | 4 | 1597-1666 | 1981 | https://scholarlycommons.law.northwestern.edu/cgi/viewcontent.cgi?article=6276&context=jclc | |
333 | Merriam-Webster_amplify | amplify | Merriam-Webster | Merriam-Webster Dictionary | https://www.merriam-webster.com/dictionary/amplify | |||||
334 | Gupta_et_al_HAR_2022 | Human activity recognition in artificial intelligence framework: a narrative review | Neha Gupta, Suneet K. Gupta, Rajesh K. Pathak, Vanita Jain, Parisa Rashidi, and Jasjit S. Suri | Artificial Intelligence Review | 55 | 4755–4808 | 2022 | https://link.springer.com/article/10.1007/s10462-021-10116-x | ||
335 | Merriam-Webster_annotate | annotate | Merriam-Webster | Merriam-Webster Dictionary | https://www.merriam-webster.com/dictionary/annotate | |||||
336 | Freeman_et_al_2014 | Active learning increases student performance in science, engineering, and mathematics | Scott Freeman, Sarah L. Eddy, Miles McDonough, Michelle K. Smith, Nnadozie Okoroafor, Hannah Jordt, and Mary Pat Wenderoth | PNAS | 111 | 23 | 8410-8415 | 2014 | https://www.pnas.org/doi/full/10.1073/pnas.1319030111 | |
337 | AI_Assurance_2022 | Assuring AI methods for economic policymaking | Anderson Monken, William Ampeh, Flora Haberkorn, Uma Krishnaswamy, and Feras A. Batarseh | AI Assurance: Towards Trustworthy, Explainable, Safe, and Ethical AI | 371-428 | 2022 | https://www.google.com/books/edition/AI_Assurance/dch6EAAAQBAJ?hl=en&gbpv=1&dq=%22Large+language+models+LLMs+are+a+class+of+language+models+that+use+deep+learning+algorithms+and+are+trained+on+extremely+large+textual+datasets+that+can+be+multiple+terabytes+in+size%22&pg=PA376&printsec=frontcover | |||
338 | Poore_Lawrence_ARLIS_2023-01 | AI Engineering: An Academic Research Roadmap | Joshua Poore and Craig Lawrence | Applied Research Laboratory for Intelligence and Security (ARLIS) | 2023 | |||||
339 | Survey_of_Hallucination_in_NLG | Survey of Hallucination in Natural Language Generation | Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Ye Jin Bang, Andrea Madotto, and Pascale Fung | ACM Computing Surveys | 55 | 12 | 1-38 | 2023 | https://dl.acm.org/doi/10.1145/3571730 | |
340 | APA_clustering | clustering | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/clustering | |||||
341 | APA_content_validity | content validity | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/content-validity | |||||
342 | ISO_9241-11:2018 | ISO 9241-11:2018(en) Ergonomics of human-system interaction — Part 11: Usability: Definitions and concepts | ISO | ISO Online Browsing Platform | 2018 | https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-2:v1:en | ||||
343 | APA_criterion_validity | criterion validity | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/criterion-validity | |||||
344 | APA_data_analysis | data analysis | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/data-analysis | |||||
345 | APA_decision_making | decision making | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/decision-making | |||||
346 | Lehto_Nanda_2021 | Decision-Making Models, Decision Support, and Problem Solving | Mark R. Lehto and Gaurav Nanda | Handbook of Human Factors and Ergonomics, Fifth Edition | 159-202 | 2021 | https://www.wiley.com/en-us/Handbook+of+Human+Factors+and+Ergonomics%2C+5th+Edition-p-9781119636083 | |||
347 | Baron_Thinking_and_Deciding | Jonathan Baron | Thinking and Deciding | 2008 | ||||||
348 | EO_DEIA_2021 | Executive Order on Diversity, Equity, Inclusion, and Accessibility in the Federal Workforce | Joseph R. Biden Jr. | The White House | 2021 | https://www.whitehouse.gov/briefing-room/presidential-actions/2021/06/25/executive-order-on-diversity-equity-inclusion-and-accessibility-in-the-federal-workforce/ | ||||
349 | APA_ethics | ethics | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/ethics | |||||
350 | APA_external_validity | external validity | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/external-validity | |||||
351 | CSRC_false_negative | False Negative | NIST CSRC | Information Technology Laboratory Computer Security Resource Center Glossary | https://csrc.nist.gov/glossary/term/false_negative | |||||
352 | CSRC_false_positive | False Positive | NIST CSRC | Information Technology Laboratory Computer Security Resource Center Glossary | https://csrc.nist.gov/glossary/term/false_positive | |||||
353 | Wilke_Mata_2012 | Cognitive Bias | A. Wilke and R. Mata | Encyclopedia of Human Behavior | 1 | 531-535 | 2012 | https://s3.amazonaws.com/arena-attachments/557491/b16d97da35ed37a0a022e806cc931a0d.pdf | ||
354 | AIID_incident_response | Defining an "AI Incident Response" | Sean McGregor | Artificial Intelligence Incident Database | https://incidentdatabase.ai/research/5-response/ | |||||
355 | APA_integrity | integrity | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/integrity | |||||
356 | APA_internal_validity | internal validity | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/internal-validity | |||||
357 | APA_learning | learning | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/learning | |||||
358 | McNamara_Fallacy | The McNamara Fallacy | Jonathan Cook | The McNamara Fallacy | 2023 | https://mcnamarafallacy.com/ | ||||
359 | Creswell_Clark_mixed_methods | John W. Creswell and Vicki L. Plano Clark | Designing and Conducting Mixed Methods Research, Third Edition | 2017 | ||||||
360 | APA_observation | observation | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/observation | |||||
361 | Glossary_of_Statistical_Terms | Glossary of Statistical Terms | Philip B. Stark | SticiGui | 2019 | https://www.stat.berkeley.edu/~stark/SticiGui/Text/gloss.htm | ||||
362 | Wikipedia_RMSD | Root-mean-square-deviation | Wikipedia | Wikipedia | https://en.wikipedia.org/wiki/Root-mean-square_deviation | |||||
363 | APA_recognition | recognition | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/recognition | |||||
364 | APA_recall | recall | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/recall | |||||
365 | APA_stereotype | stereotype | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/stereotype | |||||
366 | Augoustinos_Walker_1998 | The Construction of Stereotypes within Social Psychology: From Social Cognition to Ideology | Martha Augoustinos and Iain Walker | Theory & Psychology | 8 | 5 | 629-652 | 1998 | https://doi.org/10.1177/0959354398085003 | |
367 | APA_autonomy | autonomy | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/autonomy | |||||
368 | Charmaz_Henwood | Grounded Theory Methods for Qualitative Psychology | Kathy Charmaz and Karen Henwood | The SAGE Handbook of Qualitative Research in Psychology | 238-255 | 2017 | https://doi.org/10.4135/9781526405555 | |||
369 | APA_reflexivity | reflexivity | American Psychological Association (APA) | APA Dictionary of Psychology | https://dictionary.apa.org/reflexivity | |||||
370 | Lee_See_2004 | Trust in Automation: Designing for Appropriate Reliance | John D. Lee and Katrina A. See | Human Factors: The Journal of the Human Factors and Ergonomics Society | 46 | 1 | 50-80 | 2004 | https://doi.org/10.1518/hfes.46.1.50_30392 | |
371 | Mayer_Davis_Schoorman_1995 | An Integrative Model of Organizational Trust | Roger C. Mayer, James H. Davis, and F. David Schoorman | The Academy of Management Review | 20 | 3 | 709-734 | 1995 | https://doi.org/10.2307/258792 | |
372 | NISTIR_8280 | NISTIR 8280. Face Recognition Vendor Test (FRVT). Part 3: Demographic Effects | Patrick Grother, Mei Ngan, and Kayee Hanaoka | NIST | 2019 | https://nvlpubs.nist.gov/nistpubs/ir/2019/NIST.IR.8280.pdf | ||||
373 | Usabilitygov | Usability Testing | Usability.gov | Usabillity.gov | https://www.usability.gov/how-to-and-tools/methods/usability-testing.html | |||||
374 | Encyclopedia.com_underrepresentation | Underrepresentation | Encyclopedia.com | Encyclopedia.com | https://www.encyclopedia.com/social-sciences/applied-and-social-sciences-magazines/underrepresentation | |||||
375 | Arham_Islam_History_2023 | A History of Generative AI: From GAN to GPT-4 | Arham Islam | MarkTechPost | 2023 | https://www.marktechpost.com/2023/03/21/a-history-of-generative-ai-from-gan-to-gpt-4/ | ||||
376 | McKinsey_generative_AI | What is generative AI? | McKinsey & Company | McKinsey & Company | 2023 | https://www.mckinsey.com/featured-insights/mckinsey-explainers/what-is-generative-ai | ||||
377 | Seshia_et_al_2022 | Toward Verified Artificial Intelligence | Sanjit A. Seshia, Dorsa Sadigh, and S. Shankar Sastry | Communications of the ACM | 65 | 7 | 46-55 | 2022 | https://cacm.acm.org/magazines/2022/7/262079-toward-verified-artificial-intelligence/fulltext | |
378 | Liam_Tung_2022_Meta_hallucination | Meta warns its new chatbot may forget that it's a bot | Liam Tung | ZDNet | 2022 | https://www.zdnet.com/article/meta-warns-its-new-chatbot-may-not-tell-you-the-truth/ | ||||
379 | Merriam-Webster_requirement | requirement | Merriam-Webster | Merriam-Webster Dictionary | https://www.merriam-webster.com/dictionary/requirement | |||||
380 | TTC6_Taxonomy_Terminology | EU-U.S. Terminology and Taxonomy for Artificial Intelligence - Second Edition | EU-US Trade and Technology Council (TTC) Working Group 1 (WG1) |