AI Glossary
A
A/B Testing
A/B testing, also known as split testing or bucket testing, is a statistical method of comparing two versions of a single variable to determine which performs better. It involves randomly dividing a population into two groups, exposing one to a...
Accelerator
An accelerator is a specialized hardware or software component designed to enhance the performance of artificial intelligence tasks by optimizing computationally intensive operations. These devices are engineered to handle the massive parallel computations required by AI algorithms, such as matrix...
Actionable Intelligence
Actionable intelligence refers to information that has been processed and analyzed to the point where it can be directly applied to strategic decision-making processes and activities. Unlike raw data, which consists of unprocessed facts and figures, actionable intelligence provides valuable...
Activation Function
An activation function is a mathematical operation applied to the output of a neuron in a neural network that determines whether and to what extent that signal should be passed forward to subsequent layers. By introducing non-linearity into the network,...
Active Learning (Active Learning Strategy)
Active learning is a specialized machine learning strategy in which the algorithm proactively queries a human annotator to label specific, selected inputs rather than relying on a pre-existing, fully labeled dataset. Unlike traditional supervised learning where all training data is...
AGI (Artificial General Intelligence)
Artificial General Intelligence (AGI) is a theoretical form of artificial intelligence characterized by the ability to understand, learn, and apply knowledge across a wide variety of tasks and domains, mirroring the versatility of human cognition. Unlike specialized systems designed for...
AI Ethics
AI ethics is the field of study that examines the moral implications of artificial intelligence systems and establishes principles to guide their development and deployment. It focuses on ensuring that AI technologies align with human values, respect fundamental rights, and...
Algorithm
An algorithm is a finite sequence of well-defined instructions or rules designed to perform a specific task or solve a particular problem. In the context of artificial intelligence, these algorithms serve as the fundamental mechanisms that guide systems in processing...
Alignment
Alignment is the concept of ensuring that artificial intelligence systems behave in ways that correspond to human intentions, values, and goals. It involves designing, training, and deploying models so that their outputs and decisions reflect the outcomes deemed ethical and...
Anaphora
Anaphora is the linguistic phenomenon where a word or phrase, known as an anaphor, refers back to a previously mentioned entity, called the antecedent, within a text. In artificial intelligence and natural language processing, anaphora resolution is the computational task...
Area Under the Curve (AUC)
Area Under the Curve (AUC) is a performance measurement used to evaluate the predictive power of classification models, particularly in binary classification tasks. It quantifies the degree of separability between classes by calculating the area under the Receiver Operating Characteristic...
Artificial Intelligence (AI)
Artificial Intelligence (AI) is a branch of computer science dedicated to the creation of systems capable of performing tasks that typically require human intelligence. These systems utilize algorithms and models to analyze data, identify patterns, and make decisions or take...
Artificial Neural Networks
Artificial Neural Networks are computational models inspired by the biological neural networks of the human brain, designed to recognize complex patterns and relationships within data. They consist of interconnected processing units, or neurons, organized into layers that transform input signals...
ASI (Artificial Super Intelligence)
Artificial Super Intelligence (ASI) is a hypothetical form of artificial intelligence that possesses cognitive capabilities surpassing those of human beings across virtually all economically valuable domains. It represents a stage where machine intelligence is not merely comparable to human performance...
Association Rule Learning
Association Rule Learning is a machine learning method used to discover relationships among a set of items within large datasets. It identifies patterns where the presence of one item suggests the presence of another, often expressed as conditional rules such...
Auto-Classification
Auto-classification is the automated process of assigning predefined categories or labels to data items using machine learning algorithms. It enables systems to interpret, sort, and manage large volumes of information without requiring continuous human intervention. By recognizing underlying patterns within...
Auto-Complete
Auto-complete, also known as predictive text, is a feature that provides suggestions or predicts the rest of a word or phrase that a user has started typing. This function, embedded in numerous systems and devices such as search engines, messaging...
Autoencoders
Autoencoders are a class of artificial neural networks designed to learn efficient, compressed representations of data through unsupervised learning. By encoding input data into a lower-dimensional code and then decoding it back to the original format, these models aim to...
Automated Speech Recognition
Automated Speech Recognition, also known as Computer Speech Recognition, is a technology that converts spoken language into written text. It is a cross-disciplinary area within computer science and computational linguistics that focuses on creating strategies and technologies allowing computers to...
B
Back Propagation
Back propagation is a supervised learning algorithm used to train artificial neural networks by calculating the gradient of the loss function with respect to each weight in the network. It enables the network to learn from data by iteratively adjusting...
Backpropagation Through Time
Backpropagation through time is a gradient-based learning algorithm used to train recurrent neural networks by treating the temporal sequence of operations as a deep, unrolled feedforward network. It calculates the gradient of the loss function with respect to the network...
Batch
Batch is a fundamental technique in machine learning where a subset of training examples is processed together to compute an approximate gradient for updating model parameters. Instead of adjusting weights after every single data point, the algorithm accumulates errors across...
Bayes’s Theorem
Bayes’s Theorem is a fundamental mathematical formula in probability theory that describes how to update the probability of a hypothesis as more evidence or information becomes available. It provides a rigorous framework for reasoning under uncertainty by combining prior knowledge...
BERT
BERT, short for Bidirectional Encoder Representations from Transformers, is a neural network architecture designed for natural language processing that captures the context of words by considering both preceding and following words in a sentence. It achieves this by training on...
Bias
Bias refers to the presence of systematic errors or prejudices in the data, algorithms, or decision-making processes that can lead to unfair or inaccurate outcomes. These biases may arise from various sources, such as the data used to train AI...
Bias-Variance Tradeoff
The bias-variance tradeoff is a fundamental concept in machine learning that describes the relationship between a model's ability to capture underlying patterns in data and its sensitivity to noise within that data. It highlights the tension between two distinct sources...
Bounding Box
A bounding box is a rectangular region defined by coordinate pairs that localizes an object within a two-dimensional image or video frame. It serves as a fundamental geometric representation in computer vision, delineating the spatial extent of a target entity...
C
Cataphora
Cataphora is an anticipatory referencing mechanism in linguistics where a pronoun or other referring expression points forward to a specific word, phrase, or clause that appears later in the same sentence or discourse. This structure enables entities or concepts to...
Category Trees
Category trees are hierarchical structures used to organize information by grouping concepts or items into parent categories and child subcategories. This method provides a systematic representation of a domain, allowing for efficient navigation, retrieval, and management of complex datasets through...
Central Processing Unit (CPU)
The Central Processing Unit (CPU) is the primary component of a computer system responsible for executing instructions and performing calculations. It acts as the core processing engine, interpreting and carrying out the fundamental operations required for a computer to function....
Chain of Thought
Chain of Thought is a cognitive process in artificial intelligence where a system connects various pieces of information or ideas in a logical sequence to arrive at a conclusion or make informed decisions. This concept draws parallels with how human...
Chatbot
A chatbot is a software application designed to simulate human conversation through text-based or voice-based interfaces. It functions as a conversational agent that processes natural language inputs from users and generates appropriate responses to assist with tasks, provide information, or...
ChatGPT
ChatGPT is an advanced chatbot model developed by OpenAI that generates human-like text responses and engages in interactive conversations with users. It is built upon the GPT (Generative Pre-trained Transformer) architecture, leveraging deep learning techniques to understand and generate natural...
CLIP (Contrastive Language–Image Pretraining)
CLIP, which stands for Contrastive Language–Image Pretraining, is a cutting-edge model developed by OpenAI. The essence of CLIP lies in its ability to enable cross-modal understanding between images and text Unlike traditional models that focus on image or text separately,...
Clustering
Clustering is a data analysis technique used to group similar objects or data points together based on their features or characteristics. The essence of clustering lies in its ability to discover inherent patterns and structures in data and organize them...
Co-Occurrence
Co-Occurrence refers to the phenomenon where two or more items, events, or concepts appear together or in close proximity more often than would be expected by chance alone. The essence of co-occurrence lies in its ability to reveal relationships and...
Cognitive Map
A cognitive map is a mental representation or framework that individuals construct to organize and navigate their understanding of the physical or abstract world. It captures an individual's internalized knowledge, beliefs, and spatial relationships, serving as an internal model that...
Cold-Start
Cold-start refers to a situation or problem that arises when a system or model lacks sufficient data or information to make accurate predictions or recommendations for new or unseen instances. The essence of the cold-start problem lies in the difficulty...
Collaborative Filtering
Collaborative filtering is a recommendation technique that predicts a user’s interest in an item by aggregating the preferences of other users who have exhibited similar behavior or tastes. It operates on the assumption that past agreement between users indicates a...
Completions
Completions is a predictive technique that forecasts missing or upcoming data points by analyzing patterns and historical information. This method leverages available context to generate subsequent elements, providing significant insights that aid in decision-making processes across various domains. It is...
Composite AI
Composite AI is an architectural approach that integrates multiple distinct artificial intelligence technologies into a single, cohesive system to handle complex decision-making and problem-solving tasks. Rather than relying on a single model to perform all functions, this method assembles various...
Computational Linguistics
Computational linguistics is an interdisciplinary field that combines computer science and linguistics to enable computers to analyze, understand, and generate human language. It employs specialized algorithms and software to process natural language data, bridging the gap between human communication and...
Computational Semantics (Semantic Technology)
Computational semantics, also known as Semantic Technology, is a field of study that combines aspects of semantic theory, computer science, and artificial intelligence to develop automated systems that understand, interpret, and generate human language. It focuses on creating technologies that...
Computer Vision
Computer Vision is a specialized field of artificial intelligence that focuses on teaching machines to interpret and understand visual information from the world, much like how humans perceive and process visual stimuli. It involves developing algorithms and models that enable...
Confidence Interval
A confidence interval is a range of values derived from sample data that is likely to contain an unknown population parameter. In the context of artificial intelligence, it serves as a statistical measure to quantify the uncertainty associated with a...
Content Enrichment
Content Enrichment is the process of enhancing raw data with additional or relevant information to increase its value and render it more comprehensible, useful, and relevant for users or systems. It addresses the inherent lack of context, insight, or depth...
Contributor
A contributor is an individual who actively participates in the development, refinement, or implementation of artificial intelligence systems. This role encompasses a spectrum of activities, ranging from designing novel algorithms and engineering model architectures to managing project workflows and maintaining...
Controlled Vocabulary
A controlled vocabulary is a curated list of terms used to describe content within a specific domain, designed to standardize how information is indexed and retrieved. It manages lexical variations and semantic similarities by mapping different words or phrases to...
Conversational AI
Conversational AI is a subfield of artificial intelligence that focuses on enabling machines to engage in human-like dialogue, capturing context and providing appropriate responses. It leverages natural language processing, machine learning, and semantic understanding to comprehend and respond to text...
Convolutional Neural Networks
Convolutional Neural Networks are a class of deep learning algorithms designed to process data with a known grid-like topology, such as images, by automatically extracting hierarchical features through the application of learnable filters. Inspired by the biological visual cortex, these...
Corpus
In the subfield of Natural Language Processing (NLP), a corpus is defined as a substantial and diverse collection of textual data. This collection serves as the foundational bedrock for training, validating, and testing artificial intelligence models, enabling them to learn...
Cross-Validation
Cross-validation is a statistical resampling procedure used in machine learning to evaluate how well a predictive model will perform on unseen data. By partitioning a dataset into complementary subsets and rotating their roles between training and testing, the technique provides...
Custom/Domain Language Model
A Custom/Domain Language Model is a specialized artificial intelligence system designed to understand, interpret, and generate language within a specific area of expertise or industry. Unlike general language models that are trained on a broad and diverse range of text...
D
Data Augmentation
Data augmentation is a technique in machine learning that artificially expands the size and diversity of a training dataset by generating new, modified instances from existing data. It involves applying domain-specific transformations to original samples, such as rotating images or...
Data Discovery
Data discovery is an iterative process of collecting, exploring, and analyzing data to uncover hidden patterns, relationships, and insights that support informed decision-making. Unlike traditional linear analysis, it is a flexible, user-oriented approach that allows analysts to navigate through data...
Data Drift
Data drift is the phenomenon in which the statistical properties of the input data provided to a predictive model change over time, leading to a degradation in the model’s prediction accuracy. It occurs when the distribution of incoming data diverges...
Data Extraction
Data extraction is the process of retrieving data from various sources for further processing or storage. It involves gathering information from unstructured formats, such as websites, PDFs, emails, images, or videos, as well as from structured formats like databases, Excel...
Data Ingestion
Data ingestion is the process of obtaining, importing, and processing data from various sources for immediate use or storage in a database. It serves as the foundational gateway for any data pipeline, ensuring that information is swiftly and reliably collected...
Data Labelling
Data labeling, also known as data annotation, is the process of adding informative tags or labels to datasets to make raw data understandable and usable for machine learning algorithms. These labels serve as the 'ground truth' that enables systems to...
Data Scarcity
Data scarcity is the condition in which the volume or quality of available information is insufficient to train machine learning models effectively or to support robust decision-making. It arises when data collection is constrained by logistical, financial, or privacy barriers,...
Decision Tree
A decision tree is a predictive modeling technique used in machine learning, data mining, and statistics that represents decisions and their possible consequences as a tree-like structure. It functions by recursively partitioning data into subsets based on specific conditions, creating...
Deep Blue
Deep Blue is a specialized artificial intelligence system designed to play the game of chess at a grandmaster level. It achieved global recognition by becoming the first computer program to defeat a reigning world chess champion in a standard match...
Deep Learning (Deep Reinforcement Learning)
Deep Learning is a subfield of machine learning that utilizes artificial neural networks with multiple layers to process data, identify patterns, and make predictions without explicit rule programming. Deep Reinforcement Learning extends this capability by combining deep learning with reinforcement...
Did You Mean (DYM)
Did You Mean is a feature in search engines and information retrieval systems that suggests alternative queries to correct user errors. It activates when the system detects a likely mistake, such as a typo or misspelling, and presents a corrected...
Diffusion
Diffusion is a term with two distinct meanings in artificial intelligence. In the context of generative modeling, it describes a class of algorithms that create new data by reversing a gradual noise-adding process, starting from random noise and refining it...
Disambiguation
Disambiguation is the process of clarifying the meaning of words, phrases, or visual elements that can be interpreted in multiple ways. It involves assigning the correct sense or identity to these ambiguous inputs based on the surrounding context in which...
Domain Knowledge
Domain knowledge is the specialized understanding, insights, and contextual awareness that experts possess within a specific field of study or industry. It encompasses the nuances, terminologies, and operational realities of a particular subject area that are not immediately obvious to...
E
Edge Model
Edge modeling is the practice of deploying machine learning models directly onto edge devices, which are hardware components that control data flow at the boundary between networks or generate data locally. By bringing computation and data storage closer to the...
Embedding
Embedding is a technique in machine learning and natural language processing that represents categorical data, such as words, phrases, or entities, as dense vectors of real numbers in a high-dimensional space. This transformation maps similar entities closer together while keeping...
Emergence Behavior
Emergence behavior is a phenomenon in which a complex system exhibits properties, capabilities, or patterns that are not present in its individual components and cannot be easily predicted from them. It describes the spontaneous evolution of macro-level intelligence or structure...
Emotion AI (aka Affective Computing)
Emotion AI, also known as Affective Computing, is a branch of artificial intelligence that aims to simulate, comprehend, and respond to human emotions. It involves developing systems and devices that are capable of recognizing, interpreting, processing, and simulating human emotions....
End-to-End Learning
End-to-end learning is a machine learning approach in which a model maps raw input data directly to the desired output, eliminating the need for separate, manual stages of feature extraction. Instead of relying on human-designed features to represent the data,...
Ensemble Methods
Ensemble methods are a machine learning paradigm that combines the predictions of multiple individual models to produce a single, more robust final prediction. By aggregating the outputs of several "weak" learners, these techniques aim to create a "strong" model that...
Entity
An entity is a distinct, well-defined unit of information that represents a real-world object, concept, or instance within a dataset. In artificial intelligence, entities serve as the fundamental building blocks for understanding context and semantics, allowing systems to identify, categorize,...
Entropy
Entropy is a fundamental concept borrowed from information theory that quantifies the impurity, disorder, or uncertainty within a set of data. In the context of artificial intelligence and machine learning, it serves as a mathematical metric to measure the randomness...
Environmental, Social, and Governance (ESG)
Environmental, Social, and Governance (ESG) is a framework for evaluating an organization’s performance across three distinct dimensions: its impact on the natural world, its treatment of people and communities, and the quality of its corporate leadership and oversight. In the...
Epoch
An epoch is a unit of measurement in machine learning that denotes one complete pass through the entire training dataset during the training of a learning algorithm. It serves as a fundamental metric for tracking the progress of iterative learning...
ETL (Entity Recognition, Extraction)
Entity Recognition and Extraction is a natural language processing technique that identifies specific, meaningful chunks of text within a larger body of content and classifies them into predefined categories, such as people, organizations, or locations. This process transforms unstructured text...
Expert Systems
Expert Systems a branch of artificial intelligence (AI), are computer systems that emulate the decision-making ability of a human expert in a particular domain. They are designed to solve complex problems by reasoning through bodies of knowledge, represented mainly as...
Explainable AI (XAI)
Explainable AI (XAI) is a set of methods and techniques designed to make the outputs and internal decision-making processes of artificial intelligence systems understandable to human users. By revealing how a model arrives at a specific conclusion, XAI addresses the...
Extraction or Keyphrase Extraction
Keyphrase Extraction is a process in the field of Natural Language Processing that involves the automated identification and selection of significant phrases or keywords from unstructured text data. These extracted phrases ideally represent the central themes or main topics covered...
F
F-score
The F-score, also known as the F1 score or F-measure, is a statistical metric used to evaluate the performance of binary classification systems. It serves as a single composite value that balances two fundamental aspects of classification quality: precision and...
False Negative
False Negative, a term often used in Statistics and Machine Learning, refers to a specific kind of error that occurs during a binary classification test. In a binary classification scenario, the aim is to sort instances into one of two...
False Positive
A false positive is a classification error in which a model or test incorrectly identifies a negative instance as positive. In binary classification, this means the system predicts the presence of a condition or feature when the ground truth indicates...
Feature Learning
Feature learning is a machine learning approach in which a system automatically discovers the representations or features required for data analysis directly from raw input data. This method enables models to perform tasks such as classification or prediction more effectively...
Feed-Forward (Neural) Networks
A feed-forward neural network is a class of artificial neural network in which information moves unidirectionally from the input layer, through any intermediate hidden layers, to the output layer without looping back. This architecture ensures that the directed graph of...
Few-shot learning
Few-shot learning is a machine learning paradigm designed to enable models to acquire new concepts and make accurate predictions using only a small number of labeled examples, rather than the large datasets typically required by standard supervised learning. It seeks...
Fine-tuning
Fine-tuning is a machine learning technique in which a pre-trained model is further trained on a specific, smaller dataset to adapt its learned representations to a particular task. It is a form of transfer learning that leverages the features acquired...
Forward Propagation
Forward propagation is a fundamental process in neural network modeling that describes the flow of information from the input layer to the output layer. It is the mechanism by which a neural network transforms input data into meaningful output predictions...
Foundation Model
A foundation model is a large-scale machine learning model trained on a massive, diverse corpus of data, typically sourced from the internet, to acquire a broad, general understanding of the world. These models serve as a generic base that can...
G
Garbage In, Garbage Out
Garbage in, garbage out (GIGO) is a fundamental principle in computer science and information technology stating that the quality of output is determined by the quality of input. If incorrect, incomplete, or poor-quality data is provided as input to a...
General Adversarial Network (GAN)
Generative Adversarial Networks (GANs) are a class of machine learning models designed to generate new data instances that resemble those from an original dataset. They operate through a competitive framework where two neural networks, a generator and a discriminator, are...
General Data Protection Regulation (GDPR)
The General Data Protection Regulation (GDPR) is a legal structure established by the European Union (EU) to guide the accumulation, processing, and preservation of personal data from EU residents. Enforced in May 2018, the GDPR, which supersedes the 1995 EU...
Generative AI (GenAI)
Generative AI, or GenAI, refers to artificial intelligence technologies and algorithms capable of generating new, original content such as images, texts, music, or videos. It is a branch of artificial intelligence that focuses on creating models capable of producing creative...
Genetic Algorithm
Genetic algorithms are a class of optimization techniques inspired by the principles of natural selection and biological evolution. They are employed to solve complex problems where traditional deterministic algorithms may struggle, by iteratively searching for optimal or near-optimal solutions through...
GPT (Generative Pretrained Transformer)
Generative Pretrained Transformer (GPT) is a class of large language models that generate human-like text by predicting the next token in a sequence based on the preceding context. It leverages the Transformer neural network architecture, specifically utilizing a decoder-only structure,...
GPU (Graphics Processing Unit)
A Graphics Processing Unit (GPU) is a specialized electronic circuit designed to rapidly manipulate and alter memory to accelerate the rendering of images and videos in a frame buffer intended for output to a display device. It's a critical component...
Ground Truth
Ground truth in artificial intelligence and machine learning denotes the absolute or "true" information about the data within a model. As a benchmark standard or a reference point, it aids in the training and development of machine learning models by...
Grounding
Grounding is the process of linking abstract, symbolic representations in artificial intelligence to sensory or perceptual data from the real world. It establishes a meaningful connection between linguistic symbols, such as words or phrases, and the actual entities or concepts...
H
Hallucinate/Hallucination
Hallucinate/Hallucination describes the phenomenon where an artificial intelligence system generates information, perceptions, or sensory experiences that are not grounded in the actual input data or external reality. This typically occurs in generative models, such as neural networks, which simulate human-like...
Hidden Layer
A hidden layer is an intermediate processing stage within an artificial neural network, positioned between the input layer that receives raw data and the output layer that generates final predictions. It consists of interconnected nodes, or neurons, that apply weights...
Human-in-the-Loop
Human-in-the-Loop is a collaborative framework in artificial intelligence where human intelligence and machine learning algorithms work together iteratively to achieve a desired outcome. This approach leverages the distinct strengths of both parties: the speed and consistency of automated systems and...
Hybrid AI
Hybrid AI is a computational approach that integrates machine learning, which excels at pattern recognition, with traditional symbolic reasoning or rule-based methods, which handle logical inference and knowledge management. By combining these distinct methodologies, the system aims to leverage the...
Hyperparameter (Hyperparameter Tuning)
A hyperparameter is a configuration variable external to a machine learning model that cannot be learned directly from the training data. These variables control the training process and the structure of the model, remaining constant throughout the learning phase. Hyperparameter...
Hyperparameters
Hyperparameters are configuration settings that define the structure and control the behavior of a learning algorithm before the training process begins. Unlike model parameters, which are learned automatically from data during training, hyperparameters are set by the practitioner and remain...
I
Image Recognition
Image recognition is the computational process by which artificial intelligence systems identify, classify, and interpret the content of visual data. It involves training machine learning models to analyze pixel-level information, enabling them to detect objects, recognize patterns, and understand features...
ImageNet
ImageNet is a large-scale visual database designed for use in visual object recognition research. It consists of hundreds of thousands of labeled images organized according to a hierarchical taxonomy, serving as a primary benchmark for training and evaluating machine learning...
Inference
Inference is the process of applying a trained machine-learning model to new, unseen data in order to make predictions or draw conclusions. It is the stage where the model's learned patterns and relationships are utilized to provide insights or decisions...
Inference Engine
An inference engine is a core component of expert systems in artificial intelligence that applies reasoning capabilities to a knowledge base to derive conclusions from a set of facts or assertions. It functions as the processing unit of an expert...
Information Retrieval
Information retrieval is a discipline within computer science focused on the efficient organization, storage, and retrieval of information from large, often unstructured collections. Its primary goal is to identify and return the most relevant items from a database that satisfy...
Insight Engines
An insight engine, also referred to as a cognitive search engine, is an information retrieval system that uses artificial intelligence to analyze structured and unstructured data and deliver actionable insights. Unlike traditional search engines that primarily retrieve data based on...
Instruction Tuning
Instruction Tuning is a technique used in high-performance computing to enhance the efficiency and speed of computation by optimizing the ordering and combination of low-level instructions issued by a processor. The basis of this technique involves leveraging the concept of...
Intelligent Document Processing (IDP)
Intelligent Document Processing (IDP) is an advanced technology that utilizes artificial intelligence and machine learning to recognize, classify, and extract relevant data from a wide variety of document types. By aggregating unstructured data from sources such as PDFs, printed text,...
K
Knowledge Graph
A Knowledge Graph is a structured representation of knowledge that captures relationships between entities, concepts, and facts in a graph-like structure. It serves as a powerful tool for organizing and understanding information in a more interconnected and contextual manner. The...
Knowledge Model
A Knowledge Model is a structured representation of information, insights, and relationships extracted from data sources. It encompasses a system's understanding of domain-specific knowledge, facts, rules, and patterns that enable it to reason, make informed decisions, and generate intelligent responses....
L
Labelled Data
Labelled data is a dataset in which each data point is associated with a specific and well-defined label or category. These labels serve as annotations that provide context and meaning to the data, guiding machine learning algorithms to learn patterns...
LangOps (Language Operations)
LangOps, or Language Operations, is a specialized operational discipline that manages the end-to-end lifecycle of language-centric artificial intelligence applications. It extends traditional software engineering practices to address the unique challenges of natural language processing, such as the dynamic nature of...
Language Data
Language Data is textual or spoken information that serves as the raw material for training, fine-tuning, and evaluating language-related artificial intelligence models. It comprises a diverse range of texts, sentences, paragraphs, or spoken utterances that provide the foundation for machine...
Large Language Model (LLM)
Large Language Model (LLM) is a type of artificial intelligence focusing on understanding and generating human language. It's a subset of the broader field of natural language processing (NLP) that leverages machine learning methods to train language models on vast...
Latent Space
Latent space is a mathematical representation where complex, high-dimensional data is mapped into a lower-dimensional form. This transformation simplifies the structure of the data by reducing noise and redundancy, allowing machine learning algorithms to more effectively model and understand the...
Layer (Hidden Layer)
A layer is a collection of interconnected nodes or neurons that process input data or the output from a preceding layer within a neural network. A hidden layer is a specific type of layer positioned between the input and output...
Learning Rate
The learning rate is a hyperparameter that controls the magnitude of weight updates during the optimization of a machine learning model. It determines how much the model’s parameters are adjusted in response to the calculated error gradient in each training...
Learning-to-Learn
Learning-to-learn, also known as meta-learning, is a machine learning paradigm in which a model is trained on a distribution of tasks rather than a single task, enabling it to acquire new abilities or adapt to new situations with minimal additional...
Learning-to-Rank
Learning to rank, sometimes called machine-learned ranking, is a significant aspect of machine learning that focuses on constructing models used to sort items into a specific order. This technique is largely used in applications where the items' order matters such...
Lemma
A lemma is a fundamental building block used to simplify complex structures, though its specific meaning depends on the field. In mathematics, it is a proven statement used as a stepping stone to prove a larger theorem. In natural language...
Lexicon
A lexicon is a structured collection of words, phrases, and other language elements, accompanied by metadata that describes their semantic, phonetic, or syntactic properties. In artificial intelligence, it serves as a reference database that allows systems to map raw text...
Linked Data
Linked Data is a method of publishing structured data on the Internet so that it can be interlinked and become more useful. It extends the traditional notion of data as a static and rigid structure by integrating, sharing, and connecting...
Logit Function
The logit function is a mathematical transformation that maps a probability value from the interval (0, 1) to the entire real number line, effectively converting probabilities into log-odds. It serves as the inverse of the sigmoid function and is a...
Long Short-Term Memory Networks
Long Short-Term Memory Networks (LSTM) are a specialized architecture of recurrent neural networks designed to overcome the limitations of standard recurrent models when processing sequential data. They achieve this by employing a memory cell structure regulated by gating mechanisms, which...
Loss Function (or Cost Function)
A loss function, also known as a cost function, is a mathematical formula used to quantify the discrepancy between a model's predictions and the actual observed values. It serves as a primary metric for evaluating the accuracy of a predictive...
M
Machine Learning
Machine learning is a branch of artificial intelligence that enables computer systems to improve their performance on a specific task through experience, rather than relying on explicit, hand-coded instructions. It achieves this by using algorithms and statistical techniques to identify...
Machine Translation
Machine Translation is the automated process of converting text or speech from a source language into a target language using computational algorithms. It functions by analyzing the semantic meaning of the input and re-encoding it according to the grammatical rules...
Metadata
Metadata is descriptive information that provides context, attributes, and characteristics about a piece of data. It serves as a structural layer that organizes, categorizes, and clarifies the underlying content without directly altering the data itself, enabling efficient retrieval, interpretation, and...
Mixture of Experts
A Mixture of Experts (MoE) is a machine learning technique developed by Michael I. Jordan and Robert A. Jacobs in the early 1990s. The model is a type of ensemble learning approach that consists of multiple learning components, termed "experts,"...
Model Drift
Model drift, also known as concept drift, refers to the change in data patterns over time that results in the degradation of a predictive model's performance. It occurs when the underlying statistical properties of the target variable or input predictors...
Model Parameter
A model parameter is an internal configuration variable of a machine learning model whose value is estimated from data during the training process. These values define the specific behavior of the model and are essential for making predictions on new,...
Monte Carlo
The Monte Carlo method refers to a set of techniques that use random sampling to solve problems that might be deterministic in principle. Monte Carlo methods can be used when a problem is complex and the solution space or possibility...
Morphological Analysis
Morphological analysis is a fundamental process in natural language processing and computational linguistics that decomposes words into their smallest meaningful units, known as morphemes. By identifying the root, prefixes, suffixes, and inflectional markers within a word, this technique allows machines...
Multi-Modal Learning
Multi-modal learning is a subfield of machine learning that builds models capable of processing and relating information from multiple distinct data types, or "modes." By integrating diverse inputs such as text, images, audio, video, and sensor data, these models leverage...
Multi-Task Learning
Multi-task learning is a machine learning approach in which a single model is trained to perform multiple related prediction problems simultaneously. By solving these tasks concurrently, the model leverages shared representations and commonalities across tasks, often resulting in improved generalization...
Multimodal
Multimodal describes systems or models designed to receive, process, and analyze multiple types of data, known as "modes," simultaneously. These modes can include diverse data types such as text, images, audio, video, and other sensory inputs. By combining and interconnecting...
N
Naive Bayes
Naive Bayes is a probabilistic classification technique rooted in Bayesian probability theory that estimates the likelihood of a data point belonging to a specific class. It operates by calculating the product of individual feature probabilities and the prior probability of...
Named Entity Recognition
Named Entity Recognition is a natural language processing technique that identifies and classifies specific named entities within unstructured text into predefined categories such as persons, organizations, locations, dates, and other proper nouns. By extracting these structured elements from raw text,...
Natural Language Processing (NLP)
Natural Language Processing (NLP) is a multidisciplinary field that focuses on enabling computers to understand, interpret, and generate human language. The essence of NLP lies in its aim to bridge the communication gap between humans and machines, allowing computers to...
Natural Language Understanding
Natural Language Understanding (NLU) is a branch of artificial intelligence that focuses on the interaction between computers and human languages, specifically enabling machines to comprehend and respond to input given in natural language. It involves the processing and analysis of...
NeRF (Neural Radiance Fields)
NeRF, or Neural Radiance Fields, is a deep learning technique for representing and rendering three-dimensional scenes from two-dimensional images. It uses a fully connected neural network to learn a continuous volumetric function that maps spatial coordinates to color and density,...
Neural Network
Neural networks, also known as artificial neural networks (ANNs), are computational models inspired by the biological structure of the human brain. They consist of interconnected layers of nodes that process information by performing weighted computations and applying activation functions to...
Neuron
A neuron, also referred to as a node, is the fundamental computational unit within an artificial neural network. It serves as the basic building block that processes incoming information by performing a weighted summation and applying a non-linear transformation, thereby...
NLG (aka Natural Language Generation)
Natural Language Generation (NLG) is a subfield of artificial intelligence (AI) that focuses on generating text that is natural, clear, and concise. The aim is to create written or spoken narrative from a dataset, with context and variability that would...
NLQ (aka Natural Language Query)
Natural Language Query (NLQ) is a subset of Natural Language Processing that enables users to interact with databases or information repositories using everyday, conversational language. It allows individuals to retrieve data by asking questions in a human-like manner, eliminating the...
NLT (aka Natural Language Technology)
Natural Language Technology (NLT) is a broad term encompassing all technologies designed to handle and interact with human language. It forms the basis for many artificial intelligence applications, aiming to bridge the gap between human and machine communication. NLT systems...
O
Objective Function
An Objective Function is a mathematical formula that quantifies the performance or effectiveness of a model by measuring the discrepancy between its predictions and the desired outcomes. It serves as the primary guiding metric that optimization algorithms seek to minimize...
Ontology
An ontology is a formal representation of knowledge that defines the concepts, entities, relationships, and properties within a specific domain. It serves as a conceptual framework that structures information to facilitate better understanding, reasoning, and communication among both humans and...
Optical Character Recognition
Optical Character Recognition is a technology that enables computers to convert images containing printed or handwritten text into machine-readable and editable text. It bridges the gap between physical documents and digital data by allowing for efficient data extraction and manipulation....
P
Parsing
Parsing is the computational process of analyzing a string of symbols, such as a sentence or code, to determine its grammatical structure and meaning. It involves breaking down complex data into constituent parts, like words and phrases, to extract the...
Part-of-Speech Tagging
Part-of-Speech (POS) tagging is the computational process of assigning a specific grammatical category, or "tag," to each word in a text based on its syntactic role within a sentence. This technique identifies attributes such as whether a word functions as...
Pattern Recognition
Pattern recognition is a branch of artificial intelligence focused on the identification and classification of structures within data. It involves teaching machines to learn from observations so they can make decisions, predictions, or classifications based on detected similarities and patterns....
PEMT (aka Post Edit Machine Translation)
Post Edit Machine Translation, commonly referred to as PEMT, is a hybrid translation workflow that combines the speed of automated machine translation with the linguistic expertise of human editors. In this process, a machine system generates an initial draft translation,...
Personally Identifiable Information
Personally Identifiable Information (PII) is any data that can be used to distinguish or trace the identity of a specific individual. This category includes direct identifiers, such as names or social security numbers, as well as indirect identifiers that, when...
Pooling (Max Pooling)
Pooling, specifically Max Pooling, is a downsampling operation used within Convolutional Neural Networks to reduce the spatial dimensions of feature maps. By summarizing local regions of input data, it decreases the number of parameters and computational load while preserving the...
Post-processing
Post-processing refers to any operations or adjustments applied to data, images, or materials after the initial phase of production or recording. It is a value-added stage designed to improve, optimize, or adapt the initial output to satisfy specific standards, enhance...
Pre-Processing
Pre-processing is a preliminary stage in any production or analysis pipeline, where initial input is prepared or conditioned to optimize it for the subsequent stages. The essence of pre-processing lies in its ability to transform raw input into a more...
Pre-trained Model
A pre-trained model is a machine learning or artificial intelligence model that has already been trained on a large benchmark dataset, rather than being initialized with random weights and trained from scratch. This process allows the model to learn and...
Pre-training
Pre-training in artificial intelligence (AI) refers the process of training a machine model on a large-scale dataset to using it for a task. Such a model, from previously established networks, is called a pre-trained model. The concept behind pre-training lies...
Preprocessing
Preprocessing is the systematic transformation of raw data into a standardized, clean, and structured format suitable for analysis by machine learning algorithms or other computational methods. It serves as a critical initial phase in data pipelines, ensuring that input information...
Principal Component Analysis
Principal Component Analysis is a statistical procedure that uses an orthogonal transformation to convert a set of observations of possibly correlated variables into a set of values of linearly uncorrelated variables called principal components. It is primarily employed as a...
Prompt
A prompt is a specific instruction, query, or input cue provided to an artificial intelligence system, such as a language model, to guide its generation of text or responses. It serves as the primary mechanism for directing the model's output...
Prompt Engineering
Prompt engineering is the strategic design and formulation of input cues, known as prompts, to guide the behavior and output of language models or other artificial intelligence systems. It involves tailoring these inputs with specific instructions, context, and constraints to...
R
Random Forest
Random Forest is an ensemble machine learning algorithm that constructs a collection of decision trees during training and outputs the mode of the classes (for classification) or mean prediction (for regression) of the individual trees. By combining the predictions of...
Recall
Recall is a performance metric used to evaluate classification models, measuring the proportion of actual positive instances that are correctly identified by the model. Also known as sensitivity or the true positive rate, it quantifies the model's ability to capture...
Rectified Linear Unit
The Rectified Linear Unit is a mathematical activation function used in neural networks to introduce non-linearity into the model's decision-making process. It operates by passing positive input values through unchanged while setting all negative input values to zero, creating a...
Recurrent Neural Networks (RNN)
Recurrent Neural Networks (RNN) are a class of artificial neural networks designed to process sequences of data by maintaining an internal memory of previous inputs. Unlike conventional feedforward networks that treat each input independently, RNNs possess interconnections that form loops,...
Regression (Linear Regression, Logistic Regression)
Regression is a fundamental statistical and machine learning technique used to model the relationship between input features and a target variable. It serves as a core method for predicting continuous numerical values or estimating the probability of categorical outcomes based...
Regressor
A Regressor is a machine-learning model designed to predict continuous numerical values by learning the relationship between input features and a target variable. It functions by approximating the underlying function that maps inputs to outputs, aiming to minimize the difference...
Regularization
Regularization is a technique used in machine learning to prevent overfitting by adding constraints or penalties to the training process. It works by discouraging the model from becoming overly complex, thereby improving its ability to generalize accurately to new, unseen...
Reinforcement Learning
Reinforcement Learning is a machine learning paradigm in which an agent learns to make sequential decisions by interacting with an environment to maximize cumulative rewards. Unlike supervised learning, which relies on labeled examples, or unsupervised learning, which identifies patterns in...
Responsible AI
Responsible AI refers to the ethical, transparent, and accountable development and deployment of artificial intelligence technologies. It encompasses a set of principles and practices aimed at ensuring that AI systems are designed and used in ways that align with societal...
Restricted Boltzmann Machines
Restricted Boltzmann Machines are a class of generative artificial neural networks that learn a probability distribution over their input data. They consist of two layers of nodes—a visible layer and a hidden layer—connected in a bipartite graph structure where connections...
RLHF (Reinforcement Learning from Human Feedback)
Reinforcement Learning from Human Feedback (RLHF) is a machine learning technique that aligns an AI agent’s behavior with human preferences by combining reinforcement learning with direct human-provided feedback. It addresses the difficulty of defining complex, nuanced objectives for an agent...
Rules-based Machine Translation (RBMT)
Rules-based Machine Translation (RBMT) is an early approach to machine translation that relies on predefined linguistic rules and structures to translate text from one language to another. Unlike data-driven methods, RBMT involves linguists and experts manually crafting dictionaries, grammatical rules,...
S
SAO (Subject-Action-Object)
SAO (Subject-Action-Object) is a fundamental linguistic structure that represents the core elements of a sentence by breaking down linguistic content into three distinct components: the entity performing an activity, the activity itself, and the entity receiving the activity. This framework...
Semantic Network
A Semantic Network is a structured representation of knowledge that models relationships between concepts using interconnected nodes and edges. This graph-like structure enables systems to capture and organize complex relationships, facilitating more sophisticated reasoning and understanding by depicting not only...
Semantic Search
Semantic Search is an information retrieval approach that interprets the meaning, context, and intent of a user’s query rather than relying solely on exact keyword matches. By leveraging natural language processing and machine learning, it maps queries to content based...
Semi-structured Data
Semi-structured data is a form of information that lacks the rigid, fixed schema of traditional relational databases but retains a degree of organization through self-describing tags, labels, or hierarchical markers. It occupies a middle ground between strictly structured data, which...
Semi-Supervised Learning
Semi-supervised learning is a machine learning approach that utilizes a small amount of labeled data alongside a large volume of unlabeled data to train models. It operates as a bridge between supervised learning, which relies exclusively on labeled examples, and...
Sentiment Analysis
Sentiment analysis is the computational process of evaluating and discerning the emotional tone, opinion, or attitude expressed within text data. It involves using machine learning and natural language processing techniques to categorize text as positive, negative, or neutral based on...
Similarity (and Correlation)
Similarity (and Correlation) are fundamental mathematical concepts used to quantify relationships within data. Similarity measures the degree of likeness or resemblance between objects, data points, or concepts by assessing shared attributes, while correlation gauges the strength and direction of the...
Simple Knowledge Organization System (SKOS)
The Simple Knowledge Organization System (SKOS) is a standardized framework designed to represent and structure knowledge concepts for use in information systems. It provides a lightweight method for organizing controlled vocabularies, taxonomies, and thesauri by defining relationships between terms, such...
Singularity
Singularity is a hypothetical future point in time when technological progress, particularly in artificial intelligence, reaches a level where machines surpass human intelligence. This scenario envisions a state where AI systems gain the ability to self-improve, leading to an exponential...
Speech Analytics
Speech analytics is the process of analyzing spoken language to extract valuable insights and information from audio data. It involves using natural language processing and machine learning techniques to transcribe, interpret, and understand spoken interactions, transforming unstructured audio into structured...
Speech Recognition
Speech recognition, also known as automatic speech recognition (ASR), is the technology that enables computers to convert spoken language into text. It utilizes machine learning algorithms to decipher spoken words and phrases, transcribing them into a textual format that computers...
Statistical Distribution
A statistical distribution is a mathematical function that describes the likelihood of different outcomes occurring within a set of data or a random variable. It characterizes the behavior of data by defining the probability of observing specific values and the...
Structured Data
Structured data is a form of information organization where content is arranged according to a predefined schema or model, typically following a consistent tabular structure of rows and columns. This format ensures that each data point has a designated place...
Supervised Learning
Supervised learning is a fundamental machine learning paradigm in which a model learns to map input data to specific output labels using a dataset of labeled examples. During the training process, the algorithm analyzes these input-output pairs to identify underlying...
Support Vector Machines (SVM)
Support Vector Machines (SVMs) stand as a form of supervised machine learning technique utilized in tasks involving classification and regression. Their purpose revolves around identifying the most advantageous hyperplane, one that effectively distinguishes between distinct sets of data points, all...
Symbolic Artificial Intelligence
Symbolic Artificial Intelligence is a classical approach to artificial intelligence that simulates human intelligence by manipulating symbols and applying logical reasoning. In this paradigm, knowledge is explicitly represented using symbols and rules, allowing systems to perform operations on these representations...
Symbolic Methodology
Symbolic methodology is an approach to artificial intelligence that centers on the manipulation of symbols, formal logic, and structured knowledge representation to enable intelligent reasoning and problem-solving. It involves representing information using symbolic languages, such as logic statements, rules, and...
Syntax
Syntax refers to the grammatical structure and arrangement of words, symbols, or elements within a language or formal system. It dictates the rules and patterns governing how these components are combined to create meaningful expressions and statements, encompassing aspects such...
Synthetic Data
Synthetic data is artificially generated data that mimics real-world data patterns and characteristics. It is created using algorithms or models to replicate the statistical properties and structures of authentic data without directly using actual observations. Synthetic data is used when...
T
Tagging
Tagging is the process of assigning descriptive labels or metadata to data points such as text, images, audio, or video. It serves as a fundamental technique for organizing, categorizing, and enhancing the understanding of these data points by both humans...
Taxonomy
A taxonomy is a hierarchical framework used to systematically categorize and organize concepts, objects, or data based on their inherent relationships and characteristics. It serves as a foundational structure for understanding and classifying information in a structured manner, providing a...
TensorFlow
TensorFlow is an open-source software library designed for the construction and training of machine learning models. It operates by representing data as multi-dimensional arrays, known as tensors, and executing computational operations on these structures through a defined graph of dependencies....
Test Set
A test set is a distinct subset of data held out from the training process to provide an unbiased evaluation of a machine learning model’s performance. It serves as a proxy for real-world conditions, allowing developers to estimate how well...
Testing (Testing Data)
Testing, often referred to as the test set or testing data, is a distinct subset of data used to evaluate the performance of a trained machine learning model. It consists of examples that the model has not encountered during the...
Text Analytics
Text analytics is a computational discipline that applies artificial intelligence and natural language processing techniques to process, analyze, and derive meaningful insights from textual data. It transforms unstructured text sources, such as documents, emails, and social media posts, into organized...
Text Summarization
Text Summarization is the automatic condensation of longer texts into shorter, coherent versions while retaining the key information and main ideas. It is a vital component of natural language processing that addresses the challenge of information overload, enabling efficient content...
Thesauri
A thesaurus is a structured database or list of words and phrases organized by their semantic relationships, such as synonyms, antonyms, and hierarchical associations. In artificial intelligence, these resources serve as linguistic tools that help systems understand language nuances, expand...
Time Series (Time Series Data)
A time series is a sequence of data points collected at regular intervals over time, characterized by the temporal ordering of each observation. This data structure captures how a variable evolves, allowing analysts to identify patterns such as trends, seasonality,...
Tokens
Tokens are individual units or elements that make up a piece of text, such as a sentence or document. These units are typically words, but they can also be subwords, characters, or other linguistic components. Tokenization is the process of...
Topic Modeling
Topic modeling is an unsupervised machine learning technique used to discover the abstract "topics" that occur in a collection of documents. It operates by analyzing the statistical co-occurrence of words to group documents with similar vocabulary together, thereby revealing the...
TPU (Tensor Processing Unit)
A Tensor Processing Unit (TPU) is a specialized hardware accelerator designed to execute machine learning workloads with high efficiency, particularly those involving deep learning and neural networks. Unlike general-purpose processors, TPUs are engineered specifically to perform the matrix computations that...
Training Data
Training data is a fundamental component of machine learning that consists of labeled examples used to teach models to recognize patterns, make predictions, and perform specific tasks. It comprises input examples paired with their corresponding desired outputs or labels, serving...
Training Set
A training set is a collection of data examples used to teach a machine-learning model how to perform a specific task or make predictions. It consists of input data paired with known outputs, or labels, which serve as the reference...
Transfer Learning
Transfer learning is a machine learning technique in which a model developed for one task serves as the starting point for a model on a second, related task. Instead of training a new model from scratch, the knowledge acquired during...
Transformer
The Transformer is a deep learning architecture designed to process sequential data by utilizing self-attention mechanisms to weigh the significance of different input elements relative to each other. Unlike traditional models that process data in a fixed order, it allows...
Treemap
A treemap is a data visualization technique that displays hierarchical data structures by partitioning a rectangular area into nested rectangles. Each rectangle represents a category or data element, with its size and color conveying specific information about the underlying data...
Triple or Triplet Relations (Subject Action Object (SAO))
Triple or Triplet Relations, also known as Subject-Action-Object (SAO) or Subject-Operation-Target (SOT) connections, are a structured format for representing knowledge in artificial intelligence. This format delineates associations among entities within a sentence or context by breaking information down into three...
Tuning (Model Tuning or Fine Tuning)
Tuning, also known as model tuning or fine-tuning, is a critical process in artificial intelligence and machine learning that involves optimizing the performance of a trained model by adjusting its hyperparameters or architecture. Hyperparameters are configuration settings that are not...
Turing Test
The Turing Test is a behavioral benchmark used to assess whether a machine can exhibit intelligent behavior indistinguishable from that of a human. In this test, a human evaluator engages in a text-based conversation with two entities—one human and one...
Type I Error
Type I error, also known as a false positive, is a statistical concept describing the incorrect rejection of a true null hypothesis. In the context of binary classification, it occurs when a model or test identifies a condition as present...
Type II Error
A Type II error, also known as a false negative, is a statistical error that occurs when a hypothesis test or classification model fails to reject a null hypothesis that is actually false. In practical terms, this means the system...
U
Uncertainty
Uncertainty in artificial intelligence describes the state of incomplete knowledge or confidence regarding the outcomes and predictions generated by machine learning models. It acknowledges that models often cannot provide deterministic answers when processing complex, noisy, or ambiguous data. Recognizing and...
Underfitting
Underfitting is a condition in machine learning where a model fails to adequately capture the underlying patterns and relationships within the training data. This failure typically stems from a model that is too simplistic or lacks the necessary capacity to...
Unstructured Data
Unstructured data is information that lacks a predefined or organized format, making it challenging for traditional algorithms to interpret and analyze. Unlike structured data, which is neatly organized into tables and fields, unstructured data is often in the form of...
Unsupervised Learning
Unsupervised learning is a paradigm of machine learning where the emphasis is on discovering patterns, structures, or relationships within data without explicit labeled guidance. Unlike supervised learning, where models are trained on labeled examples with well-defined target outputs, unsupervised learning...
V
Validation Data
Validation data is a subset of labeled data that is distinct from the training data and is used to assess the performance and generalization capabilities of a machine learning model during its development and training process. It serves as an...
Vanishing/Exploding Gradients
Vanishing and exploding gradients are optimization issues that arise during the training of deep neural networks when the gradients used to update model parameters become either excessively small or excessively large. These phenomena occur as the error signal is propagated...
X
XAI (Explainable AI)
Explainable AI (XAI) is the practice of designing and developing artificial intelligence models and systems in a way that their decision-making processes and outcomes can be understood and interpreted by humans. It addresses the "black-box" nature of complex algorithms by...
Z
Zero-shot Learning
Zero-shot learning is a machine learning paradigm in which a model performs tasks or recognizes classes for which it has never observed labeled examples during the training phase. Unlike traditional supervised learning, which requires explicit labeled data for every possible...
