Reference · 266 terms
AI Glossary
Definitions of artificial intelligence, machine learning and data science terms. Each entry opens with a one-paragraph definition, then explains how it works, with examples and related terms.
A
- A/B Testing
A/B testing , also known as split testing or bucket testing, is a statistical method of comparing two versions of a single variable to determine…
- Accelerator
An accelerator is a specialized hardware or software component designed to enhance the performance of artificial intelligence tasks by optimizing…
- Actionable Intelligence
Actionable intelligence refers to information that has been processed and analyzed to the point where it can be directly applied to strategic…
- Activation Function
An activation function is a mathematical operation applied to the output of a neuron in a neural network that determines whether and to what extent…
- Active Learning (Active Learning Strategy)
Active learning is a specialized machine learning strategy in which the algorithm proactively queries a human annotator to label specific, selected…
- Agentic AI
Agentic AI refers to AI systems designed to pursue multi-step goals with a degree of autonomy: they perceive context, decide on a sequence of actions…
- AGI (Artificial General Intelligence)
Artificial General Intelligence (AGI) is a theoretical form of artificial intelligence characterized by the ability to understand, learn, and apply…
- AI Agent
An AI agent is a software system that uses a model, usually a large language model, to autonomously pursue a goal. It perceives its environment or…
- AI Ethics
AI ethics is the field of study that examines the moral implications of artificial intelligence systems and establishes principles to guide their…
- AI Guardrails
AI guardrails are rules, checks, and constraints placed around an AI system, typically a large language model application, to keep its behavior…
- AI Jailbreak
An AI jailbreak is a technique or prompt designed to bypass an AI model's safety guidelines or built-in restrictions, getting it to produce content…
- Algorithm
An algorithm is a finite sequence of well-defined instructions or rules designed to perform a specific task or solve a particular problem. In the…
- Alignment
Alignment is the concept of ensuring that artificial intelligence systems behave in ways that correspond to human intentions, values, and goals. It…
- Anaphora
Anaphora is the linguistic phenomenon where a word or phrase, known as an anaphor, refers back to a previously mentioned entity, called the…
- Area Under the Curve (AUC)
Area Under the Curve (AUC) is a performance measurement used to evaluate the predictive power of classification models, particularly in binary…
- Artificial Intelligence (AI)
Artificial Intelligence (AI) is a branch of computer science dedicated to the creation of systems capable of performing tasks that typically require…
- Artificial Neural Networks
Artificial Neural Networks are computational models inspired by the biological neural networks of the human brain, designed to recognize complex…
- ASI (Artificial Super Intelligence)
Artificial Super Intelligence (ASI) is a hypothetical form of artificial intelligence that possesses cognitive capabilities surpassing those of human…
- Association Rule Learning
Association Rule Learning is a machine learning method used to discover relationships among a set of items within large datasets.
- Attention Mechanism
An attention mechanism is a component in a neural network that lets the model weigh the relevance of different parts of the input when producing each…
- Auto-Classification
Auto-classification is the automated process of assigning predefined categories or labels to data items using machine learning algorithms. It enables…
- Auto-Complete
Auto-complete , also known as predictive text, is a feature that provides suggestions or predicts the rest of a word or phrase that a user has…
- Autoencoders
Autoencoders are a class of artificial neural networks designed to learn efficient, compressed representations of data through unsupervised learning.…
- Automated Speech Recognition
Automated Speech Recognition , also known as Computer Speech Recognition, is a technology that converts spoken language into written text. It is a…
B
- Back Propagation
Back propagation is a supervised learning algorithm used to train artificial neural networks by calculating the gradient of the loss function with…
- Backpropagation Through Time
Backpropagation through time is a gradient-based learning algorithm used to train recurrent neural networks by treating the temporal sequence of…
- Batch
Batch is a fundamental technique in machine learning where a subset of training examples is processed together to compute an approximate gradient for…
- Bayes’s Theorem
Bayes’s Theorem is a fundamental mathematical formula in probability theory that describes how to update the probability of a hypothesis as more…
- BERT
BERT , short for Bidirectional Encoder Representations from Transformers, is a neural network architecture designed for natural language processing…
- Bias
In AI, bias has two distinct meanings. Statistical bias is the systematic error between a model’s average prediction and the true value, forming one…
- Bias-Variance Tradeoff
The bias-variance tradeoff is a fundamental concept in machine learning that describes the relationship between a model's ability to capture…
- Bounding Box
A bounding box is a rectangular region defined by coordinate pairs that localizes an object within a two-dimensional image or video frame. It serves…
C
- Cataphora
Cataphora is an anticipatory referencing mechanism in linguistics where a pronoun or other referring expression points forward to a specific word,…
- Category Trees
Category trees are hierarchical structures used to organize information by grouping concepts or items into parent categories and child subcategories.…
- Causal AI
Causal AI is an approach to artificial intelligence that models cause-and-effect relationships between variables, aiming to answer questions about…
- Central Processing Unit (CPU)
The Central Processing Unit (CPU) is the primary component of a computer system responsible for executing instructions and performing calculations.…
- Chain of Thought
Chain of Thought is a cognitive process in artificial intelligence where a system connects various pieces of information or ideas in a logical…
- Chatbot
A chatbot is a software application designed to simulate human conversation through text-based or voice-based interfaces. It functions as a…
- ChatGPT
ChatGPT is an advanced chatbot model developed by OpenAI that generates human-like text responses and engages in interactive conversations with…
- CLIP (Contrastive Language-Image Pretraining)
CLIP (Contrastive Language-Image Pretraining) is a neural network created by OpenAI that learns to associate images with the text descriptions that…
- Clustering
Clustering is a data analysis technique used to group similar objects or data points together based on their features or characteristics. The essence…
- Co-Occurrence
Co-Occurrence refers to the phenomenon where two or more items, events, or concepts appear together or in close proximity more often than would be…
- Cognitive Map
A cognitive map is a mental representation or framework that individuals construct to organize and navigate their understanding of the physical or…
- Cold-Start
Cold-start refers to a situation or problem that arises when a system or model lacks sufficient data or information to make accurate predictions or…
- Collaborative Filtering
Collaborative filtering is a recommendation technique that predicts a user’s interest in an item by aggregating the preferences of other users who…
- Completions
Completions is a predictive technique that forecasts missing or upcoming data points by analyzing patterns and historical information. This method…
- Composite AI
Composite AI is an architectural approach that integrates multiple distinct artificial intelligence technologies into a single, cohesive system to…
- Computational Linguistics
Computational linguistics is an interdisciplinary field that combines computer science and linguistics to enable computers to analyze, understand,…
- Computational Semantics (Semantic Technology)
Computational semantics , also known as Semantic Technology, is a field of study that combines aspects of semantic theory, computer science, and…
- Computer Vision
Computer Vision is a specialized field of artificial intelligence that focuses on teaching machines to interpret and understand visual information…
- Confidence Interval
A confidence interval is a range of values derived from sample data that is likely to contain an unknown population parameter. In the context of…
- Confusion Matrix
A confusion matrix is a table that compares a classification model's predicted labels with the actual labels, counting correct and incorrect…
- Content Enrichment
Content Enrichment is the process of enhancing raw data with additional or relevant information to increase its value and render it more…
- Contributor
A contributor is an individual who actively participates in the development, refinement, or implementation of artificial intelligence systems. This…
- Controlled Vocabulary
A controlled vocabulary is a curated list of terms used to describe content within a specific domain, designed to standardize how information is…
- Conversational AI
Conversational AI is a subfield of artificial intelligence that focuses on enabling machines to engage in human-like dialogue, capturing context and…
- Convolutional Neural Networks
Convolutional Neural Networks are a class of deep learning algorithms designed to process data with a known grid-like topology, such as images, by…
- Corpus
In the subfield of Natural Language Processing (NLP), a corpus is defined as a substantial and diverse collection of textual data. This collection…
- Cross-Entropy Loss
Cross-entropy loss measures the difference between two probability distributions: the true labels and the model’s predicted probabilities. It is the…
- Cross-Validation
Cross-validation is a statistical resampling procedure used in machine learning to evaluate how well a predictive model will perform on unseen data.…
- Custom/Domain Language Model
A Custom/Domain Language Model is a specialized artificial intelligence system designed to understand, interpret, and generate language within a…
D
- Data Augmentation
Data augmentation is a technique in machine learning that artificially expands the size and diversity of a training dataset by generating new,…
- Data Discovery
Data discovery is an iterative process of collecting, exploring, and analyzing data to uncover hidden patterns, relationships, and insights that…
- Data Drift
Data drift is the phenomenon in which the statistical properties of the input data provided to a predictive model change over time, leading to a…
- Data Extraction
Data extraction is the process of retrieving data from various sources for further processing or storage. It involves gathering information from…
- Data Ingestion
Data ingestion is the process of obtaining, importing, and processing data from various sources for immediate use or storage in a database. It serves…
- Data Labelling
Data labeling , also known as data annotation, is the process of adding informative tags or labels to datasets to make raw data understandable and…
- Data Scarcity
Data scarcity is the condition in which the volume or quality of available information is insufficient to train machine learning models effectively…
- Decision Tree
A decision tree is a predictive modeling technique used in machine learning, data mining, and statistics that represents decisions and their possible…
- Deep Blue
Deep Blue is a specialized artificial intelligence system designed to play the game of chess at a grandmaster level. It achieved global recognition…
- Deep Learning (Deep Reinforcement Learning)
Deep Learning is a subfield of machine learning that utilizes artificial neural networks with multiple layers to process data, identify patterns, and…
- Deepfake
A deepfake is synthetic media (video, image or audio) in which a real person's face, voice or body is generated or altered with deep learning so that…
- Did You Mean (DYM)
Did You Mean is a feature in search engines and information retrieval systems that suggests alternative queries to correct user errors. It activates…
- Diffusion
Diffusion is a term with two distinct meanings in artificial intelligence. In the context of generative modeling, it describes a class of algorithms…
- Disambiguation
Disambiguation is the process of clarifying the meaning of words, phrases, or visual elements that can be interpreted in multiple ways. It involves…
- Domain Knowledge
Domain knowledge is the specialized understanding, insights, and contextual awareness that experts possess within a specific field of study or…
E
- Edge Model
Edge modeling is the practice of deploying machine learning models directly onto edge devices, which are hardware components that control data flow…
- Embedding
Embedding is a technique in machine learning and natural language processing that represents categorical data, such as words, phrases, or entities,…
- Emergence Behavior
Emergence behavior is a phenomenon in which a complex system exhibits properties, capabilities, or patterns that are not present in its individual…
- Emotion AI (aka Affective Computing)
Emotion AI , also known as Affective Computing, is a branch of artificial intelligence that aims to simulate, comprehend, and respond to human…
- End-to-End Learning
End-to-end learning is a machine learning approach in which a model maps raw input data directly to the desired output, eliminating the need for…
- Ensemble Methods
Ensemble methods are a machine learning paradigm that combines the predictions of multiple individual models to produce a single, more robust final…
- Entity
An entity is a distinct, well-defined unit of information that represents a real-world object, concept, or instance within a dataset. In artificial…
- Entropy
Entropy is a fundamental concept borrowed from information theory that quantifies the impurity, disorder, or uncertainty within a set of data.
- Environmental, Social, and Governance (ESG)
Environmental, Social, and Governance (ESG) is a framework for evaluating an organization’s performance across three distinct dimensions: its impact…
- Epoch
An epoch is a unit of measurement in machine learning that denotes one complete pass through the entire training dataset during the training of a…
- ETL (Entity Recognition, Extraction)
Entity Recognition and Extraction is a natural language processing technique that identifies specific, meaningful chunks of text within a larger body…
- Expert Systems
An expert system is an artificial intelligence program that uses a large collection of hand-coded "if-then" rules, written by human experts in a…
- Explainable AI (XAI)
Explainable AI (XAI) is a set of methods and techniques designed to make the outputs and internal decision-making processes of artificial…
- Extraction or Keyphrase Extraction
Keyphrase Extraction is a process in the field of Natural Language Processing that involves the automated identification and selection of significant…
F
- F-score
The F-score , also known as the F1 score or F-measure, is a statistical metric used to evaluate the performance of binary classification systems. It…
- Facial Recognition
Facial recognition is a biometric technology that identifies or verifies a person by analyzing and comparing patterns in their facial features, using…
- False Negative
A false negative is a case where a classification model or test predicts the negative outcome (for example, "no disease," "not spam," "not fraud")…
- False Positive
A false positive is a classification error in which a model or test incorrectly identifies a negative instance as positive. In binary classification,…
- Feature Engineering
Feature engineering is the process of using domain knowledge to create, select, and transform the input variables (features) fed into a machine…
- Feature Learning
Feature learning is a machine learning approach in which a system automatically discovers the representations or features required for data analysis…
- Federated Learning
Federated learning is a distributed machine learning approach in which a shared model is trained across many devices or servers that each hold their…
- Feed-Forward (Neural) Networks
A feed-forward neural network is a class of artificial neural network in which information moves unidirectionally from the input layer, through any…
- Few-shot learning
Few-shot learning is a machine learning paradigm designed to enable models to acquire new concepts and make accurate predictions using only a small…
- Fine-tuning
Fine-tuning is a machine learning technique in which a pre-trained model is further trained on a specific, smaller dataset to adapt its learned…
- Forward Propagation
Forward propagation is a fundamental process in neural network modeling that describes the flow of information from the input layer to the output…
- Foundation Model
A foundation model is a large-scale machine learning model trained on a massive, diverse corpus of data, typically sourced from the internet, to…
G
- Garbage In, Garbage Out
Garbage in, garbage out (GIGO) is a fundamental principle in computer science and information technology stating that the quality of output is…
- General Adversarial Network (GAN)
Generative Adversarial Networks (GANs) are a class of machine learning models designed to generate new data instances that resemble those from an…
- General Data Protection Regulation (GDPR)
The General Data Protection Regulation (GDPR) is a European Union law that sets rules for how organizations collect, store, and process the personal…
- Generative AI (GenAI)
Generative AI , or GenAI, refers to artificial intelligence technologies and algorithms capable of generating new, original content such as images,…
- Genetic Algorithm
Genetic algorithms are a class of optimization techniques inspired by the principles of natural selection and biological evolution. They are employed…
- GPT (Generative Pretrained Transformer)
Generative Pretrained Transformer (GPT) is a class of large language models that generate human-like text by predicting the next token in a sequence…
- GPU (Graphics Processing Unit)
A GPU (graphics processing unit) is a processor originally designed to render computer graphics. It is built around thousands of small cores that can…
- Gradient Descent
Gradient descent is an iterative optimization algorithm that finds the minimum of a function by repeatedly adjusting its parameters in the direction…
- Ground Truth
Ground truth in artificial intelligence and machine learning denotes the absolute or "true" information about the data within a model. As a benchmark…
- Grounding
Grounding is the process of linking abstract, symbolic representations in artificial intelligence to sensory or perceptual data from the real world.…
H
- Hallucinate/Hallucination
Hallucinate/Hallucination describes the phenomenon where an artificial intelligence system generates information, perceptions, or sensory experiences…
- Hidden Layer
A hidden layer is an intermediate processing stage within an artificial neural network, positioned between the input layer that receives raw data and…
- Human-in-the-Loop
Human-in-the-Loop is a collaborative framework in artificial intelligence where human intelligence and machine learning algorithms work together…
- Hybrid AI
Hybrid AI is a computational approach that integrates machine learning, which excels at pattern recognition, with traditional symbolic reasoning or…
- Hyperparameter (Hyperparameter Tuning)
A hyperparameter is a configuration variable external to a machine learning model that cannot be learned directly from the training data. These…
- Hyperparameters
Hyperparameters are configuration settings that define the structure and control the behavior of a learning algorithm before the training process…
I
- Image Recognition
Image recognition is the computational process by which artificial intelligence systems identify, classify, and interpret the content of visual data.…
- Image Segmentation
Image segmentation is a computer vision task that assigns a label to every pixel in an image, dividing it into regions that correspond to different…
- ImageNet
ImageNet is a large-scale visual database designed for use in visual object recognition research. It consists of hundreds of thousands of labeled…
- Inference
Inference is the process of applying a trained machine-learning model to new, unseen data in order to make predictions or draw conclusions. It is the…
- Inference Engine
An inference engine is a core component of expert systems in artificial intelligence that applies reasoning capabilities to a knowledge base to…
- Information Retrieval
Information retrieval is a discipline within computer science focused on the efficient organization, storage, and retrieval of information from…
- Insight Engines
An insight engine , also referred to as a cognitive search engine, is an information retrieval system that uses artificial intelligence to analyze…
- Instruction Tuning
Instruction Tuning is a technique used in high-performance computing to enhance the efficiency and speed of computation by optimizing the ordering…
- Intelligent Document Processing (IDP)
Intelligent Document Processing (IDP) is an advanced technology that utilizes artificial intelligence and machine learning to recognize, classify,…
K
- K-Means Clustering
K-means clustering is an unsupervised machine learning algorithm that divides a dataset into k groups. Each point belongs to the cluster whose…
- Knowledge Distillation
Knowledge distillation is a machine learning technique where a smaller "student" model is trained to reproduce the behavior of a larger,…
- Knowledge Graph
A Knowledge Graph is a structured representation of knowledge that captures relationships between entities, concepts, and facts in a graph-like…
- Knowledge Model
A Knowledge Model is a structured representation of information, insights, and relationships extracted from data sources. It encompasses a system's…
- KV Cache
The KV cache (key-value cache) is a store of the key and value vectors, computed by a transformer's self-attention layers for every token generated…
L
- Labelled Data
Labelled data is a dataset in which each data point is associated with a specific and well-defined label or category. These labels serve as…
- LangOps (Language Operations)
LangOps , or Language Operations, is a specialized operational discipline that manages the end-to-end lifecycle of language-centric artificial…
- Language Data
Language Data is textual or spoken information that serves as the raw material for training, fine-tuning, and evaluating language-related artificial…
- Large Language Model (LLM)
A large language model (LLM) is a neural network, almost always built on the transformer architecture, trained on very large amounts of text to…
- Latent Space
Latent space is a mathematical representation where complex, high-dimensional data is mapped into a lower-dimensional form. This transformation…
- Layer (Hidden Layer)
A layer is a collection of interconnected nodes or neurons that process input data or the output from a preceding layer within a neural network. A…
- Learning Rate
The learning rate is a hyperparameter that controls the magnitude of weight updates during the optimization of a machine learning model. It…
- Learning to Rank
Learning to rank is a machine learning approach for training a model to order a list of items, such as search results or product recommendations, by…
- Learning-to-Learn
Learning-to-learn , also known as meta-learning, is a machine learning paradigm in which a model is trained on a distribution of tasks rather than a…
- Lemma
A lemma is a fundamental building block used to simplify complex structures, though its specific meaning depends on the field. In mathematics, it is…
- Lexicon
A lexicon is a structured collection of words, phrases, and other language elements, accompanied by metadata that describes their semantic, phonetic,…
- Linked Data
Linked Data is a method of publishing structured data on the Internet so that it can be interlinked and become more useful. It extends the…
- Logit Function
The logit function is a mathematical transformation that maps a probability value from the interval (0, 1) to the entire real number line,…
- Long Short-Term Memory Networks
Long Short-Term Memory Networks (LSTM) are a specialized architecture of recurrent neural networks designed to overcome the limitations of standard…
- LoRA (Low-Rank Adaptation)
LoRA (low-rank adaptation) is a parameter-efficient fine-tuning technique that adapts a pretrained model to a new task by training a small number of…
- Loss Function (or Cost Function)
A loss function , also known as a cost function, is a mathematical formula used to quantify the discrepancy between a model's predictions and the…
M
- Machine Learning
Machine learning is a branch of artificial intelligence that enables computer systems to improve their performance on a specific task through…
- Machine Translation
Machine Translation is the automated process of converting text or speech from a source language into a target language using computational…
- Metadata
Metadata is descriptive information that provides context, attributes, and characteristics about a piece of data. It serves as a structural layer…
- Mixture of Experts (MoE)
Mixture of experts (MoE) is a neural network design where, instead of one large network processing every input, the network is split into many…
- Model Context Protocol (MCP)
The Model Context Protocol (MCP) is an open standard that defines how AI applications, such as assistants, coding tools and agents built on large…
- Model Drift
Model drift , also known as concept drift, refers to the change in data patterns over time that results in the degradation of a predictive model's…
- Model Parameter
A model parameter is an internal configuration variable of a machine learning model whose value is estimated from data during the training process.…
- Monte Carlo Method
The Monte Carlo method is any technique that uses repeated random sampling to estimate a numerical result. It is used when the exact answer would be…
- Morphological Analysis
Morphological analysis is a fundamental process in natural language processing and computational linguistics that decomposes words into their…
- Multi-Modal Learning
Multi-modal learning is a subfield of machine learning that builds models capable of processing and relating information from multiple distinct data…
- Multi-Task Learning
Multi-task learning is a machine learning approach in which a single model is trained to perform multiple related prediction problems simultaneously.…
- Multimodal
Multimodal describes systems or models designed to receive, process, and analyze multiple types of data, known as "modes," simultaneously. These…
N
- Naive Bayes
Naive Bayes is a probabilistic classification technique rooted in Bayesian probability theory that estimates the likelihood of a data point belonging…
- Named Entity Recognition
Named Entity Recognition is a natural language processing technique that identifies and classifies specific named entities within unstructured text…
- Natural Language Generation (NLG)
Natural language generation (NLG) is the subfield of AI and natural language processing concerned with producing human-readable text. This output can…
- Natural Language Processing (NLP)
Natural Language Processing (NLP) is a multidisciplinary field that focuses on enabling computers to understand, interpret, and generate human…
- Natural Language Understanding
Natural Language Understanding (NLU) is a branch of artificial intelligence that focuses on the interaction between computers and human languages,…
- NeRF (Neural Radiance Fields)
NeRF , or Neural Radiance Fields, is a deep learning technique for representing and rendering three-dimensional scenes from two-dimensional images.…
- Neural Network
Neural networks , also known as artificial neural networks (ANNs), are computational models inspired by the biological structure of the human brain.…
- Neuron
A neuron , also referred to as a node, is the fundamental computational unit within an artificial neural network. It serves as the basic building…
- NLQ (aka Natural Language Query)
Natural Language Query (NLQ) is a subset of Natural Language Processing that enables users to interact with databases or information repositories…
- NLT (aka Natural Language Technology)
Natural Language Technology (NLT) is a broad term encompassing all technologies designed to handle and interact with human language. It forms the…
O
- Object Detection
Object detection is a computer vision task that identifies and locates objects within an image, typically outputting a bounding box around each…
- Objective Function
An Objective Function is a mathematical formula that quantifies the performance or effectiveness of a model by measuring the discrepancy between its…
- Ontology
An ontology is a formal representation of knowledge that defines the concepts, entities, relationships, and properties within a specific domain. It…
- Open Weights
Open weights describes a model whose trained parameters (weights) are published and can be downloaded and run by anyone, as distinguished from a…
- Optical Character Recognition
Optical Character Recognition is a technology that enables computers to convert images containing printed or handwritten text into machine-readable…
- Overfitting
Overfitting is when a machine learning model learns the training data too closely, including its noise and random fluctuations, so it performs well…
P
- Parsing
Parsing is the computational process of analyzing a string of symbols, such as a sentence or code, to determine its grammatical structure and…
- Part-of-Speech Tagging
Part-of-Speech (POS) tagging is the computational process of assigning a specific grammatical category, or "tag," to each word in a text based on its…
- Pattern Recognition
Pattern recognition is a branch of artificial intelligence focused on the identification and classification of structures within data. It involves…
- PEMT (aka Post Edit Machine Translation)
Post Edit Machine Translation , commonly referred to as PEMT, is a hybrid translation workflow that combines the speed of automated machine…
- Personally Identifiable Information
Personally Identifiable Information (PII) is any data that can be used to distinguish or trace the identity of a specific individual. This category…
- Pooling (Max Pooling)
Pooling , specifically Max Pooling , is a downsampling operation used within Convolutional Neural Networks to reduce the spatial dimensions of…
- Post-processing
Post-processing refers to any operations or adjustments applied to data, images, or materials after the initial phase of production or recording. It…
- Pre-Processing
Pre-processing is a preliminary stage in any production or analysis pipeline, where initial input is prepared or conditioned to optimize it for the…
- Pre-trained Model
A pre-trained model is a machine learning or artificial intelligence model that has already been trained on a large benchmark dataset, rather than…
- Pre-training
Pre-training is the initial stage of training a model, usually on a large, general, often unlabeled dataset with a self-supervised objective, before…
- Precision and Recall
Precision measures the proportion of positive identifications that were actually correct, while recall measures the proportion of actual positives…
- Preprocessing
Preprocessing is the systematic transformation of raw data into a standardized, clean, and structured format suitable for analysis by machine…
- Principal Component Analysis
Principal Component Analysis is a statistical procedure that uses an orthogonal transformation to convert a set of observations of possibly…
- Prompt
A prompt is a specific instruction, query, or input cue provided to an artificial intelligence system, such as a language model, to guide its…
- Prompt Engineering
Prompt engineering is the strategic design and formulation of input cues, known as prompts, to guide the behavior and output of language models or…
- Prompt Injection
Prompt injection is an attack on applications built with large language models in which instructions hidden in input text override or subvert the…
Q
- Quantization
Quantization is a model compression technique that reduces the numeric precision used to represent a model's weights and sometimes its activations,…
R
- Random Forest
Random Forest is an ensemble machine learning algorithm that constructs a collection of decision trees during training and outputs the mode of the…
- Reasoning Model
A reasoning model is a large language model specifically trained to produce an extended chain of intermediate reasoning steps before giving a final…
- Recall
Recall is a performance metric used to evaluate classification models, measuring the proportion of actual positive instances that are correctly…
- Rectified Linear Unit
The Rectified Linear Unit is a mathematical activation function used in neural networks to introduce non-linearity into the model's decision-making…
- Recurrent Neural Networks (RNN)
Recurrent Neural Networks (RNN) are a class of artificial neural networks designed to process sequences of data by maintaining an internal memory of…
- Regression (Linear Regression, Logistic Regression)
Regression is a fundamental statistical and machine learning technique used to model the relationship between input features and a target variable.…
- Regressor
A Regressor is a machine-learning model designed to predict continuous numerical values by learning the relationship between input features and a…
- Regularization
Regularization is a technique used in machine learning to prevent overfitting by adding constraints or penalties to the training process. It works by…
- Reinforcement Learning
Reinforcement Learning is a machine learning paradigm in which an agent learns to make sequential decisions by interacting with an environment to…
- Responsible AI
Responsible AI refers to the ethical, transparent, and accountable development and deployment of artificial intelligence technologies. It encompasses…
- Restricted Boltzmann Machines
Restricted Boltzmann Machines are a class of generative artificial neural networks that learn a probability distribution over their input data. They…
- Retrieval-Augmented Generation (RAG)
Retrieval-augmented generation (RAG) is a technique that grounds a large language model's response in external information. Before generating an…
- RLHF (Reinforcement Learning from Human Feedback)
Reinforcement Learning from Human Feedback (RLHF) is a machine learning technique that aligns an AI agent’s behavior with human preferences by…
- Rules-based Machine Translation (RBMT)
Rules-based Machine Translation (RBMT) is an early approach to machine translation that relies on predefined linguistic rules and structures to…
S
- SAO (Subject-Action-Object)
SAO (Subject-Action-Object) is a fundamental linguistic structure that represents the core elements of a sentence by breaking down linguistic content…
- Self-Supervised Learning
Self-supervised learning is a training approach in which a model learns from unlabeled data by generating its own supervisory signal from the…
- Semantic Network
A Semantic Network is a structured representation of knowledge that models relationships between concepts using interconnected nodes and edges.
- Semantic Search
Semantic Search is an information retrieval approach that interprets the meaning, context, and intent of a user’s query rather than relying solely on…
- Semi-structured Data
Semi-structured data is a form of information that lacks the rigid, fixed schema of traditional relational databases but retains a degree of…
- Semi-Supervised Learning
Semi-supervised learning is a machine learning approach that utilizes a small amount of labeled data alongside a large volume of unlabeled data to…
- Sentiment Analysis
Sentiment analysis is the computational process of evaluating and discerning the emotional tone, opinion, or attitude expressed within text data. It…
- Similarity (and Correlation)
Similarity (and Correlation) are fundamental mathematical concepts used to quantify relationships within data. Similarity measures the degree of…
- Simple Knowledge Organization System (SKOS)
The Simple Knowledge Organization System (SKOS) is a standardized framework designed to represent and structure knowledge concepts for use in…
- Singularity
Singularity is a hypothetical future point in time when technological progress, particularly in artificial intelligence, reaches a level where…
- Small Language Model (SLM)
A small language model (SLM) is a language model with a comparatively small number of parameters, built to run efficiently on limited hardware such…
- Softmax Function
The softmax function turns a vector of real numbers (logits) into a probability distribution: every output is between 0 and 1 and all outputs add up…
- Speculative Decoding
Speculative decoding is an inference-time technique that accelerates text generation from a large language model by having a smaller, faster draft…
- Speech Analytics
Speech analytics is the process of analyzing spoken language to extract valuable insights and information from audio data. It involves using natural…
- Speech Recognition
Speech recognition , also known as automatic speech recognition (ASR), is the technology that enables computers to convert spoken language into text.…
- Statistical Distribution
A statistical distribution is a mathematical function that describes the likelihood of different outcomes occurring within a set of data or a random…
- Structured Data
Structured data is a form of information organization where content is arranged according to a predefined schema or model, typically following a…
- Supervised Learning
Supervised learning is a fundamental machine learning paradigm in which a model learns to map input data to specific output labels using a dataset of…
- Support Vector Machines (SVM)
A support vector machine (SVM) is a supervised learning algorithm, most commonly used for classification, that works by finding the hyperplane…
- Symbolic Artificial Intelligence
Symbolic Artificial Intelligence is a classical approach to artificial intelligence that simulates human intelligence by manipulating symbols and…
- Symbolic Methodology
Symbolic methodology is an approach to artificial intelligence that centers on the manipulation of symbols, formal logic, and structured knowledge…
- Syntax
Syntax refers to the grammatical structure and arrangement of words, symbols, or elements within a language or formal system. It dictates the rules…
- Synthetic Data
Synthetic data is artificially generated data, created by a computer rather than collected from real-world events, designed to have statistical…
T
- Tagging
Tagging is the process of assigning descriptive labels or metadata to data points such as text, images, audio, or video. It serves as a fundamental…
- Taxonomy
A taxonomy is a hierarchical framework used to systematically categorize and organize concepts, objects, or data based on their inherent…
- Temperature (LLM)
Temperature is a parameter that controls the randomness of a language model's output by scaling the raw prediction scores (logits) before they are…
- TensorFlow
TensorFlow is an open-source software library designed for the construction and training of machine learning models. It operates by representing data…
- Test Set
A test set is a distinct subset of data held out from the training process to provide an unbiased evaluation of a machine learning model’s…
- Testing (Testing Data)
Testing , often referred to as the test set or testing data, is a distinct subset of data used to evaluate the performance of a trained machine…
- Text Analytics
Text analytics is a computational discipline that applies artificial intelligence and natural language processing techniques to process, analyze, and…
- Text Summarization
Text Summarization is the automatic condensation of longer texts into shorter, coherent versions while retaining the key information and main ideas.…
- Thesauri
A thesaurus is a structured database or list of words and phrases organized by their semantic relationships, such as synonyms, antonyms, and…
- Time Series (Time Series Data)
A time series is a sequence of data points collected at regular intervals over time, characterized by the temporal ordering of each observation. This…
- Tokenization
Tokenization is the process of splitting text into smaller units, called tokens, that a language model processes as its basic units of input and…
- Tokens
A token is the basic unit of text that a language model actually processes. It is a chunk of text produced by a tokenizer that may represent a whole…
- Topic Modeling
Topic modeling is an unsupervised machine learning technique used to discover the abstract "topics" that occur in a collection of documents. It…
- TPU (Tensor Processing Unit)
A Tensor Processing Unit (TPU) is a specialized hardware accelerator designed to execute machine learning workloads with high efficiency,…
- Training Data
Training data is a fundamental component of machine learning that consists of labeled examples used to teach models to recognize patterns, make…
- Training Set
A training set is a collection of data examples used to teach a machine-learning model how to perform a specific task or make predictions. It…
- Transfer Learning
Transfer learning is a machine learning technique in which a model developed for one task serves as the starting point for a model on a second,…
- Transformer
The Transformer is a deep learning architecture designed to process sequential data by utilizing self-attention mechanisms to weigh the significance…
- Treemap
A treemap is a data visualization technique that displays hierarchical data structures by partitioning a rectangular area into nested rectangles.…
- Triple or Triplet Relations (Subject Action Object (SAO))
Triple or Triplet Relations , also known as Subject-Action-Object (SAO) or Subject-Operation-Target (SOT) connections, are a structured format for…
- Tuning (Model Tuning or Fine Tuning)
Tuning , also known as model tuning or fine-tuning, is a critical process in artificial intelligence and machine learning that involves optimizing…
- Turing Test
The Turing Test is a behavioral benchmark used to assess whether a machine can exhibit intelligent behavior indistinguishable from that of a human.…
- Type I Error
Type I error , also known as a false positive, is a statistical concept describing the incorrect rejection of a true null hypothesis. In the context…
- Type II Error
A Type II error , also known as a false negative, is a statistical error that occurs when a hypothesis test or classification model fails to reject a…
U
- Uncertainty
Uncertainty in artificial intelligence describes the state of incomplete knowledge or confidence regarding the outcomes and predictions generated by…
- Underfitting
Underfitting is a condition in machine learning where a model fails to adequately capture the underlying patterns and relationships within the…
- Unstructured Data
Unstructured data is information that lacks a predefined or organized format, making it challenging for traditional algorithms to interpret and…
- Unsupervised Learning
Unsupervised learning is a paradigm of machine learning where the emphasis is on discovering patterns, structures, or relationships within data…
V
- Validation Data
Validation data is a subset of labeled data that is distinct from the training data and is used to assess the performance and generalization…
- Vanishing/Exploding Gradients
Vanishing and exploding gradients are optimization issues that arise during the training of deep neural networks when the gradients used to update…
- Vector Database
A vector database is a database designed to store and efficiently search high-dimensional vectors, called embeddings, using similarity search rather…
- Vibe Coding
Vibe coding is a software development style where a person describes desired functionality in plain natural language, and an AI coding assistant…
W
- World Model
A world model is a model that learns an internal representation of how an environment works, including how it changes over time and in response to…
X
- XAI (Explainable AI)
Explainable AI (XAI) is the practice of designing and developing artificial intelligence models and systems in a way that their decision-making…
- XGBoost
XGBoost (eXtreme Gradient Boosting) is an open-source machine learning library that implements gradient-boosted decision trees. It is used for…
Z
- Zero-shot Learning
Zero-shot learning is a machine learning paradigm in which a model performs tasks or recognizes classes for which it has never observed labeled…