AIP-210 CertNexus Certified Artificial Intelligence Practitioner (CAIP) Questions and Answers

Oversampling is a method that can help address the issue of imbalanced data, which is when one class is much more frequent than the other in the dataset. This can cause the model to be biased towards the majority class and have a low true negative rate. Oversampling involves creating synthetic samples of the minority class or replicating existing samples to balance the class distribution. This can help the model learn more from the minority class and improve the true negative rate. References: [Handling imbalanced datasets in machine learning], [Oversampling and undersampling in data analysis - Wikipedia]

Caffe is a deep learning framework that is designed for speed and modularity. It can process large datasets of images efficiently and supports various types of neural networks. It also has a large and active developer community that contributes to its code base and documentation. Caffe is suitable for image processing tasks such as classification, segmentation, detection, and recognition

The Adversarial ML Threat Matrix is an open framework designed to help detect, respond to, and remediate threats in ML systems. The Adversarial ML Threat Matrix is inspired by the MITRE ATTandCK® Matrix1, which is a framework for describing cyberattacks across various stages of an attack lifecycle. The Adversarial ML Threat Matrix adapts this framework to address specific threats and vulnerabilities in ML systems, such as data poisoning, model stealing, model evasion, or model inversion2. The Adversarial ML Threat Matrix provides a structured way to organize and classify adversarial techniques, tactics, procedures, examples, and mitigations for ML systems2.

Accuracy is a measure of how well a classifier can correctly predict the class of an instance. Accuracy is calculated by dividing the number of correct predictions (true positives and true negatives) by the total number of predictions. True positives are instances that are correctly predicted as positive (belonging to the target class). True negatives are instances that are correctly predicted as negative (not belonging to the target class).

Adversarial attacks are malicious attempts to fool or manipulate machine learning models by adding small perturbations to the input data that are imperceptible to humans but can cause significant changes in the model output. In general, models that perform their tasks more accurately are less robust against adversarial attacks, because they tend to have higher confidence in their predictions and are more sensitive to small changes in the input data. References: [Adversarial machine learning - Wikipedia], [Why Are Machine Learning Models Susceptible to Adversarial Attacks? | by Anirudh Jain | Towards Data Science]

SVM models can use kernel functions to map the input data into higher-dimensional feature spaces, where linear separation is possible. This allows SVM models to handle non-linear problems effectively. References: CertNexus Certified Artificial Intelligence Practitioner, Support vector machine - Wikipedia

Distributed artificial intelligence (DAI) is a subfield of artificial intelligence that studies how multiple intelligent agents can coordinate and cooperate to achieve a common goal or solve a complex problem. DAI relies on a distributed system that performs robust computations across a network of unreliable nodes, such as sensors, robots, or humans. DAI can handle large-scale, dynamic, and uncertain environments that are beyond the capabilities of a single agent. References: [Distributed artificial intelligence - Wikipedia], [Distributed Artificial Intelligence: An Overview]

Missing values are a common problem in data analysis and machine learning, as they can affect the quality and reliability of the data and the model. There are various methods to deal with missing values, such as deleting, imputing, or ignoring them. One of the most common methods is imputing, which means replacing the missing values with some estimated values based on some criteria. For continuous variables, one of the simplest and most widely used imputation methods is to fill in the missing values with the mean (average) of the observed values for that variable in the entire dataset. This method can preserve the overall distribution and variance of the data, as well as avoid introducing bias or noise.

Word2vec is a word embedding method that finds characteristics of words in a very large number of documents. Word embedding is a technique that converts words into numerical vectors that represent their meaning, usage, or context. Word2vec learns a dense and continuous vector representation for each word based on its context in a large corpus of text. Word2vec can capture the semantic and syntactic similarity and relationships among words, such as synonyms, antonyms, analogies, or associations1.

Cloud models are service models that provide different levels of abstraction and control over computing resources in a cloud environment. Some of the common cloud models for machine learning pipelines are:

Software as a Service (SaaS): SaaS provides ready-to-use applications that run on the cloud provider’s infrastructure and are accessible through a web browser or an API. SaaS can provide AI practitioner data science services such as Jupyter notebooks, which are web-based interactive environments that allow users to create and share documents that contain code, text, visualizations, and more.

Platform as a Service (PaaS): PaaS provides a platform that allows users to develop, run, and manage applications without worrying about the underlying infrastructure. PaaS can provide some services within an application such as payment applications to create efficient results.

Infrastructure as a Service (IaaS): IaaS provides access to fundamental computing resources such as servers, storage, networks, and operating systems. IaaS can provide CPU, memory, disk, network and GPU resources that can be used to run machine learning models and applications.

Data as a Service (DaaS): DaaS provides access to data sources that can be consumed by applications or users on demand. DaaS can host the databases providing backups, clustering, and high availability.

Increasing the speed of analysis is a benefit of machine learning for solving business problems. Machine learning is a branch of artificial intelligence that involves creating systems that can learn from data and make predictions or decisions. Machine learning can help increase the speed of analysis by automating and optimizing various tasks, such as data processing, feature extraction, model training, model evaluation, or model deployment. Machine learning can also help handle large and complex data sets that may be difficult or impractical to analyze manually or with traditional methods.

Technical debt is a metaphor that describes the implied cost of additional work or rework caused by choosing an easy or quick solution over a better but more complex solution. Technical debt can accumulate in ML systems due to various factors, such as changing requirements, outdated code, poor documentation, or lack of testing. Some of the ways to decrease technical debt in ML systems are:

Documentation readability: Documentation readability refers to how easy it is to understand and use the documentation of an ML system. Documentation readability can help reduce technical debt by providing clear and consistent information about the system’s design, functionality, performance, and maintenance. Documentation readability can also facilitate communication and collaboration among different stakeholders, such as developers, testers, users, and managers.

Refactoring: Refactoring is the process of improving the structure and quality of code without changing its functionality. Refactoring can help reduce technical debt by eliminating code smells, such as duplication, complexity, or inconsistency. Refactoring can also enhance the readability, maintainability, and extensibility of code.

Data privacy is the right of individuals to control how their personal data is collected, used, shared, and protected. It also involves complying with relevant laws and regulations that govern the handling of personal data. Data privacy is especially important when extracting business intelligence from primary data captured from the public, as it may contain sensitive or confidential information that could harm the individuals if misused or breached .

Highly interpretable models are models that can provide clear and intuitive explanations for their predictions, such as decision trees, linear regression, or logistic regression. Some of the statements that are true regarding highly interpretable models are:

They are usually easier to explain to business stakeholders: Highly interpretable models can help communicate the logic and reasoning behind their predictions, which can increase trust and confidence among business stakeholders. For example, a decision tree can show how each feature contributes to a decision outcome, or a linear regression can show how each coefficient affects the dependent variable.

They usually compromise on model accuracy for the sake of interpretability: Highly interpretable models may not be able to capture complex or non-linear patterns in the data, which can reduce their accuracy and generalization. For example, a decision tree may overfit or underfit the data if it is too deep or too shallow, or a linear regression may not be able to model curved relationships between variables.

Before log-transforming Y, we should add 1 to all of the Y values. This is because log transformation is undefined for zero or negative values, and some of the Y values may be zero. Adding 1 to all of the Y values can avoid this problem and ensure that the log transformation is valid and meaningful. Adding 1 to all of the Y values is also known as a log-plus-one transformation.

Ridge regression is a type of linear regression that adds a regularization term to the loss function to reduce overfitting and improve generalization. Ridge regression is fast and requires low memory and low processing power, as it only involves solving a system of linear equations. Ridge regression can also handle multicollinearity (high correlation among predictors) by shrinking the coefficients of correlated predictors.

Normalization is a method that can help us to solve the problem of features being on different scales when using the k-nearest neighbors algorithm. Normalization is a technique that rescales the values of features to a common range, such as [0, 1] or [-1, 1] . Normalization can help reduce the influence or dominance of some features over others, as well as improve the accuracy and performance of the algorithm2.

Principal component analysis (PCA) is a technique that reduces the dimensionality of a dataset by transforming it into a set of new variables called principal components. The principal components are linear combinations of the original variables that capture the maximum amount of variance in the data. The first principal component explains the most variance, the second principal component explains the second most variance, and so on. The goal of PCA is to retain as much variance as possible while reducing the number of variables.

Entanglement in ML pipelines occurs when a change in one step affects other steps that depend on it. Changing the normalization function in the feature engineering step would affect the model training and evaluation steps, as they rely on the features generated by the feature engineering step. Therefore, this scenario is an example of entanglement in ML pipelines. The other scenarios are not examples of entanglement, as they do not affect other steps in the pipeline.

Lasso regression is a type of linear regression that adds a regularization term to the loss function to reduce overfitting and improve generalization. Lasso regression uses an L1 norm as the regularization term, which is the sum of the absolute values of the coefficients. Lasso regression can shrink some of the coefficients to zero, which effectively eliminates some of the features from the model. Lasso regression is preferable over ridge regression when there are many features with no association with the dependent variable, as it can perform feature selection and reduce the complexity and noise of the model.

Personas are fictional characters that represent the potential users or customers of an ML system. Personas can help understand the needs, goals, preferences, and behaviors of the target audience, as well as design and evaluate the system from their perspective. Some of the techniques that are used to build personas in the ML development lifecycle are:

Population estimates: Population estimates are statistical methods that estimate the size, characteristics, and distribution of a population based on a sample or a census. Population estimates can help identify and quantify the potential market segments and user groups for an ML system, as well as their demographics, locations, and behaviors.

Population triage: Population triage is a process of prioritizing and selecting the most relevant and representative personas for an ML system based on some criteria or metrics. Population triage can help focus on the key user needs and scenarios, as well as avoid creating too many or too few personas.

Sampling bias occurs when a data segment is collected in such a way that some members of the intended statistical population are less likely to be included than others. This can result in a sample that is not representative of the population and may lead to inaccurate or misleading conclusions. Sampling bias can be caused by various factors, such as non-random sampling methods, non-response, self-selection, or convenience sampling. References: [Sampling bias - Wikipedia], [What is Sampling Bias? Definition, Types and Examples]