DP-100: Designing and Implementing a Data Science Solution on Azure

48%

Question 91

You are performing feature engineering on a dataset.

You must add a feature named CityName and populate the column value with the text London.
You need to add the new feature to the dataset.

Which Azure Machine Learning Studio module should you use?
Extract N-Gram Features from Text
Edit Metadata
Preprocess Text
Apply SQL Transformation
Execute Python Script




Answer is Edit Metadata

Typical metadata changes might include marking columns as features.

Reference:
https://docs.microsoft.com/en-us/azure/machine-learning/studio-module-reference/edit-metadata

Question 92

You are building a regression model for estimating the number of calls during an event.

You need to determine whether the feature values achieve the conditions to build a Poisson regression model.

Which two conditions must the feature set contain? Each correct answer presents part of the solution.

NOTE: Each correct selection is worth one point.
The label data must be a negative value.
The label data must be whole numbers.
The label data must be non-discrete.
The label data must be a positive value.
The label data can be positive or negative.




Answer is The label data must be whole numbers. and The label data must be a positive value.

Poisson regression is intended for use in regression models that are used to predict numeric values, typically counts. Therefore, you should use this module to create your regression model only if the values you are trying to predict fit the following conditions:

The response variable has a Poisson distribution.

Counts cannot be negative. The method will fail outright if you attempt to use it with negative labels.

A Poisson distribution is a discrete distribution; therefore, it is not meaningful to use this method with non-whole numbers.

References:
https://docs.microsoft.com/en-us/azure/machine-learning/studio-module-reference/poisson-regression

Question 93

Overview
You are a data scientist in a company that provides data science for professional sporting events. Models will use global and local market data to meet the following business goals:

Understand sentiment of mobile device users at sporting events based on audio from crowd reactions.
Assess a user’s tendency to respond to an advertisement.
Customize styles of ads served on mobile devices.
Use video to detect penalty events

Current environment
Media used for penalty event detection will be provided by consumer devices. Media may include images and videos captured during the sporting event and shared using social media. The images and videos will have varying sizes and formats.
The data available for model building comprises of seven years of sporting event media. The sporting event media includes; recorded video transcripts or radio commentary, and logs from related social media feeds captured during the sporting events.
Crowd sentiment will include audio recordings submitted by event attendees in both mono and stereo formats.

Penalty detection and sentiment
Data scientists must build an intelligent solution by using multiple machine learning models for penalty event detection.
Data scientists must build notebooks in a local environment using automatic feature engineering and model building in machine learning pipelines.
Notebooks must be deployed to retrain by using Spark instances with dynamic worker allocation. Notebooks must execute with the same code on new Spark instances to recode only the source of the data.
Global penalty detection models must be trained by using dynamic runtime graph computation during training.
Local penalty detection models must be written by using BrainScript.
Experiments for local crowd sentiment models must combine local penalty detection data.
Crowd sentiment models must identify known sounds such as cheers and known catch phrases. Individual crowd sentiment models will detect similar sounds.
All shared features for local models are continuous variables.
Shared features must use double precision. Subsequent layers must have aggregate running mean and standard deviation metrics available.


Advertisements
During the initial weeks in production, the following was observed:

Ad response rated declined. Drops were not consistent across ad styles. The distribution of features across training and production data are not consistent

Analysis shows that, of the 100 numeric features on user location and behavior, the 47 features that come from location sources are being used as raw features. A suggested experiment to remedy the bias and variance issue is to engineer 10 linearly uncorrelated features.

Initial data discovery shows a wide range of densities of target states in training data used for crowd sentiment models.
All penalty detection models show inference phases using a Stochastic Gradient Descent (SGD) are running too slow.
Audio samples show that the length of a catch phrase varies between 25%-47% depending on region The performance of the global penalty detection models shows lower variance but higher bias when comparing training and validation sets. Before implementing any feature changes, you must confirm the bias and variance using all training and validation cases.
Ad response models must be trained at the beginning of each event and applied during the sporting event.
Market segmentation models must optimize for similar ad response history.
Sampling must guarantee mutual and collective exclusively between local and global segmentation models that share the same features.
Local market segmentation models will be applied before determining a user’s propensity to respond to an advertisement.
Ad response models must support non-linear boundaries of features.
The ad propensity model uses a cut threshold is 0.45 and retrains occur if weighted Kappa deviated from 0.1 +/- 5%.
The ad propensity model uses cost factors shown in the following diagram:
  Actual
10
Predicted012
121

The ad propensity model uses proposed cost factors shown in the following diagram:
  Actual
10
Predicted015
151

Performance curves of current and proposed cost factor scenarios are shown in the following diagram:

You need to implement a feature engineering strategy for the crowd sentiment local models.

What should you do?
Apply an analysis of variance (ANOVA).
Apply a Pearson correlation coefficient.
Apply a Spearman correlation coefficient.
Apply a linear discriminant analysis.




Answer is Apply a linear discriminant analysis.

The linear discriminant analysis method works only on continuous variables, not categorical or ordinal variables.

Linear discriminant analysis is similar to analysis of variance (ANOVA) in that it works by comparing the means of the variables.

Scenario:
Data scientists must build notebooks in a local environment using automatic feature engineering and model building in machine learning pipelines.
Experiments for local crowd sentiment models must combine local penalty detection data.
All shared features for local models are continuous variables.

Incorrect Answers:

Apply a Pearson correlation coefficient.: The Pearson correlation coefficient, sometimes called Pearson’s R test, is a statistical value that measures the linear relationship between two variables. By examining the coefficient values, you can infer something about the strength of the relationship between the two variables, and whether they are positively correlated or negatively correlated.

Apply a Spearman correlation coefficient: Spearman’s correlation coefficient is designed for use with non-parametric and non-normally distributed data. Spearman's coefficient is a nonparametric measure of statistical dependence between two variables, and is sometimes denoted by the Greek letter rho. The Spearman’s coefficient expresses the degree to which two variables are monotonically related. It is also called Spearman rank correlation, because it can be used with ordinal variables.

References:
https://docs.microsoft.com/en-us/azure/machine-learning/studio-module-reference/fisher-lineardiscriminant-analysis
https://docs.microsoft.com/en-us/azure/machine-learning/studio-module-reference/computelinear-correlation

Question 94

You are a data scientist for Fabrikam Residences, a company specializing in quality private and commercial property in the United States. Fabrikam Residences is considering expanding into Europe and has asked you to investigate prices for private residences in major European cities.
You use Azure Machine Learning Studio to measure the median value of properties. You produce a regression model to predict property prices by using the Linear Regression and Bayesian Linear Regression modules.

Datasets

There are two datasets in CSV format that contain property details for two cities, London and Paris. You add both files to Azure Machine Learning Studio as separate datasets to the starting point for an experiment. Both datasets contain the following columns:


An initial investigation shows that the datasets are identical in structure apart from the MedianValue column. The smaller Paris dataset contains the MedianValue in text format, whereas the larger London dataset contains the MedianValue in numerical format.

Data issues

Missing values
The AccessibilityToHighway column in both datasets contains missing values. The missing data must be replaced with new data so that it is modeled conditionally using the other variables in the data before filling in the missing values.
Columns in each dataset contain missing and null values. The datasets also contain many outliers. The Age column has a high proportion of outliers. You need to remove the rows that have outliers in the Age column. The MedianValue and AvgRoomsInHouse columns both hold data in numeric format. You need to select a feature selection algorithm to analyze the relationship between the two columns in more detail.

Model fit
The model shows signs of overfitting. You need to produce a more refined regression model that reduces the overfitting.

Experiment requirements
You must set up the experiment to cross-validate the Linear Regression and Bayesian Linear Regression modules to evaluate performance. In each case, the predictor of the dataset is the column named MedianValue. You must ensure that the datatype of the MedianValue column of the Paris dataset matches the structure of the London dataset.
You must prioritize the columns of data for predicting the outcome. You must use non-parametric statistics to measure relationships.
You must use a feature selection algorithm to analyze the relationship between the MedianValue and AvgRoomsInHouse columns.

Model training
Permutation Feature Importance

Given a trained model and a test dataset, you must compute the Permutation Feature Importance scores of feature variables. You must be determined the absolute fit for the model.

Hyperparameters
You must configure hyperparameters in the model learning process to speed the learning phase. In addition, this configuration should cancel the lowest performing runs at each evaluation interval, thereby directing effort and resources towards models that are more likely to be successful.
You are concerned that the model might not efficiently use compute resources in hyperparameter tuning. You also are concerned that the model might prevent an increase in the overall tuning time. Therefore, must implement an early stopping criterion on models that provides savings without terminating promising jobs.

Testing
You must produce multiple partitions of a dataset based on sampling using the Partition and Sample module in Azure Machine Learning Studio.

Cross-validation
You must create three equal partitions for cross-validation. You must also configure the cross- validation process so that the rows in the test and training datasets are divided evenly by properties that are near each city’s main river. You must complete this task before the data goes through the sampling process.

Linear regression module
When you train a Linear Regression module, you must determine the best features to use in a model. You can choose standard metrics provided to measure performance before and after the feature importance process completes. The distribution of features across multiple training models must be consistent.

Data visualization
You need to provide the test results to the Fabrikam Residences team. You create data visualizations to aid in presenting the results.
You must produce a Receiver Operating Characteristic (ROC) curve to conduct a diagnostic test evaluation of the model. You need to select appropriate methods for producing the ROC curve in Azure Machine Learning Studio to compare the Two-Class Decision Forest and the Two-Class Decision Jungle modules with one another.
You need to select a feature extraction method.

Which method should you use?
Mutual information
Mood’s median test
Kendall correlation
Permutation Feature Importance




Answer is Kendall correlation

In statistics, the Kendall rank correlation coefficient, commonly referred to as Kendall's tau coefficient (after the Greek letter ?), is a statistic used to measure the ordinal association between two measured quantities.

It is a supported method of the Azure Machine Learning Feature selection.

Scenario: When you train a Linear Regression module using a property dataset that shows data for property prices for a large city, you need to determine the best features to use in a model. You can choose standard metrics provided to measure performance before and after the feature importance process completes. You must ensure that the distribution of the features across multiple training models is consistent.

References:
https://docs.microsoft.com/en-us/azure/machine-learning/studio-module-reference/featureselection-modules

Question 95

You are using Azure Machine Learning Studio to perform feature engineering on a dataset.
You need to normalize values to produce a feature column grouped into bins.

Solution: Apply an Entropy Minimum Description Length (MDL) binning mode.

Does the solution meet the goal?
Yes
No




Answer is No

You can specify the following binning modes:
- Entropy MDL
- Quantiles
- Equal Width
- Custom Edges
- Equal Width with Custom Start and Stop
From all of these, the only binning mode which supports normalization is Quantiles. In particular, Entropy MDL does NOT support normalization.

Entropy Minimum Description Length (MDL) binning is a technique that can be used to group values into bins. However, it is not a normalization technique. Normalization is a technique that is used to scale values so that they have a similar range. In this case, the goal is to normalize values to produce a feature column grouped into bins. However, the solution of applying an Entropy MDL binning mode will not achieve this goal. Instead, you should use a normalization technique, such as min-max normalization or z-score normalization.

References:
https://learn.microsoft.com/en-us/previous-versions/azure/machine-learning/studio-module-reference/group-data-into-bins

Question 96

You have been tasked with employing a machine learning model, which makes use of a PostgreSQL database and needs GPU processing, to forecast prices.
You are preparing to create a virtual machine that has the necessary tools built into it.
You need to make use of the correct virtual machine type.

Recommendation: You make use of a Deep Learning Virtual Machine (DLVM) Windows edition.

Will the requirements be satisfied?
Yes
No




Answer is Yes

The DLVM is a specially configured variant of the Data Science Virtual Machine (DSVM) that comes with pre-configured environments for developing and deploying deep learning models on GPU instances.

Regarding PostgreSQL, the DLVM (Deep Learning Virtual Machine) is a specially configured variant of the DSVM (Data Science Virtual Machine) that is custom made to help users jump-start deep learning on Azure GPU VMs2. The DLVM uses the same underlying VM images of the DSVM and hence comes with the same set of data science tools and deep learning frameworks as the base VM. So, you can have access to PostgreSQL .

Question 97

You have been tasked with employing a machine learning model, which makes use of a PostgreSQL database and needs GPU processing, to forecast prices.
You are preparing to create a virtual machine that has the necessary tools built into it.
You need to make use of the correct virtual machine type.

Recommendation: You make use of a Data Science Virtual Machine (DSVM) Windows edition.

Will the requirements be satisfied?
Yes
No




Answer is Yes

Deep Learning Virtual Machine (DLVM) and Data Science Virtual Machine (DSVM) can be used for machine learning workloads and come with pre-installed tools and frameworks.

In this case, you can choose either the DLVM or DSVM based on your preference and specific requirements. Both virtual machine types can support the use of a PostgreSQL database and GPU processing for your machine learning model.

To summarize, both DLVM and DSVM can satisfy the requirements of using a PostgreSQL database and GPU processing for your machine learning model. You can choose the one that best suits your needs and preferences.

Reference:
https://docs.microsoft.com/en-us/azure/machine-learning/data-science-virtual-machine/overview

Question 98

You are planning to host practical training to acquaint learners with data visualization creation using Python. Learner devices are able to connect to the internet. Learner devices are currently NOT configured for Python development. Also, learners are unable to install software on their devices as they lack administrator permissions. Furthermore, they are unable to access Azure subscriptions.
It is imperative that learners are able to execute Python-based data visualization code.

Which of the following actions should you take?
You should consider configuring the use of Azure Container Instance.
You should consider configuring the use of Azure BatchAI.
You should consider configuring the use of Azure Notebooks.
You should consider configuring the use of Azure Kubernetes Service.




Answer is You should consider configuring the use of Azure Notebooks.

Azure Notebooks are accessible by any device that can connect to the internet. The other options require installation of additional software, which is not permitted in this scenario.

Reference:
https://notebooks.azure.com/

Question 99

You have been tasked with constructing a machine learning model that translates language text into a different language text.
The machine learning model must be constructed and trained to learn the sequence of the.

Recommendation: You make use of Convolutional Neural Networks (CNNs).

Will the requirements be satisfied?
Yes
No




Answer is No

Convolution Neural Networks (CNN) for training images machine learning model.
Recurrent Neural Networks (RNN) for training text (words sequence) in term of seq2seq, but now it is out of date, use Transformer as alternative solution.

Reference:
https://www.techtarget.com/searchenterpriseai/feature/CNN-vs-RNN-How-they-differ-and-where-they-overlap

Question 100

You are planning to make use of Azure Machine Learning designer to train models.
You need choose a suitable compute type.

Recommendation: You choose Attached compute.

Will the requirements be satisfied?
Yes
No




Answer is No

Designer only supports Azure Machine Learning Compute (AML Compute cluster or AML compute instance) for training.

Reference:
https://docs.microsoft.com/en-us/azure/machine-learning/concept-compute-target

< Previous PageNext Page >

Quick access to all questions in this exam