Mining Massive Datasets

Suppose ABCD is not a frequent itemset, while ABC and ACD are frequent itemsets. Which of the following is definitely true?

Suppose we are representing sets by strings and indexing the strings according to both the symbol and its position within the prefix. We want to find strings within Jaccard distance at most 0.2 (i.e., similarity at least 0.8), and we are given a probe string of length 24. Into how many buckets must we look?

In the following question we consider an example of the implementation of the PCY algorithm. All numbers should be treated as decimal; e.g., “one million” is 1,000,000, NOT 2²⁰ = 1,048,576. All integers (item counts and bucket counts) require 4 bytes.We have one billion bytes of main memory available for the first pass. There are 100,000,000 items, and also 100,000,000 baskets, each of which contains exactly 10 items. Say that PCY is effective if the average count of a bucket is at most half the support value. For the given data, what is the smallest support value for which PCY will be effective?

Suppose we want to represent the multiplication of two 10-by-10 matrices as a “problem” in the sense used for our discussion of the theory of MapReduce algorithms. How many pairs are in the input-output mapping?

The “all-triples” problem is described by n inputs, (n choose 3) outputs, and an input-output mapping where each output is connected to a different set of three inputs. Suppose q is the reducer size. Which of the following functions of n and q approximates, to within a constant factor, the lowest possible replication rate for a mapping schema that solves this problem?

Suppose we are running the DGIM algorithm (approximate counting of 1’s in a window. At time t, the list of bucket sizes being maintained is 8,4,4,2,1,1. At times t+1, t+2, and t+3, 1’s arrive on the input. Assuming no buckets are deleted because they fall outside the window, what are the numbers of buckets after each of the times t+1, t+2, and t+3?

Apply the HITS algorithm to a network with four pages (nodes) A, B, C, and D, arranged in a chain:A–>B–>C–>D

Compute the hubbiness and authority of each of these pages (scale doesn’t matter, because you only have to identify pages with the same hubbiness or the same authority). Which of the following is FALSE.

Let G be the complete graph on five nodes (i.e., there is an edge in G between every pair of distinct nodes). What is the sum of the squares of the elements of the Laplacian matrix for G?

Note: This problem is similar to one on the Basic Final, but involves a combiner.Consider the following MapReduce algorithm. The input is a collection of positive integers. Given integer X, the Map function produces a tuple with key Y and value X for each prime divisor Y of X. For example, if X = 20, there are two key-value pairs: (2,20) and (5,20). The Reduce function, given a key K and list L of values, produces a tuple with key K and value sum(L) i.e., the sum of the values in the list.

Suppose we process the input 9, 15, 16, 23, 25, 27, 28, 56, using a Combiner. There are 4 Map tasks and 1 Reduce task. The first Map task processes the first two inputs, the second the next two, and so on. How many input tuples does the Reduce task receive?

Consider an AdWords scenario with 4 advertisers competing for the same query Q, all with the same budget of $100 and the same clickthrough rate. The table below shows the bid and the dollars spent by each advertiser until this point. Suppose we use Generalized BALANCE, and show one ad for each query. Which advertiser do we pick the next time query Q comes up?

Advertiser	Bid	Spend
A	$1	$20
B	$2	$40
C	$3	$60
D	$4	$80

Suppose we wish to estimate the rating of movie M by user U using item-Item Collaborative Filtering, but there are no movies really similar to movie M. The average of all ratings is 3.5, user U’s average rating is 3.1, and movie M’s average rating is 4.3. What is our best guess for the rating of movie M by user U using a global baseline estimate?

The table below shows data from ten people showing whether they like four different ice cream flavors.

Fit a decision tree that predicts whether somebody would like Peanut ice cream based on whether she liked the other three flavors. Use Information gain as the measure to make the splits. What is the order of splits?

For an unknown graph with 3 nodes, r₁ is the topic sensitive PageRank using teleport set {0, 1} and r₂ is is the topic sensitive PageRank using teleport set {1}. What’s the value of the topic sensitive PageRank vector when using teleport set {0}?

A is a users times movie-ratings matrix like the one seen in class. Each column in A represents a movie, and there are 5 movies in total. Recall that a Singular Value Decomposition of a matrix is a multiplication of three matrices: U, Σ and V. is the following is such a decomposition for matrix A:

If we get three new users with the following rating vectors: User 1: [5,0,0,0,0] User 2: [0,5,0,0,0] User 3: [0,0,0,0,4] If for advertising purposes we want to cluster these three customers into two clusters using the movie concepts as features. How would you cluster them? (use cosine distance).

The soft margin SVM optimization problem is:

If for some i we have ξ=0, this indicates that the point x_i is (check the true option):