So two things that we wanted to check during lecture today, and some notes:
- If is sub-Gaussian with parameter , and they are independent, then is indeed sub-Gaussian with parameter , as claimed. Basically, just use the MGF definition to show this. And note the analogy to Gaussians, where should be the standard deviation, and not the variance.
- I got the sub-exponential equivalence slightly wrong. The MGF-based definition: there exist parameters such that
This is equivalent to there existing some other constants such that
See Theorem~2.2 here for a proof. (Thanks for pointing out that mistake, Tom!)
- For compressive sensing, there are a million resources online. E.g., here’s Terry Tao on the topic.
- I should have emphasized: the blood testing example we talked about was the simple case where you were guaranteed that the vector was -sparse. I.e., there is exactly one person with the disease among a population of people. Then the binary search strategy we did used linear tests, which is optimal. (To clarify, for each , the test combines together the samples for all people whose index has a in the place and tests this combination. Now construct a -bit vector with a in the position precisely if the test came up positive: this is the index of the person with the infection.
Note this is a non-adaptive strategy: we can write down all the tests up-front, and can read off the answer from their results. This is opposed to an adaptive strategy that would look at the answers to previous tests to decide which sets to test next.
What about the case where there are exactly two people infected? The same strategy does not work. In fact, since there are answers and each answer gives us bit each time, we must perform at least tests. Any thoughts on how to do this? An adaptive strategy that uses tests is easy: can you get a non-adaptive strategy? Using randomness?