Tuesday, May 5, 2020

COVID 19 Update: Is More Testing the Solution?


*I will try to stick to facts as I understand them.  Any opinions I express are not necessarily those of the leadership of my medical group or profession.

Almost from the beginning of the COVID 19 crisis, the subject of testing has been a flash point between the federal government and the states as well as between the government and the news media.  I believe almost everybody agrees test availability was woefully lacking in the early days of the crisis.  Availability improved considerably, but still falls way short of "enough for anyone who wants it" that some seem to be demanding. But is "testing everyone" realistically achievable and is is even desirable?  In my opinion, much of the confusion and misunderstanding stems from a basic lack of understanding of what testing tells us and what it doesn't and more importantly, what we do with test results after we have them.  So, I thought I would start with the basics of laboratory testing to help folks better understand the issues at stake here.

I understand that in law schools they teach students to never ask a question they don't already know the answer to.  In medical schools, we teach students to never order a test if they don't know what action they will take or not take when they know the results.  Will a positive test make you initiate a medication or treatment or additional testing?  Will a negative test lead you to withhold or stop treatment?  If we do not know the answer to these questions, we should not be ordering the test in the first place!  Before we can make decisions about test results, we need to understand several things about the accuracy of the tests we order.  Here are the key terms:

Sensitivity(true positive rate):  The sensitivity of a test is the probability that a patient who has the condition in question will have a positive test.  Let's say you have a group of 100 patients and 10 of them have disease X.  A perfectly sensitive test will be positive in all 10 of the patients who have the disease.  Now, maybe the test is also positive in 10 patients who don't have the disease(false positive), but that does not diminish the sensitivity of the test because you know that all 10 patients with the disease you are looking for are in that group of 20 with positive tests.  You can now tell the other 80 patients they don't have the disease and concentrate on the 20 that are left.  Highly sensitive tests are generally useful as screening tests with patients testing positive undergoing additional testing to identify the true positives from the false positives.

Specificity(true negative rate): The specificity of a test is the probability that a patient who does not have the disease will have a negative test.  If a test is perfectly specific then 100% of patients who don't have the disease will have a negative test. Let's say in our sample population you run a test with 7 positives and 93 negatives.  All 7 of the patients who test positive have the disease because all 90 of the patients who don't have the disease are in the 93 who test negative.  Highly specific tests are generally useful for confirming the presence of the disease you are testing for.

Precision:  Precision is the probability that when you perform the same test on the same person multiple times, you will get the same result or in quantitative tests, how close you get to the same result on repeated testing.

Positive Predictive Value:  Positive Predictive Value(PPV) is the probability that subjects with a positive screening test truly have the disease.  This value is heavily influenced by the composition of the population you are testing.  Let's take our sample population again where you have 10 patients with the disease and 90 who don't.  But, the test you are running has a 30% false positive rate and a zero false negative rate.  All 10 patients with the disease will test true positive but 30% of the other 90 who don't have the disease will also test positive.  Out of the total of 37 patients who test positive there is only a 10/37 or 27% chance that any one of those patients truly has the disease and a 73% chance the test is falsely positive.

Negative Predictive Value:  Negative Predictive Value(NPV) is the probability that a patient with a negative test does not have the disease.

*********************************************************************************

There are two basic types of tests for COVID 19:  1.  Tests that directly test for the current presence of the virus.  2.  Test for antibodies to the virus which can be subdivided into IgM(current or recent infection) and IgG(past infection).

Tests for the current presence of the virus are highly specific but have a 5-30% false negative rate(they are much less sensitive). False negatives can be due to flaws in collection methods, improper handling of the specimen or faulty reagents. If you strongly suspect a patient has COVID based on symptoms and signs but the test is negative, it is wise to run a second test.  There have been reports of patients with classic symptoms and clinical course who did not test positive until the 3'rd test was run!  Assuming the results of the first test do not bias the results of the second and so on, by the time you have 3 negative tests, each with a 30% false negative rate, you can whittle down your false negatives to under 3%.

The major problem that has emerged with antibody tests is they are reported to have 7-30% false positive rates depending on which of many brands of tests are being used.  If only 4% of the population has or had the disease and the test has a false positive rate of 30%, the test has an extremely low PPV and an almost 90% chance that any one positive test is a false positive.

6 comments:

  1. Appreciate the fantastic and valuable info for a layman.

    Please keep it coming Doc.

    ReplyDelete
    Replies
    1. Thank you for reading. Hope it is helpful information.

      Delete
  2. Based on what we know from the last 6 weeks dealing with this virus, would a more selective quarantine with only high risk individuals required to stay home work? Most elderly are retired and anyone else deemed a high risk could stay at home and allow everyone else to go back to work while following all the safety guidelines we have been told (wash hands, don't touch face, wear a mask, etc.). Some of the healthy may get sick and die but the percentage would be far less. High risk individuals would be protected and the economy could start back up. Right now there are too many negative affects from shutting down the economy and if everyone went back to work there would be too many deaths from the virus. Seems like this could be an acceptable solution to protect both the people and the economy.

    ReplyDelete
    Replies
    1. So far, every single country and region that has relaxed mitigation measures even slightly has seen an almost immediate increase in cases.

      Delete
  3. Hi DrB: Love the blog as usual. Would like to get back to watching our A+ San Jose prospects light it up.
    I agree that in medicine, one tests to answer a question that makes a difference in treatment. COVID-19 doesn't have an effective treatment, but I believe the paradigm here for testing is different.
    In public health terms, we don't have an accurate assessment of who is infected and who is not. This is because the virus can be carried by asymptomatic or minimally symptomatic people, and the virus has spread to a fairly decent percentage of the population. To reduce the eventual impact of the virus flaring up again, testing and contact tracing need to be employed. This type of testing is to improve the Awareness of those that need to stay isolated for a period of time.
    Given the vast prevalence of the problem, one strategy proposed has been to keep testing until your number of positive tests are somewhere around 3-5%. (This is close to the number for South Korea or other nations that have minimal deaths from the disease) Only then can you say that from a public health standpoint, you've got a fairly good sense of most of the potentially infected carriers and transmitters such that the pandemic doesn't spread as drastically when you open up businesses. I doubt that we have tested enough, because there are still many "unknown" carriers and their impact may not be felt until more people are hospitalized or seriously harmed, which is too late. this is why the medical advice of people like Dr. Anthony Fauci makes sense-- we have to ramp up testing.

    ReplyDelete
    Replies
    1. So, you are jumping ahead of me here. The purpose of this post was more of a basic primer on the principles of interpreting lab tests. I am going to address the different uses of tests in my next post. Yes, there is a big difference between testing for clinical decisionmaking and for epidemiological purposes. In either case, you must have a plan for what you are going to do with the results once you have completed the tests. Does a positive test tell you to start treatment? We don't really have any specific treatment at this point. Does it tell you to Isolate the patient? To take them out of isolation?

      In epidemiology, we have 3 basic strategies: Containment, mitigation and doing nothing while waiting for herd immunity. If your strategy is containment, clearly you need to test aggressively with rapid results, aggressive quarantining of cases and contact tracing. We long since lost to opportunity to do that effectively so the current strategy, which BTW we are not doing aggressively enough as opposed to too aggressively, is mitigation. It is less clear what role testing has in a mitigation strategy. Do you test for the virus or for antibodies to the virus? How do you account for false positive and false negative tests? Let's say you had the capability of simultaneously testing all 320 million people in the country, which we don't. What instructions are you going to give the people who test positive? Who test negative? If there is a national plan for that right now, I would be interested in reading about it because I am not aware of one.

      Stay tuned!

      Delete