Tag Archives: Antibodies

False Positives, False Cases, False Deaths

14 Monday Sep 2020

Posted by in Coronavirus, Pandemic

≈ Leave a comment

Tags

, , , , , , , , , , , , , , , ,

The tremendous increase in testing for COVID-19 (C19) this summer was associated with an increase in cases. Most of these tests were so-called PCR tests with samples collected via deep nasal swabs. More testing did not fully explain the increased case load, but false positives (FPs) still accounted for a substantial share. That’s especially true in light of the decline in positivity rates, which reflected a decline in the actual prevalence of active infections. FPs also account for a substantial share of the deaths attributed to COVID, which are obviously cases of false attribution. If a test for C19 is positive, it will be listed on the death certificate.  

COVID Case Inflation

The exaggeration of confirmed cases due to FPs is more substantial as the prevalence of active infection declines. That’s because the share of true positives in the tested population declines, while the share of false positives must rise due to the greater share of uninfected individuals in the population.

Now, as the contagion is waning in former hot spots, there is a danger that FPs create the impression of persistence in the case counts. That’s costly not just for those incorrectly diagnosed, but also in terms of medical resources, for communities subject to excessive public intervention, such as inappropriate lockdowns, and in terms of the fear promoted by these inaccuracies.

FPs are extremely disruptive when testing is relied upon in critical situations such as health care staffing, or even among sports teams. For example, at the University of Arizona, out of 25 positive tests on September 3, only 10 were confirmed as positives in later tests. The NFL has also had its share of false positives. 

Lax Testing Standards

There is evidence that testing standards under CDC guidance are so broad that a large number of inactive, non-infectious cases are being flagged as positives (see the chart above for the intuition, as well as the graphic at the bottom of this post). The tests sometimes amount to a coin flip when it comes to evaluating positives; some of the positives might even come from non-novel coronaviruses such as the common cold! This paper by Andrew N. Cohen, Bruce Kessel, & Michael G. Milgroom – CKM) questions the guidance of public health authorities on testing more generally. From the abstract (my emphasis):

“Unlike previous epidemics, in addressing COVID-19 nearly all international health organizations and national health ministries have treated a single positive result from a PCR-based test as confirmation of infection, even in asymptomatic persons without any history of exposure. …  positive results in asymptomatic individuals that haven’t been confirmed by a second test should be considered suspect.”

False Positive Math

When I wrote about “The Scourge of False Positives” in July. I noted that a test specificity of 95% implies that 5% of uninfected individuals will falsely test positive. Unfortunately, that still produces a huge number of FPs when testing is broad. That’s NOT a good reason to avoid broad testing; it just means that positive tests should be confirmed by another test. (In this case, two tests with the same specificity reduce a 5% false positive rate to 0.25%. That’s why fast, cheap tests are necessary for confirmation.

Again, exaggerated case counts due to FP’s become more severe as a contagion wanes. That’s because FPs become an increasingly large share of positive test results and overstate the persistence of the virus. If active infections fall to 1% of 750,000 daily tests, or 7,500 true cases, the 5% specificity implies 37,125 FPs: true positives would be only 17% of positive cases. Much worse than a coin flip! And again, which cases are infectious?

How Bad Are FPs, Really?

This recent research, also authored by CKM, explains the reasons why FPs are usually an issue in the real world, despite the tests’ reportedly perfect reactivity to anything other than the virus’ genetic fragments. CKM find that the median FP rate in their sample of “tests of tests” was 2.3%. That means 23 out of every 1,000 uninfected people tested will test positive.

If that seems small to you, suppose the true prevalence of active infection in a population is 4%. If 1,000,000 people are tested and there are no false negatives (unlikely), then 40,000 infected people will be identified by the test. However, another 22,000 uninfected people will also test positive ((1,000,000 – 40,000 infected) x 0.023). That means the number of positive tests will be inflated by 55%. They’ll all receive some form of treatment or ordered into quarantine. Expanded Testing and FPs This summer, the volume of daily tests increased from about 150,000 a day in early April to more than 750,000 a day in July. That’s a 400% increase, but the true prevalence of active infection in the expanded test population during the summer was almost certainly lower than in the spring. Suppose active infections fell from 10% of the test population in the spring to 5% in the summer. That means the daily number of “true positives” would have risen from 15,000 to 35,000 in the expanded test population (and again I assume no false negatives for simplicity). The number of FPs, however, would have risen from 3,105 to 16,445. Therefore, FPs would have accounted for 40% of the increase in “confirmed” cases between spring and summer.

False COVID Deaths

FPs are also inflating COVID death counts. PCR tests are routinely given at hospital admission for any cause, and even after sudden death, especially as the availability of tests increased late in the spring. This subset of the tested population will certainly have its share of FPs. If such a patient dies, regardless of underlying cause, it might well be attributed to COVID-19 as it will still appear on the death certificate. The same has occurred in the case of traffic fatalities, suicides, and other sudden deaths.

Antibody Tests

The FP problem also plagues tests of seroprevalence, which determine whether an individual has had the virus or is cross-protected against the virus by antibodies acquired via non-novel coronavirus infections. The consequences of these antibody FPs can be serious as well, because it means a positive test might not ensure immunity. As the exposed share of the population increases, however, the FP share of antibody tests is diminished.

Conclusion

As long as testing is required, dealing with FPs (and false negatives, of course) requires repeated testing, as CKM state unequivocally. And the tests must be fast to be of any use. The current testing regime must be overhauled to prevent false positives from costly impositions on the lives of uninfected patients, consuming unnecessary medical resources, making unrealistic assessments of cases and deaths, and unnecessary suspensions of normal human social activity and liberty.

Not News: Infections and Long-Term Complications

06 Sunday Sep 2020

Posted by in Coronavirus, Health Care

≈ Leave a comment

Tags

, , , , , , , , , , , , , , , , ,

At 15 years of age I was diagnosed as a Type I diabetic — 49 years ago. I had a genetic predisposition, but I’ve been told by several endocrinologists over the years that an “event” likely triggered the antibody response for which I was predisposed. The event was, in all probability, a viral or bacterial infection. The autoimmune response to that infection attacked the islet cells in my pancreas and destroyed my body’s ability to produce insulin. I’ve been dependent on external delivery of insulin ever since. Life goes on.

I relate this information to emphasize that it is not “novel” for a virus to trigger long-term “complications”. Recently, certain media factions have been shrieking about the long-term complications that might be triggered by the coronavirus (C19) even in those with otherwise light symptoms. Those are unfortunate, but again, this aspect of viral and bacterial infection is not uncommon.

We know, for example, that bacterial and viral infections often trigger autoimmune diseases like diabetes. Other examples are chronic fatigue syndrome, fibromyalgia, rheumatoid conditions, celiac disease, Graves’ disease, Guillain-Barré syndrome, Sjogren’s Syndrome, multiple sclerosis, and many others.

One condition that’s been cited as an especially dangerous complication of C19 is myocarditis, or inflammation of the heart muscle. This has been invoked as a reason to cancel sports competitions, for example. (See here for a denial of one rather hyperbolic claim regarding this condition.) Myocarditis has a long history as a side effect of influenza. Most people recover with no long-term complications, and others manage to live with it and remain productive. While C19 is “novel”, infection-induced myocarditis is not.

If you catch a virus or a bacterial infection, you might experience other complications with varying severity. Get used to the idea. It’s an unfortunate fact of life.

COVID Immunity, Herd By Herd

01 Tuesday Sep 2020

Posted by in Coronavirus, Herd Immunity

≈ Leave a comment

Tags

, , , , , , , , , , , , , , ,

Too many public health authorities remain in denial, but epidemiologists are increasingly convinced that heterogeneity implies a coronavirus herd immunity threshold (HIT) that is greatly reduced from traditional models and estimates. HIT is the share of the population that must be infected before the contagion begins to recede (and the transmission ratio R falls below one). Traditional models, based on three classes of individuals (Susceptibles, Infectives, and Recovered – SIR), predict a HIT of 60% or more. However, models that incorporate variation in susceptibility, transmissibility, and occupational or social behavior reduce the HIT substantially. Many of these more nuanced models show that the HIT could be in a range of just 15% to 25%. If that is the case, many regions are already there!

For background, I refer you to the first post I wrote about heterogeneity in late March, more detailed thoughts from early May, examples and more information on the literature later in May. I’ve referenced it repeatedly in other posts since then. And now, more than five months later, even the slow kids at the New York Times have noticed. The gist of it: if not everyone is equally susceptible, for example, a smaller share of the population needs to be “immunized via infection” to taper the spread of the virus.

Some supporting evidence appears in the charts below, courtesy of Kyle Lamb on Twitter. The first chart shows a seven-day average of C19 cases per million of population for ten states that reached an estimated 10% antibodies. These antibodies confer at least short-term immunity against C19. Most of these states saw cases/m climb at least through the day when the 10% level was reached, though Rhode Island appears to have been an exception.

The second chart shows the seven-day average of cases/m in the same states starting seven days after the 10% immunity level was reached. I’d prefer to see the days in the interim as well, but the changes in trend are still noteworthy. All of these states except Louisiana had a downturn in the seven-day average of new cases within a few weeks of breaching the 10% infection level (Louisiana had distinct and non-coincident outbreaks in different parts of the state). These striking similarities suggest that things turned as the infection level reached 15% or more, consistent with many of the epidemiological models incorporating heterogeneity.

Next, take a look at the states in which C19 surged most severely this summer. The new cases are not moving averages, so the charts are not quite comparable to those above. However, the peaks seem to occur prior to the breach of the 15% infection level.

Speculation about early herd immunity has been going on for several months with respect to various countries and even more “micro” settings such as cruise ships and military vessels, where populations are completely isolated. Early on, this “early” herd immunity was discussed under the aegis of “immunological dark matter”, but we know now that T-cell immunity has played an important role. In any case, anti-body expression (or seroprevalence) at around 20% has been linked to reversals in C19 cases and deaths in several countries. As Yinon Weiss notes, New York City and Stockholm were both C19 hotspots in the spring, both have seen deaths decline to low levels, and they have little in common in terms of public health policy. London as well. The one thing they share are similar levels of seroprevalence.

An important qualification is that herd immunity is not relevant at high levels of aggregation. That is, herd immunity won’t be achieved simultaneously in all regions. The New York City metro area might have reached its HIT in April, but Florida (or perhaps only Miami) might have reached a HIT in July. Many areas of the Midwest probably still aren’t there.

In the absence of a new mutation of C19, the final proof of herd immunity in many of the former hotspots will be in the fall and winter. We should expect at least a few cases in those areas, but if there are more intense contagions, they should be confined to areas that have not yet seen a level of seroprevalence near 15%.

COVID Seasonality and Latitudes

23 Sunday Aug 2020

Posted by in Pandemic

≈ 2 Comments

Tags

, , , , , , , , , , , , , , , , , , , , , , , , ,

The coronavirus (C19), or SARS-CoV-2, has a strong seasonal component that appears to closely match that of earlier SARS viruses as well as seasonal influenza. This includes the two distinct caseloads we’ve experienced in the U.S. 1) in the late winter/early spring; and 2) the smaller bump we witnessed this summer in some southern states and tropics. 

COVID Seasonal Patterns and Latitude

The Ethical Skeptic on Twitter recently featured the chart below. It shows the new case count of C19 in the U.S. in the upper panel, and the 2003 SARS virus in the lower panel. Both viruses had an initial phase at higher latitudes and a summer rebound at lower latitudes.

 

 

 

 

 

 

 

 

 

 

I particularly like the following visualizations from Justin Hart demonstrating the pandemic’s pattern at different latitudes (shown in the leftmost column). The first table shows total cases by week of 2020. The second shows deaths per 100,000 of population by week. Again, notice that lower latitudes have had a crest in the contagion this summer, while higher latitudes suffered the worst of their contagion in the spring. Based on deaths in the second table, the infections at lower latitudes have been less severe.

Viral Patterns in the South

Many expected the pandemic to abate this summer, including me, as it is well known that viruses don’t thrive in higher temperatures and humidity levels, and in more direct sunlight. So it is a puzzle that southern latitudes experienced a surge in the virus during the warmest months of the year. True, the cases were less severe on average, and sunlight and humidity likely played a role in that, along with the marked reduction in the age distribution of cases. However, the SARS pandemic of 2003 followed the same pattern, and the summer surge of C19 at southern latitudes was quite typical of viruses historically.

A classic study of the seasonality of viruses was published in 1981 by Robert Edgar Hope-Simpson. The next chart summarized his findings on influenza, seasonality, and latitude based on four groups of latitudes. Northern and southern latitudes above 30° are shown in the top and bottom panels, respectively. Both show wintertime contagions with few infections during the summer months. Tropical regions are different, however. The second and third panels of the chart show flu infections at latitudes less than 30°. Influenza seems to lurk at relatively low levels through most of the year in the tropics, but the respective patterns above and below the equator look almost like very muted versions of activity further to the north and south. However, some researchers describe the tropical pattern as bimodal, meaning that there are two peaks over the course of a year.   

So the “puzzle” of the summer surge at low latitudes appears to be more of an empirical regularity. But what gives rise to this pattern in the tropics, given that direct sunlight, temperature, and humidity subdue viral activity?

There are several possible explanations. One is that the summer rainy season in the tropics leads to less sunlight as well as changes in behavior: more time spent indoors and even less exposure to sunlight. In fact, today, in tropical areas where air conditioning is more widespread, it doesn’t have to be rainy to bring people indoors, just hot. Unfortunately, air conditioning dries the air and creates a more hospitable environment for viruses. Moreover, low latitudes are populated by a larger share of dark-skinned peoples, who generally are more deficient in vitamin D. That might magnify the virulence associated with the flight indoors brought on by hot and or rainy weather.   

Mutations and Seasonal Patterns

What makes the seasonal patterns noted above so reliable in the face of successful immune responses by recovered individuals? And shouldn’t herd immunity end these seasonal repetitions? The problem is the flu is highly prone to viral mutation, having segments of genes that are highly interchangeable (prompting so-called “antigenic drift“). That’s why flu vaccines are usually different each year: they are customized to prompt an immune response to the latest strains of the virus. Still, the power of these new viral strains are sufficient to propagate the kinds of annual flu cycles documented by Hope-Simpson.

With C19, we know there have been up to 100 mutations, mostly quite minor. Two major strains have been dominant. The first was more common in Southeast Asia near the beginning of the pandemic. It was less virulent and deadly than the strain that hit much of Europe and the U.S. Of course, in July the media misrepresented this strain as “new”, when in fact it had become the most dominant strain back in March and April.

What Lies Ahead

By now, it’s possible that the herd immunity threshold has been surpassed in many areas, which means that a surge this coming fall or winter would be limited to a smaller subset of still-susceptible individuals. The key question is whether C19 will be prone to mutations that pose new danger. If so, it’s possible that the fall and winter will bring an upsurge in cases in northern latitudes both among those still susceptible to existing strains, and to the larger population without immune defenses against new strains.

Fortunately, less dangerous variants are more more likely to be in the interest of the virus’ survival. And thus far, despite the number of minor mutations, it appears that C19 is relatively stable as viruses go. This article quotes Dr. Heidi J. Zapata, an infectious disease specialist and immunologist at Yale, who says that C19:

“… has shown to be a bit slow when it comes to accumulating mutations … Coronaviruses are interesting in that they carry a protein that ‘proofreads’ [their] genetic code, thus making mutations less likely compared to viruses that do not carry these proofreading proteins.”

The flu, however, does not have such a proofreading enzyme, so there is little to check its prodigious tendency to mutate. Ironically, C19’s greater reliability in producing faithful copies of itself should help ensure more durable immunity among those already having acquired defenses against C19.

This means that C19 might not have a strong seasonal resurgence in the fall and winter. Exceptions could include: 1) the remaining susceptible population, should they be exposed to a sufficient viral load; 2) regions that have not yet reached the herd immunity threshold; and 3) the advent of a dangerous new mutation, though existing T-cell immunity may effectively cross-react to defend against such a mutation in many individuals.

 

Case Fatality, Stale Ratios and Exaggerated Loss

14 Tuesday Jul 2020

Posted by in Analytics, Pandemic

≈ Leave a comment

Tags

, , , , , , , , ,

I hope someday I won’t feel compelled to write or worry about the coronavirus. However, as the pandemic wears on, it seems to take only a few days for issues to pile up, and I just can’t resist comment. Today I have a couple of beefs with uses of data and concomitant statements I’ve seen posted of late.

People are still quoting case fatality rates (CFRs) as if those cumulative numbers are relevant to the number of deaths we can expect going forward. They are not. Just as hair-brained are applications of cumulative hospitalization and ICU admittance rates to produce “rough and ready” estimates of what to expect going forward. Or, I’ve seen people express hospitalizations as ratios to CFR, as if those ratios will be the same going forward. Again, they are not. Let me try to explain.

The chart below shows the course of the U.S. CFR since the start of the pandemic. It’s taken from the interactive Covid Time Series site. My apologies if you have to click on the chart for decent viewing (or you can visit the site). The CFR at any date is the cumulative number of deaths to-date divided by the cumulative number of confirmed cases. It is a summary of past history, but it is not well-suited to making predictions about death rates in the future. The CFR began to taper a little before Memorial Day, and it is now at about 4% (as of July 13).

Out of curiosity, I also generated CFRs for AZ, CA, FL, GA, and TX, which now average about half of the national CFR. There’s an obvious lesson: if you must use CFRs, understand that they vary from place to place.

Again, CFRs are cumulative. Their changes over time can tell us something about recent trends, but even then they are flawed. For example, case counts have risen dramatically with more widespread testing. Those testing positive more recently are concentrated in younger age cohorts, for whom infections are much less severe. Treatment has improved dramatically as well, so there is little reason to expect the CFR’s of recently diagnosed cases to be as high as the latest CFRs shown above.

There is no easy way to calculate an unflawed “marginal” CFR for a recent period, though an effort to do so might improve the predictive value. Deaths lag behind case counts because the progression from early symptoms to death can take several weeks. Even more vexing for constructing a valid, recent fatality rate is that reporting of deaths is itself delayed, as I explained in my last post. Each day’s report of deaths captures deaths that may have occurred over a period of several weeks in the past, and sometimes many more.

Finally no CFR can capture the true mortality rate of the virus without ongoing, ubiquitous testing. As the state of testing stands, the true mortality rate must reflect undiagnosed cases in the denominator. The CDC’s latest “best” estimate of the true mortality rate is just 0.3%, and 0.05% for those aged 50 years or less. Those figures are based on serological tests for the presence of antibodies to C19 in more random samples of the population. Those findings reflect the extent of undiagnosed and/or asymptomatic cases.

The point is one shouldn’t be too blithe about throwing numbers around like 4% mortality based on the CFR, or even 1% mortality as a “nice, round number”, without heavy qualification. Those numbers are gross exaggerations of what we are likely to see going forward.

The same criticisms can be leveled at claims that hospitalizations will proceed at some fixed ratio relative to diagnosed cases, or some fixed ratio relative to deaths. Again, new cases tend to be less severe, so hospitalizations are likely to be a much lower ratio to cases than what is reflected in cumulative totals. Because of improved treatment, the ratio of deaths to hospitalizations will be much lower in the future as well.

CFRs are not a useful guide to future COVID deaths. The true mortality rate is a much better baseline, particularly for subsets of the population matching the current case load. Finally, and this is the only disclaimer I’ll bother to provide today, we all know that suffering is not confined to terminal cases, and it is not confined to the hospitalized subset. But don’t exaggerate the extent of your preferred interpretation of suffering by applying inappropriate cumulative calculations.