Showing posts with label miracles. Show all posts
Showing posts with label miracles. Show all posts

Friday, August 5, 2011

An unconfirmability argument

[A caution: This post is long, verbose, and overly technical. Read the dialogue I posted at the end. If it is comprehensible to you, you should have an adequate grasp of the contents of this and the previous post.]

In my last post, I interpreted Hume's argument against the confirmability of miracles and found it to be unsound. Now I want to affirmatively answer another question: given that Hume's argument is unconvincing, is there another unconfirmability argument which applies to paradigm miracles like the Resurrection?

If so, we are not doomed to Earman's (apparent) conclusion, that we must analyze the details of every miracle claim if we are to safely reject miracles (p.3). Rather, we can specify categories of claims, narrower than `miracle', that cannot be confirmed by certain categories of evidence. Though we might not safely assert something like "no evidence you have should convince me of a miracle," we may be able to say something like "by itself, the evidence you present is by nature incapable of overcoming the prior probability of the type of miracle you assert." I will leave open the possibility that miracles like the Resurrection (R) can be confirmed; I am only closing a class of potential means of doing so. I do not think that I am providing or can provide "an everlasting check to all kinds of superstitious delusion" which "will be useful as long as the world endures" (EPHU, p.169); rather, I am giving something which, if successful, would obviate any non-pedagogical, rational need for any detailed Bayesian analysis of the Resurrection like this one, so long as we lack other significant arguments in favor of Christianity. One notices the number of qualifiers required to invest in such an argument, and there will be more. This form of argument does not constitute a license for ignorance, and it will require creative adaption to specific miracle claims.

A lot hinges on the problem of determining appropriate priors in subjective Bayesianism. In order to provide some convincing estimate of the prior odds on R, a trick - I think novel to me - must be applied.

To motivate this trick, I'll cite its precedent and inspiration: the method of reparation, originally due to Richard Jeffrey. This tool was invented for a specific problem, the problem of old evidence. Roughly, the problem is as follows: whenever a new theory is crafted, its ability to explain known phenomenon is considered to be of epistemic significance. For example, relativity theory's ability to `predict' the perihelion precession of Mercury - a phenomenon which had long defied explanation in classical physics - is considered powerful evidence for that theory. But the hypothetico-deductive principle, which states that verification of an uncertain prediction of an uncertain hypothesis increases the probability of that hypothesis, is incapable of yielding this well-founded intuition; the `prediction' is already known, i.e. not uncertain.

Reparation solves this problem by positing a hypothetical prior probability, an ur-distribution or ur-prior, in which the theoretical prediction itself in addition to the corresponding observation is treated as uncertain. The `discovery' of that implication and the evidence then raises the probability of the hypothesis in question in a straightforward way. I want to extend this to a problem which plagues estimating the prior probability of miracles, i.e. the problem of old evidence and explanation, or if you prefer, the old everything problem. When priors are not in dispute, this method is unnecessary; this is not an actual case of confirmation. But on the very safe assumption that the prior probability of R, in the absence of other argument, is calibrated with respect to confirmation of natural principles, it is quite useful. We `know' that the prior ratio is small, but we do not know how small. This is important when disputes depend on whether or not that prior is greater than 1/1000 or less than 10-44. We need something better than the `vague intuitions' rightly deplored by the McGrews (CCRJ, p.50).

The idea is to posit an ur-prior u which is (partially) devoid of current background knowledge. The voided background knowledge is treated as uncertain in u, the recapturing of which yields through conditionalization a suitable prior p. In this context, the `recaptured' knowledge is the bulk of the `uniform evidence of sense' discussed by Hume, which is assumed to be wholly confirmatory of the law L. As I am working with the Resurrection, L is the principle that dead people remain dead. By definition and subset rule, we have for any probability pr that

.

By quick algebra, we yield the following inequality:

.

So by calculating our confidence in L, we set a maximum confidence in R.

As I mentioned, we want to `recapture' p using u by conditioning, that is,

,

where O is the set of observations confirming the putative law. But here I seem to have merely shifted the problem elsewhere, since we now need the u-odds on ~L. This regress is halted by the following abstract consideration: at some theoretical point of time, a hypothetical rational agent should have crossed the `more likely than not' threshold in favor of the law. For this reason, we may assume that the u-odds on ~L is 1. From there we must estimate the raw confirmatory force of the remaining experience as captured by the u-Bayes factor. Cleaning up the previous mess, we want to analyze

.

Now here is the crucial question: what does ~L look like after this partial recapitulation of background knowledge? An `anti-law' which states that all dead people resurrect will have probability zero, but this is an extreme; the preexisting information will select for those non-laws which ascribe higher probability to individual non-resurrections. These include, amongst other things, statements like "everybody who dies remains dead except under very rare conditions." However, even this will be made less probable by O so long as the further prediction of its elements are uncertain. Unless one claims to be able to specify in advance who should be exempted from death based on limited confirmation, the effect remains strong as regards statements like "everybody stays dead except for Jesus." (Lazarus and other proposed resurrections are not part of the background knowledge being recaptured here.)

To go further, I assume that O contains N instances of confirmation beyond those which lead our hypothetical agent to equivocate, each of which are of equal weight1, i.e.



where I use the combinatorial notation [N]={1,...,N} for the sake of cleanliness. Supposing that each element of O is independent modulo ~O, we have that

.

So if N=106, even a quite large value for u(O1|~L) yields an absurdly small upper bound on the prior odds on R. If this assumption of independence is to fail in favor of the theists, there must be in the domain of u some significant set of propositions in ~L that correlate the elements of O. In other words, there must be plausible causal processes not implying L which probabilistically tend to keep dead people dead.

And here is where the remainder of our scientific knowledge and experience come into play. We do not consider L to be a fundamental feature of the universe but a consequence of other properties. Were a technology developed that allowed for the reanimation of corpses, we need not say that a putative law of nature had been overturned; instead, we would say that the `ordinary course' had been altered by the introduction of a new yet naturalistic element. Without such technology, we expect other principles to produce L. These include thermodynamic principles. When Jesus died, there are three sorts of miraculous possibilities: either his vital tissues never fatally decayed by supernatural sustenance, his vital tissues decayed but were reconstituted gradually or suddenly prior to his reanimation, or he reanimated without the function of his vital organs. Each of these possibilities runs against other established regularities. Properly speaking, then, L is not merely the generalized rule that dead people remain dead but also the set of combinations of rules which produce that outcome. For the Resurrection to occur, every one of those combinations must fail to hold.

So a theory which advantageously counters the above independence assumption must probabilistically correlate the elements of O, have significant plausibility in its own right, and fail to assume or imply any element in L, be it the putative law itself or any combination of principles which produce that law. In this case and in the case of other miracles which violate mass/energy conservation and/or thermodynamic principles, we must toss out modern science before examining any evidence proposed against its principles. This is an absurd task, but that absurdity is consequent to proposing a suspension of the natural order.

In such a manner I tentatively maintain that the independent assumption as employed is valid in establishing an estimated upper bound on the prior odds on R. So long as we agree that it is disgustingly low, a precise value is unimportant for the strengthening of the argument. Since as you may have noticed this method of unconfirmability argument requires some detailed information concerning the relevant miracle, specifying any particular value is unimportant. For an approximate value's import to materialize, we must also delve into the category of evidence in play.

Hume appears to recognize the need for categorical bounds on the strength of evidence in his essay:
When any one tells me, that he saw a dead man restored to life, I immediately consider with myself, whether it be more probable, that this person should either deceive or be deceived, or that the fact, which he relates, should really have happened. I weigh the one miracle against the other; and according to the superiority, which I discover, I pronounce my decision, and always reject the greater miracle. If the falsehood of his testimony would be more miraculous, than the event which he relates; then, and not till then, can he pretend to command my belief or opinion. (EPHU, p.174)
I think that whenever Hume attempts to place such a bound on `testimonial evidence', he overreaches by virtue of that category's broadness. "I would not believe such a story were it told to me by Cato" (p.172) does not a sufficiently general argument make, nor are vague allusions to particular failures of human reporting which remain in the background, as these do not necessarily apply to all claims that humans make. Instead, it is better to focus on more task-specific categories. It might be possible to do so, but there is no reason to argue for more than is required.

Now I must specify what I mean by a categorical bound in formal terms: roughly, a categorical bound B is a real number such whenever evidence E for an uncertain hypothesis H lies in a set C, any Bayes factor produced by E is less than or equal to B.2 That is,

.

If H is a miracle claim violating a putative law L supported by recaptured observations O, then tautologically the argument is successful if

.

What remains is to show that the evidence proposed by the miracle-claimant lies in such a set C.

What would C look like? If we want to be trivial, we can use uncontroversial examples. For example, two gamblers who have vastly differing prior odds on the fairness of a coin should not be able to resolve their dispute by tossing the coin a small number of times to check the outcomes. With precise values available, one could derive the minimum number of tosses which could possibly result in agreement.

One may extend this notion by thinking of the epistemic limitations on experiments like "tossing a coin a certain number times" as instances of methodological bounds. In the medical sciences, anecdotal and testimonial evidence as applied to broad categories of claims is almost completely useless for confirmation; careful study is required. What this reflects is a well-founded confidence in systematic errors frequently present in anecdotal reports which cannot be sufficiently discounted in the absence of controlled study. Anecdotal evidence for a novel, popular medical hypothesis cannot by nature discount those established theories and credences, a task which is necessary in order to confirm the new remedy against a significant prior implausibility.

Similar considerations apply to many classes of potential miracles and the evidence most commonly presented for them. With the Resurrection, we need not attempt the task Hume appears to set for himself in arguing that any set of witness testimony is incapable of producing convincingly calibrated Bayes factors above something like 101000. In this case, we may instead suggest that the methods of historians in establishing the historicity of those reports and their background, while possibly very good, are not so good as to allow a confident assertion that the historical record produces a Bayes factor above 101000. Myth and utter fabrication, even if wildly improbable in this case, have precedents, and I do not think they are capable of being discarded with absolute or nearly absolute confidence given the difficulties in method.

Hoping my proposals have been convincing thus far, I conclude by giving the sort of conversation which two Bayesians could have.

Christian: Ah, skeptic! Just the person I was wanting to see! I have crafted a convincing case that the Resurrection did in fact occur, and I was wanting your feedback.

Skeptic: That sounds very interesting, but before we go into the details, would you consider the Resurrection, had it occurred, to have constituted a suspension of the natural order?

Christian: Certainly, as you well know. Otherwise, the Resurrection would be meaningless. If Jesus' Resurrection were, say, a mere product of absurdly unlikely but possible quantum fluctuations, then any argument to theism or Christianity from that event would be undermined. It would be an isolated physical anomaly; nothing more, nothing less, and surely not a communicative sign of divine endorsement of the validity of Jesus' teachings.

Skeptic: I'm glad that you and I agree. And within this possibly suspended natural order, would you admit that local, epistemic generalizations hold and that tremendous confidence in those generalizations is yielded by what Hume would call `uniform sense data'?

Christian: While I obviously do not accept Hume's argument, I agree that incredulity prior to the examination of the evidence is wholly reasonable. That is why I have analyzed the evidence; one cannot say prior to analysis whether or not the evidence is sufficient or insufficient. You and I both know that this is merely a matter of probability.

Skeptic: I do not accept Hume's argument either, but one may with certain conditions be able to obviate the need to examine all of the details in advance by grounding a posteriori bounds on Bayes factors produced by certain types of evidence.

Christian: Part of this worries me, as it sounds like an excuse to avoid examining the evidence, which, as a good skeptic and Bayesian, you should be interested in doing. In any case, I suspect that such an approach would undermine important areas of scientific research, were it to be accepted.

Skeptic: I admit that this idea is a time-saver and has its ideological attractions, but allow me to specify some of those conditions. Hopefully, when you are satisfied with their stringency, your worries will vanish. But before I may do so, I nevertheless must know the nature of the argument that you are proposing. As I said before, the bounds to which I refer would be a posteriori, not some analytic consequence of Kolmogorov's axioms, uncontroversial metaphysical theses, or sound subjective Bayesian principles. I could not pretend to Hume's rhetoric and claim "an everlasting check to all kinds of superstitious delusion," or claim to have silenced any potential reasoned argument on your part or the part of your comrades in arms, be they future comrades or present confederates. In order to state exactly what I can say in advance of detailed analysis, I have to consider at least some of the details.

Christian: That at least sounds more interesting than another platitudinous regurgitation of Hume's breathless meanderings. Fine, I will play along. I am arguing, as against many prominent skeptics, to and from the historicity of the texts with respect to several key facts, especially those facts concerning the secular claims of witness testimony.

Skeptic: Have you accorded these facts certainty in your analysis as opposed to a more general analysis, for example using Jeffrey conditioning or classical conditioning on a partition of the historical possibilities?

Christian: For the facts concerning the witnesses, I strengthened the relevant arguments so as to make those facts not only plausible, but so overwhelmingly likely as to ensure that errors of omission do not seriously undermine the strength of the argument.

Skeptic: How overwhelmingly likely?

Christian: I think that I see roughly where you are heading with this. By your earlier hintings, it is clear that you are relying on some estimate of the prior odds of the Resurrection. Riddle me this: How do you propose to estimate prior odds on the Resurrection in any convincing way? You and I are both critics of equivocation and objective Bayesianism. You and I both acknowledge the limitations of current theories of calibration, especially as applied to claims like the Resurrection.

Skeptic: Properly speaking, I do no such thing.

Christian: Help me out here.

Skeptic: I rely on the notion that miracles, to occur, require a suspension of the natural order. As you have probably anticipated, I rely on the epistemic status of that natural order with respect to any potential exemption to gauge a suitable prior on the Resurrection...

Christian: Sorry to interrupt, but clearly you seem to be contradicting yourself.

Skeptic: Only if you assume that I need a specific range of prior odds. Instead, I use the deductive implications of putative laws to straightforwardly derive inequalities via the subset rule which by basic algebra translate into an upper bound on the prior odds of the Resurrection. I only need inequalities and bounds, not specific, well-defined ranges of reasonable discussion.

Christian: Ah, I see. You're assuming that the only relevant calibrating factor is the relation of a potential suspension of the natural order to the epistemic status of the natural order, of course.

Skeptic: That's right; hence why I do not claim that my approach, even if valid, would constitute the end of the discussion. One may still need to engage the evidence, but only if an adequate, well-established natural theology is formulated so as to calibrate the priors differently.

Christian: Which of course would present a serious difficulty, since the primary and standard means of evidentially filtering Christianity out of the more general category of theism is by arguing for the Resurrection. Now I am curious: supposing you could bound the prior odds on the Resurrection below 10-1000, what would you say to me if I claimed to have produced a Bayes factor based on a confidence some salient facts which is greater than 101000?

Skeptic: I would say that you have proposed the a posteriori equivalent of proving the rationality of the square root of two, Euler's number, or pi.

Christian: That's quite a strong statement; how do you mean it?

Skeptic: I might agree that your proposed facts are plausible, even extremely convincing. But I would nevertheless insist that they cannot be sufficiently plausible as to yield such a factor. Formally, I would put evidence like that you have proposed into a set of similar evidences and claim that Bayes factors in favor of the Resurrection produced by an element in that set are below 101000.

Christian: In which case, your argument would be tautological or trivial unless you can convincingly establish, before engaging all of the details, that my textual evidence cannot be stronger. Again, I do not see how you are avoiding the shortcomings of Hume.

Skeptic: Well, you have surely noted my insistence on your specifying the type of evidence in question. I doubt you fail to imagine how that might be relevant.

Christian: I have a rough idea: are you proposing theses, like those of Hume, against testimonial evidence? Just because testimonial evidence is always subject to some precedented, possible counter-thesis, that does not mean that one can say that testimonial evidence as a category must be at least this or that weak by that virtue. The details decide how significant those considerations need to be.

Skeptic: I agree, which is another reason why I do not claim to be vindicating Hume's essay. `Testimonial evidence' is perhaps too broad a category to be subject to sufficiently small, convincing categorical boundaries. As I said before, some specifics are required. Allow me to motivate those which apply to the textual record on which you plan to rely: you can envision cases where an experiment, by its nature, cannot overcome discrepancies in prior odds so as to yield agreement between two rational agents, correct?

Christian: In highly idealized scenarios like fair dice rolls or well-understood machines and programs, sure, but I do not see the relevance to a scenario so complex and multivariate as eyewitness testimony.

Skeptic: You may at least be able to anticipate a generalization of simple and uncontroversial lessons to broader notions like `historical methodology', correct?

Christian: Not exactly, as I see such a category as too vague to easily bound.

Skeptic: Again, it depends on specifics. What is the method which you used to arrive at your initial, secular factual claims? Presumably, you do not claim to have directly observed the events in question.

Christian: Of course not.

Skeptic: And so there is some significant uncertainty in the indirect inference methods, i.e. historical methods, which you employ?

Christian: At least in a trivial sense, but that need not translate into any boundary.

Skeptic: Actually, it does, unless you claim that there is no minimally significant alternative to your facts which your methods can not diminish to an arbitrary degree. For example, can you rule out as strongly as you like the possibilities of fraud and later myth-making with respect to these secular facts?

Christian: I wouldn't say that, but again, I see no reason why, in advance, I can not devalue such possibilities sufficiently as to overcome the prior implausibility of the Resurrection.

Skeptic: If by `in advance' you mean in advance of all background knowledge, surely you are correct, but I mean the reliability of your methods with respect to our current knowledge about its reliability. If that reliability is such that the probabilities of hypotheses like frauds and myths cannot be convincingly grounded below 10-1000, I have established my case. For such extreme values, I would say that this can be said further in advance than I need to argue, but to firmly secure your methods into the category which I require, I will need to know a few more specifics.

Christian: I think I understand now, and I think that I see how you will be able to secure your conclusions were I to spell out more details. I suppose that I will have to qualify my paper with a placeholder for the time being and play with the formalisms to double-check your statements.

Skeptic: That sounds fine. In the meantime, I would be happy to read your paper. After all, you might be able to calibrate the relevant priors differently. It is still worth reading, for this and other reasons, if your conclusions are as strongly supported as you have suggested.

Christian: I look forward to your review. However, I hope you only resume technical blogging after all that wine you just drank leaves your system.

Skeptic: You're breaking the fourth wall.



1. The simplifying assumption of equal-weightedness is not generally true. If alternatives to the law include something like `dead people remain dead unless you perform a certain magic ritual', then only failures of that ritual will contrast the hypothesis with L. We can recapture the plausibility of the assumption by stipulating that a theoretical agent at this theoretical threshold point has effectively ruled any particular such hypothesis.

2. I've been playing with this notion for some time, and I know of several generalizations if anyone is interested.

Hume and the confirmability of miracles

While discussing the McGrews' Bayesian analysis of the Resurrection (CCRJ), I frequently mentioned that the McGrews and myself were not attempting to derive odds on the Resurrection. Rather, we were focusing on the Bayes factor - aka the likelihood ratio - which if you recall, is the number by which the prior odds ratio p(`thing')/p(`other thing') is multiplied to yield the posterior odds ratio q(`thing')/q(`other thing'). So at the very minimum, one needs to estimate what the prior odds should be in order to derive the final odds. Since neither of our approaches were sufficiently general to capture a truly cumulative Bayes factor, even this may be inadequate, but since the factor I derived - 106 - was calibrated given generous textual assumptions in favor of the Resurrection, we may be able to tentatively estimate an upper bound on reasonable posterior odds using that factor if we have an upper bound on reasonable priors. If that upper bound is less than 10-6, we may conclude that the Resurrection probably did not occur, i.e. 0.5>q(R).

I opine that barring other arguments in the context of a natural theology, such an upper bound exists. That is, the Resurrection can not reasonably be confirmed from the textual record alone with respect to convincing background knowledge which is shared by skeptics and Christians alike. But I am interested in Hume's more general thesis, which is that miracles by their nature can not reasonably be confirmed. The details of an analysis of the Resurrection are merely an instance of a more general unconfirmability argument.

I pause to obviate a potential objection: I am fully aware that the proper interpretation of Hume's Enquiry concerning Human Understanding, especially Of Miracles, is a hotly disputed topic. I am attributing an unconfirmability argument to Hume; I doubt he can be convincingly interpreted as not making such an argument. But I am not here interested in any historical exoneration or conviction of Hume of philosophical crimes. Rather, I want to work with his apparent argument by recasting it in formal terms, propose that it is inadequate, and attempt to shape a more satisfactory unconfirmability argument.

I am neither discussing nor proposing a definition-dependent impossibility argument, e.g., "A miracle is the violation of mathematical, divine, immutable, eternal laws. By the very exposition itself, a miracle is a contradiction in terms: a law cannot at the same time be immutable and violated." Rather, I am interested in miracles loosely defined as particular exceptions to otherwise exceptionless laws or regularities of nature. In this context, the regularities of importance are putative laws, and their importance is epistemic, not ontological. Whether or not a putative law is true is largely irrelevant: what matters is how well-supported it is.

The proper definition of a miracle is also in dispute. As regards this item, I follow Tim and Lydia McGrew in treating the Resurrection as a paradigm (CCRJ, p.4). As I will explain in the course of this discussion, working with paradigm cases like the Resurrection is all that should be required. Failures of consensus on miracles are relevant to Hume's argument, but they will not prove necessary to reject his conclusion. Which is roughly as follows:

Hume's Argument: There cannot exist evidence E for a miracle M such that

.

With conditionalization, this is equivalent to stating that the posterior odds on a miracle can never be greater than 1/2.1

The initial prospects of this statement are rather dim. As is commonly pointed out, there are no a priori boundaries on the size of Bayes factors: no matter how small the prior odds on a miracle, there exist finite Bayes factors which can overcome them. Similarly, disputes concerning the definition of a miracle make it impossible to have confidence in such a general statement.

I would also add that we should not be overly interested in such an argument as employed to justify ignoring any potential evidence for miracles. The debate is worthwhile. As I have noted in a slightly different context:
It is very often said, by e.g. PZ Myers and Massimo Pigliucci, that one cannot evidence Christianity or gods because they are not coherent hypotheses. More needs to be said about this, but I would at least suggest the following: if the evidence for the Resurrection really is extremely convincing to reasonable people on the assumption of coherency, we should take an attitude similar to that which I think we take to science: some conceptual fuzziness is to be tolerated, barring flat contradiction, where overwhelming evidence for an aspect of a theory is available. Were I to find the evidence for the Resurrection convincing, I know I would be working very diligently to craft a coherent Christian philosophy to accommodate it. So to me, the coherency difficulty is in many ways secondary, unless that difficulty is so severe that one cannot even begin to discuss relevant evidence. I think we usually manage to do so. Wouldn't you agree?
The argument also conflicts with the empirical, tentative nature of skeptical inquiry. I think we should wish to avoid such categorical statements.
The temptation to fashion such an argument is understandable. But it should be resisted. Any epistemology that does not allow for the possibility that evidence, whether from eyewitness testimony or from some other source, can establish the credibility of a UFO landing, a walking on water, or a resurrection is inadequate. (Earman, p.4)
As Earman also notes, there are events which, were they to occur, surely amount to convincing evidence for a miracle claim:
Suppose, for the sake of illustration, that there is a well developed theology based on the existence of a god called Emuh. who promises an afterlife in return for certain religious observances in this life. Suppose that this theology predicts that on such-and-such a day Emuh will send a sign in the sky. And suppose that on the appointed day, the clouds over America clearly spell out in English the words “Believe in Emuh and you will have everlasting life,” while the same message is spelled out in French over France, in Deutsch over Germany, etc. Then even though these cloud formations may not contravene any of the general principles taken at the time in question to be laws of nature and, indeed, may be explicable in terms of those principles, it would not be untoward to take these extraordinary occurrences to be support for Emuh theology. (p.11)
So Hume's argument, were it valid and coherent, would prove too much. It also ignores the effect of evidence for a theology and its implications for the proposed miracle claim. Were the gloating fiction of LaHaye's Left Behind series to be actualized, it would confirm the Resurrection. I am unsure as to how or why someone would seriously argue otherwise, even if the various details of Christian theology are unclear.

I will not second another common objection: I do not think that Hume's argument, interpreted as I have interpreted it, would destroy the possibility of overturning laws in science. His "straight rule of induction" is problematic in this context (Earman, pp.31-2), but laws are not to my knowledge overturned in the way that a putative miracle claim would overturn them.

Take the Conservation of Mass. Did measurements of nuclear reactions overturn a uniform experience? No, because what changed was not the article where uniform experience applied, but where a novelty was being analyzed. If for example I react 50 grams of sodium with 70 grams of chlorine gas to form salt (NaCl) at approximately standard temperature and pressure and measure a net change in mass of 20 grams, I or my instruments screwed up. Mass is still conserved within significant margins of instrumental error for `ordinary' chemical reactions. The implications of such experience have not been contradicted, but superseded. With miracles, where the putative law needs to otherwise be intact for theological reasons, no such consideration applies. We are not talking supercessions or the overturning of laws as done in the sciences; we are talking about flat-out, singular violations of an otherwise sound natural order. We are talking about an experiment incapable of replication. Were mass conservation to always hold, and the only exception were to occur in one apparently sound experiment, we should have discounted the experiment as flawed if replication failed.

I judge Hume's argument to be a failure and its conclusion to be unsound. But this need not be the end of the story. We may yet build a better monument by clearing away the noisy rubble of Hume's rhetoric and picking out the useful pieces. That will be the subject of my next post.



1. This interpretation, though disputed, has a lot of support, perhaps apart from the target threshold 0.5>q(M). Were Hume making an impossibility argument, it is odd that he should emphasize the relative strength of evidences (p.169) and the uncertainty of the relevant propositions (pp.169-70); that he discusses evidence at all would also be strange. In addition to his use of probabilistic terminology, he also casts his argument in terms of degrees-of-confidence: "Some events are found, in all countries and all ages, to have been constantly conjoined together: Others are found to have been more variable, and sometimes to disappoint our expectations; so that, in our reasonings concerning matter of fact, there are all imaginable degrees of assurance, from the highest certainty to the lowest species of moral evidence." And he continues famously: "A wise man, therefore, proportions his belief to the evidence. In such conclusions as are founded on an infallible experience, he expects the event with the last degree of assurance, and regards his past experience as a full proof of the future existence of that event" (p.170).

With terms like `infallible' and `proof' in play, I think that Hume may be interpreted as arguing for a prior probability of zero for miracles, or perhaps an infinitesimal probability (p.171). But I do not think that such a prior is convincing to all - or many - concerned, and it is therefore useless. Many Bayesians accept - here the terminology is unfortunate - the principle of regularity, which states that all possibilities have probability greater than 0, assuming that those possibilities are uncertain and assigned any probability whatever. In any case, we are presumably inviting Christians to the discussion, so we must at least assume that non-zero priors are in play.

There are other ambiguities, and I am lead to second Earman's hostile conclusion (p.20):
I defy the reader to give a short, simple, and accurate summary of the argumentation in "Of Miracles." What on first reading appears to be a seamless argument is actually a collection of considerations that sometimes mesh and sometimes don't. It will take much work to tease out the components of Hume's argument and to evaluate the soundness of individual components and the effectiveness of the entire package.
Immediately after bringing up `proofs' of experience, Hume dives right back into emphasizing the fallibility of evidence, particularly witness testimony (EPHU, p.171). There are other deficiencies in his presentation. After defining miracles as putative exceptions to uniformly evidenced laws, he states the following:
There must, therefore, be a uniform experience against every miraculous event, otherwise the event would not merit that appelation. And as a uniform experience amounts to a proof, there is here a direct and full proof, from the nature of the fact, against the existence of any miracle; nor can such a proof be destroyed, or the miracle rendered credible, but by an opposite proof, which is superior. (p.173)
With this stringency, the mere proposal of evidence for an event disqualifies that event's being a miracle, as experience is no longer uniformly against it. And then, the presentation of additional evidence should leave an opening. I'll stick with the Bayesian interpretation because it is the only plausible interpretation to be found.

Thursday, July 28, 2011

Tim and Lydia McGrew on the Resurrection, part 8 (conclusion/outline)

[Continued from Part 7.]

I have tentatively argued for a Bayes factor of 106 given the textual assumptions of the McGrews. I have further proposed a way to expand the discussion to include skeptics of these assumptions. In these conclusions, I have agreed with the McGrews that their assumptions are plausible, and that on these assumptions the Resurrection is the best explanation. However, I think that they overreach when they claim, or seem to claim, that their methodology - which they agree is very partial - approximates a more general Bayes factor (p.39).

The rest of their paper (pp.46-68) discusses Hume and the objections of other apologists. As I have said, I am leaving that topic for later. Just as they have not claimed to have derived odds on the Resurrection, I do not claim to have done so either.

As I stated at the beginning, the McGrews have started an excellent conversation. I would recommend anyone who wishes to pursue a rigorous analysis of the evidence for the Resurrection to read their paper. And just as they have qualified, I must qualify that my approach has not been complete.

In particular, I have not gathered all of the relevant evidence in deriving this likelihood ratio. Many apologists insist on Paul's claim that there are 500 witnesses. Skeptics focus on potential `gaps' in the text, which become quite plausible on the (quite plausible) assumption that the relevant texts are polemical and designed to serve the Christian community. In this sense, my Bayes factor is not cumulative. My Bayes factor is also not cumulative with respect to textual criticisms. Again, I've outlined how that may be pursued. A fully rigorous analysis of all of the details will probably lead to a figure quite different from the one which I have suggested. But I think, quite plausibly, that the figure I have suggested is not a gross underestimate. And I think it quite low enough to leave anyone with a reasonable prior ratio unconvinced. If Christians think that the prior odds on the Resurrection are above something like 10-6, I hope they will tell me why this is. If they have such a value, I assume it will be within the context of a well-formed natural theology. Contrary to the McGrews (p.49), I think this will prove necessary.

So there are my efforts. I hope you will read them all before making critical comments, just as I hope you will read the McGrews' paper. If you spot a technical error or misspelling, I would of course appreciate immediate correction. Otherwise, I ask that you take time to absorb the details, and inquire for yourself how knowledge you have may further inform the discussion.

I also hope that readers can at least retrospectively appreciate the utility of Bayesian techniques in analyzing such arguments. The importance of this or that number is minimal: what is important is that they can be used to capture the arguments, show how they relate to each other, and help us to focus on the important details. They also help to understand how I, a skeptic of the Resurrection, can be quite satisfied with a statement like "the Resurrection is the best explanation of the salient facts" - a statement which is very difficult to refute, I think. Bayesian insights allow me to maintain my skepticism without undertaking hopeless endeavors, for example defending or asserting statements like "the Bible does not constitute any evidence for the Resurrection." In arguments over the Resurrection, we cannot eliminate entirely our differing private intuitions. But we can at least see what is required of those intuitions and reduce their impact when possible.

And I love this stuff for its own sake. I'm soggy like that.

Suggestions for the future: separate the witness of James the Just from that of the other apostles, subsume the testimony of the women within that of the disciples generally, and largely omit any discussion of Paul's conversion as itself evidential in favor of other details. Paul is doubtlessly important, but his importance is in his teaching and his early date. And keep it general, yo.

Tim and Lydia McGrew on the Resurrection, part 7

[Continued from Part 6.]

Hallo and good day, weary traveler! We may now discuss in passing one final detail, i.e. the impact of the testimony of the women (W) on our final Bayes factor, which has currently been reduced from the McGrews' estimate of 1044 to 107. If I can convince you that the womens' testimony is not significant, we will arrive at a final replacement Bayes factor of 105. Then, I may finally lay my weary head to rest and fly elsewhere. Especially, I hope to soon discuss Hume's argument and attempt to estimate prior odds on the Resurrection.

I think this may be done as follows: take the alternative hypotheses to the Resurrection which I have proposed to explain the disciples' witness and subsume the womens' testimony within them. This may be done without loss of prior plausibility, especially since initial rumors already play a role. This undermines the `essential independence' of the women from the other disciples proposed by the McGrews (p.41), which I do not think defends probabilistic independence in any case. As I have discussed, the emergence of rumors would very likely have affected the reaction of the disciples. Indeed, since the witness of women would have been regarded as less credible (p.28), we may plausibly expect the disciples to have corroborated their belief - which perhaps began with the women's testimony - with witness of their own. This, I think, tentatively answers the McGrews' challenge: "why [should we not] judge p(W|R) to be at least several orders of magnitude greater than p(W|~R)?" (p.30)

To argue directly that W should have less effect than 102 on the final Bayes factor requires, I think, a questioning of the McGrews' salient facts. If we separate it out from the other details, I think that the McGrews were sufficiently generous in leaving it at 102. In assenting to this, all I am saying is the following: that the women would report an empty tomb, or seeing Jesus, had he not Resurrected has probability 0.01, assuming that they would report it had they really seen it and that the facts are as described by the McGrews. I do not think that this is too challenging an admission for a skeptic. Instead, we need not recognize this contribution as multiplicative, and regard it as diminished by other considerations.

I think this, along with any potential minor significance of Paul in light of the other reductions, can be fairly accounted for by leaving a final estimate of the Bayes factor at 106, and plausibly lower.

Now, we may finally arrive at our destination.

Tim and Lydia McGrew on the Resurrection, part 6

[Continued from Part 5.]

We are now ready to focus on D, the facts about the witness of the disciples, and the independence assumptions which the McGrews make in arguing that this multiplicatively contributes 1039 to a final Bayes factor. We have already reduced the cumulative Bayes factor from 1044 to 1041 by arguing that Paul's conversion does not significantly contribute to the likelihood of the Resurrection. As noted in the last past, we are also accepting the characterization of the factual record which the McGrews make, leaving dispute of that question to a more general analysis, the outlines of which are to be found in part 2. The relevant facts, and some of the argument, which I assume in this post are to be found in part 5. You will not understand this post if you have not closely followed the previous discussion.

For simplification, we may assume - and safely - that p(D|R)=1. If you think that this compromises accuracy or is unfair, try ascribing to it a value of 1/2 or 1/10 or even 1/100, and see how much it affects my conclusions. It won't prove to be crucial. There may be room to dispute it, but that discussion falls outside of the matter at hand, which is to question the conclusions of the McGrews while sharing their premises. This done, we may focus entirely on p(D|~R). This single value is the most important that occurs in their analysis, so it merits the closest focus.

Recall that there are 13 disciples in D; I denote them as D1,...,D13. If we assume conditional independence under ~R, then

.

Recall that the McGrews do not argue that this assumption is plausible. Instead, they feel that the failures of this assumption tend to favor their argument, that is,

.

Since the quantity on the left hand side represents the denominator of relevant Bayes factor - where the numerator is 1 by assumption - increasing it decreases the Bayes factor. Given the general likelihood formula (p.26), the McGrews argue in my notation and with our shared assumptions the following (p.42):



where p(D1|~R) is an approximate average of the 13 p(Di|~R). From the messiness of this formula, one can see the allure of independence. But remember the crucial detail is the inequality, not the equality, of the left hand side and right hand side in the above formula. And note that regardless of independence, one must explain at least one disciple's testimony without relying on the others.

Here is where we turn to their defense of this thesis (pp.40-46), which, just as in our previous discussion of the strength of a disciple, goes wrong for the following reason: the McGrews assume that the only significant, explanatory alternatives to the Resurrection are those which claim that the disciples were frauds, pranksters, cynical, or the victims of hallucination or delusion. As I mentioned, I am quite willing to agree that the disciples were devout, sincere, and dedicated followers of Jesus, and that they were not likely the victims of elaborate pranks, and that they were not likely to forge conspiracies without good reason. But just as in the discussion of Paul's conversion, the McGrews expend little effort imagining how it is that Jesus' followers may have realistically reacted to Jesus' death. They never say, or do not closely pursue, something like, "given that the Resurrection did not occur, here are several likely ways that the disciples may have reacted..." They instead assume that no such plausible reaction would at all explain their later behavior.

I think it plausible that the Crucifixion occurred and that the Crucifixion surprised the disciples. I doubt they would expect their Messiah to die the humiliating death of a criminal. But I think this for a good reason: I do not think that anyone there would have expected that, except for those who already condemned him as a heretic. Why is this important? Because this is exactly how skeptics argue. They do not need to invent vivid hallucinations to explain the disciples' commitment. Instead, they ask how well-intentioned followers would likely react and argue from there.

For example, suppose that you are one of Jesus' disciples. He has been dead for some time now, and you are frustrated. You are frustrated because you still believe that Jesus was the Messiah, and because you believe that the Messiah has appointed you to spread his message. The end of the world is coming soon, and Jesus will be the judge. It is vitally important that others in these troubled times understand and believe. But unfortunately, the audience is not receptive. What good, after all, is a dead Messiah for liberating the Jews from the Romans and restoring the Law? There are rumors among followers and admirers of Jesus, especially in distant regions, that he could not have died as he did. Why shouldn't there be? Nobody expected this, of all horrors, to happen. But you did not waste your life by abandoning your family to follow Jesus. His moral message is still sound, and the brotherhood of your Christians is still precious to you. The communalistic message of Christianity can provide for the poor and the beggars and others who live as you have lived.

You are faced with a choice: (1) lie, exaggerate, fail to discredit rumors, or otherwise insist that Jesus better fulfilled the expectations of doubters, or (2) quash the rumers, alienate the faithful, and suffer virtually no success against the skepticism of your peers. Pace the McGrews, you have every incentive to choose (1), as do the other Appointed. You are already willing to risk persecution and death for Jesus' teachings. Why risk dying without successfully guiding others to Salvation? The Messiah did not do as you expected, but he will one day return to rule the world, and he had always explained why your mortal expectations were presumptuous before. Yes, Jesus is currently dead, but why should his teachings die before he returns? You've been tested before; now you are ready to pass the test.

Even this scenario, which I do not think too implausible, is too simplistic. The dilemma may have been the same, but the psychology leading to the preaching of the Resurrection was probably nowhere near this crude. If you like, you can imagine other, similar scenarios which you find more plausible. The question you must address is this: were Jesus to die and remain dead, how likely is it that the disciples would have gone quiet, abandoned Jesus' teachings, and renounced their appointed status? To answer this is to partly answer the important question: what do you expect to have happened if the Resurrection did not occur? Do you expect that the disciples might have rationalized the Crucifixion? If so, how? Is a rationalization like the Resurrection story deeply unlikely, say p(`rationalization'|~R)=10-10?

It is hypotheses like these, unconsidered by the McGrews, that make the difference and undermine their defense of independence, because we need not dispute that the disciples were courageous, committed men in order to maintain it. In fact, these hypotheses are the product of their dedication. To ask how strongly this affects the Bayes factor is to ask how likely it is that the disciples would not have agreed to `lie in the service of the Truth' or would not have been able to rationalize this testimony in some other manner, or at the very least, would not have initially struck down the rumors among the faithful, and eventually come to believe them, or believe that their `essence' was true, or some other such thing. I do not think I need to list precedents of such behavior.

I think that this consideration alone, pursued in detail, is enough to push the Bayes factor way down; I think that others cleverer than myself can explore other plausible alternatives as well. But if we assume that this hypothesis does not share the bulk of p(~R), it is worth asking what the rest of the elements in ~R might look like. The McGrews appear to assume that it is dominated by completely un-explanatory hypotheses, i.e. H:p(H|~R)=0, but I do not think that this is the case. At the very least, I think that this is a very poor approximation whenever we start tossing around numbers like 1039.

How exactly should this affect p(D|~R)? Suppose that the hypothesis I outlined with respect to a single disciple gives us something like p(D1|~R)=0.01, an estimate which I think rather conservative. Now we ask how this should affect the other disciples: here, look at the same dilemma again, adding that other disciples are already claiming R. By the time we reach 7 or 8 disciples, the others follow very naturally. In this way, we can be sure that the independence assumption is overly hard on skeptical alternatives. More formally, we can give a tentative estimate of p(D|~R)=10-4 or p(D|~R)=10-5, and plausibly something higher.

So a tentative readjustment of the multiplicative contribution of the disciples to the cumulative Bayes factor is 105. I think that this is generous, and I think that skeptics can ground this or a lower value. But I am still admitting the following: given the characterization of the texts and the history of the McGrews, the testimony of the disciples is best explained by the Resurrection. What I dispute is how significant this detail must be.

Taking stock, our reduction of the Bayes factor is from 1044 to 107. The last fact which the McGrews discuss is the testimony of the women (W). That will be the topic of my next post. After that detail - perhaps unimportant relative to the other aspects of the argument - I can round all of this noise up and see where it leaves us.

Tim and Lydia McGrew on the Resurrection, part 5

[Continued from Part 4.]

In addition to the items summarized in the last post, we have now seen that there is little reason to regard Paul's conversion as itself making significant contribution to a cumulative Bayes factor, even when taking the relevant salient facts of the McGrews at face value - where they are consistent and actually salient. We have therefore reduced the McGrews' final Bayes factor from 1044 to 1041. Admittedly, this change is very slight. As previously discussed, the most important features of CCRJ are as follows: the independence assumptions and the effect of the disciples, particularly in conjunction. These ideas alone contribute a multiplicative factor 1039 to the McGrews' final likelihood ratio. Before discussing the details surrounding the disciples, their independence should be treated first.

The McGrews do not argue that their conditional independence assumptions are plausible. On the contrary: "the invocation of independence assumptions at several points is contestable; in fact, we believe that the case of the calculation for D the independence assumption almost certainly breaks down." So why do they invoke it? Because "this fact does not necessarily lessen the strength of the argument. Everything depends on the balance of considerations regarding the direction and extend of the breakdown of independence under R and ~R" (p.40). This approach is quite sensible: start out with an admitted simplification, critique it, and argue that the critiques generally favor the proponent of the argument.1 I think that the only other even approximately accurate response available on the web - at least that I know of - fails to adequately address this.

Allow me to motivate the discussion by being self-referential. If one grants a significant number, say n, of events Ei where i is a positive integer less than or equal to n, and one can assume that the Ei are conditionally independent under a hypothesis H and its negation ~H, then even a very small individual factor



is a big deal. With only 13 witnesses, even assigning a Bayes factor of 10 to each individual - even this seems uncharitable - still gives you a cumulative factor of

,

where the notation is exchanged as needed. This is a big number, even if its nowhere near that proposed by the McGrews.2

As we noticed, the McGrews will not be surprised if we directly challenge independence. Instead, we have to focus on pages 40-46 of the CCRJ. In order to do this, we have to start discussing and disputing facts about the disciples. This is because of the straightforward fact I noted in the other post in the context of evidential variety: the invocation of independence across a significant number of events `filters out' hypotheses which do not convincingly allow these events to be correlated. Less abstractly, the fact that the disciples not only witnessed as they did individually but did so in agreement must be plausibly explained by some element in ~R, if we grant that agreement.3 `Bad' hypotheses, for our purposes, are those which are intrinsically implausible and those which are only plausible with respect to one or a few disciples. Even if a hallucination happened to plausibly explain the witness of one disciple, it does not without lots of dubious conjecture help to explain the correlation of the witnesses.

The key facts about the disciples4 are as follows:

1. They were not expecting the Crucifixion or Resurrection in advance.
2. They were willing to die - or at least take great risk - in order to spread Jesus' message. (pp.17, 20-24, 30-37.)
3. There was little to no material or social advantage in preaching this message.
4. They attested to a physical resurrection. They claimed to have seen him and spoken with him for some lengthy period of time, e.g. 40 days. (pp.17-8)
5. They did not present a self-flattering account of the Resurrection. For example, they claimed to not readily understand, to be fearful, to have doubts, and to be chided and corrected by Jesus. (pp.17-8)

A hefty confidence in these is required to stick to the McGrews' analysis. For example, the importance of consensus amongst the disciples, and that there were no omitted complaints from purported witnesses, is of central importance (p.32). While I agree with the McGrews that it is very difficult to seriously attribute most or all of the disciples' testimony to cynicism or fabrication, my confidence in the uniformity of their testimony with respect to these key facts is much less. There is little reason, had there been substantive dissent, to expect that it would have made it into the gospels. Still, my purposes at this time are not to dispute these items. However, such discussion will be an important part of a general analysis like that presented in part 2.

Now, I agree with the McGrews that `external' theories, e.g. the `stolen body hypothesis', do very little to explain the facts in question (p.32). The point is to account for these facts in a convincing manner, and their origin is not at all explained by people stealing Jesus' body to corroborate the claims of early Christians. What we are looking for are `internal theories', i.e., those which convincingly explain the actions and statements of the disciples. It is here that I think the McGrews grossly underestimate the strength of potential naturalistic alternatives.

Before moving on, I should say something about the significance of these facts, especially (5). The idea is that were the disciples to be manufacturing stories or exaggerating in order to advance their cause, we might reasonably expect them to not be so hard on themselves. I do not think, especially in the context of Christianity, that this is a significant consideration. I think we are all familiar with examples of false humility, or we understand at the very least that confessions of guilt and personal inadequacy are very often encouraged in Christian communities, even admired. Perhaps my personal experience is overshadowing the general picture, but I understood early as a child that confession of guilt in church and begging for redemption was admired and expected of me. That the disciples do not flatter themselves is insignificant in the context of Jesus' teachings, quite apart from the Resurrection, "for all have sinned and fallen short of the glory of God." There are similar considerations for (1). Evidently, and I think everyone involved agrees, Jews did not expect that the prophesied Messiah would be anything like Jesus. That the disciples understood, empathized, or even shared in part this lack of expectation is not overly surprising. What matters is how we would expect the disciples to "normally behave" after Jesus' death.

To address naturalistic alternatives to the Resurrection which explain (1)-(5), the McGrews rework in probabilistic terms the good ol' "nobody would die for a lie" claim. This argument has its merits, as far as it goes, but it does not go as far as the McGrews think.
It is sometimes urged that kamikaze pilots, suicide bombers, and Nazis were willing to give their lives for what they believed was true. The objection may be put more broadly. Virtually every religion has its zealous adherents who have been willing to die for what they believe; why, then, should the willingness of the apostles to die as martyrs be of special epistemic interest? The answer is that this description blurs the distinction between the willingness to die for an ideology and the willingness to die in attestation of an empirical fact. (p.32) [citations omitted.]
It is clear that neither kamikazes, Nazis, nor suicide bombers died to affirm the reality of something that they had seen with their eyes and their hands had handled. Thus, their deaths and the falsehood of some of their beliefs tell us nothing about the probability that a man will die to make an affirmation like that of the apostles when it is in fact false. The educational resources of an entire nation, applied over the course of a decade or more to minds at their most impressionable stage, may be sufficient to induce in the young the general belief that their country or their religion is worth dying for. But what would induce grown men to break with the religious community in which they had been raised and confess with their blood that they had seen with their own eyes and handled with their own hands their dead rabbi raised again to life? (p.33) [Emphasis in original.]
The McGrews partially answer their own question or are really asking it to themselves. The disciples had already broken with their religious background to follow Jesus - with the possible exception of James. They were already committed to the heretical philosophy of Jesus. They were not merely dying to attest the Resurrection; they were dying for the belief that the Messiah had arrived, that only His followers would find salvation, and that the end was near. The distinction which the McGrews make is valid, but it is extremely narrow in this context.5 To divorce the Resurrection from the other claims, moral and otherwise, of Christianity is misleading.

The previous considerations apply to the "disciples witnessed but did not really believe" section of alternatives. Now we can look at the "disciples witnessed and really believed" section of alternatives. Here is where we find claims about delusion and hallucination:
Suppose, on the other hand, that the witnesses did have good reasons for their belief in the resurrection but were nevertheless mistaken. How is this supposed to come about? The hallucination theory has at least this advantage over both external naturalistic explanations and the appeal to enthusiasm: the supposition that the disciples suffered from sufficiently vivid and persistent hallucinations provides the resources to explain why they firmly believed they had seen Jesus risen. But this gain in explanatory power comes at a prohibitive cost in prior probability... (p.33) [Citations omitted]
Instead of looking at how the McGrews corroborate this last statement, try imagining for yourself why this should be. Is it really at all likely that these committed disciples should individually experience vivid hallucinations or powerful delusions on the event of their Messiah's death, and that these delusions, if that is what they were, should have the staying power that they did? How common are events like this at all? If we want to substantially reduce the Bayes factor proposed by the McGrews in a way that should be at all convincing to both skeptics and believers, we need to look elsewhere for alternatives. As the McGrews note, "the problem with the hallucination theory is that it has a vanishingly small probability conditional on ~R. The sort of complex, repeated, integrated hallucination that would be required to maintain even one disciple's testimony and willingness to die for it would represent a serious mental illness" (p.35). There are qualifications to the McGrews' argument that I would add, in particular that extreme distress can very plausibly result in a resilient, complex delusion, and need not require the positing of serious mental illness, but I will not dwell on these details. The fact remains that there is little reason to think such a thing happened, or would likely happen, and ultimately result in the texts as we find them.

Assuming plausibly that p(D|R) is quite high - say 1 for purposes of simplification - our attention focuses entirely on p(D|~R). We want to know whether or not p(D|~R)=10-39 is at all realistic. Although I agree with the McGrews that hallucination, delusion, and cynical fabrication are very unlikely, we still need to know whether their disjunction is well below 10-39. Unlikely as I think these are, I think that they are at least slightly more credible than that. However, if we are to propose a substantial increase in p(D|~R), we are going to have to look elsewhere. Namely, we want to look for alternative hypotheses H such that p(H|~R) and p(D|H) are significant. In the case that H is `fully explanatory' of ~R, the former quantity is p(H)/p(~R). Assuming that our prior confidence in ~R is high, this approximates the absolute probability p(H). The moral of the story? If you are proposing alternatives to the Resurrection which are designed to completely explain it, you have to be careful to avoid ad hoc thinking: you have to argue that all concerned should find that alternative explanation plausible for reasons other than that the Resurrection has low prior plausibility.

Failing to find any explanatory hypothesis of significant probability, the McGrews assign p(`a disciple'|~R)=0.001, which with independence gives a Bayes factor of 1039.

In order to discuss significant alternatives, question their defense of independence, and propose an alternative Bayes factor, we need to compare the independence case to the more general likelihood formula, which they provide in a footnote (p.26). This work will be formal, abstract, and address the most important part of their argument, so I give this work its own post.



1. To avoid confusion, the vernacular sense of `independent witnesses' is completely opposite to that of the probabilistic sense of `independent witnesses'. What we expect witnesses to do, if none influence the other and the circumstances are clear, is to produce correlating accounts. That is, what one witness says usually strongly affects what we expect other witnesses to say, which is the very opposite of conditional independence.

2. We'll see that the disciples should contribute heavily to the Bayes factor if one is willing to grant near-certainty to all of the important premises entertained by the McGrews. I do not think that skeptics should want (or need) to conclude something other than the following: if the gospel accounts are accurate as regards the relevant, secular evidence for R, then they strongly evidence R. I accept what probability tells me I must, if I assent to the following:
In other words, is there anything in the reports coming out of the first-century church that is more like what you should expect if Jesus was raised than if Jesus was not raised. If the answer to that question is yes, then the evidence confirms the resurrection, but it might still be rejected by reasonable people on the grounds that a Resurrection would commit you to the existence of God, or other features of Christianity that you consider to be improbable. Fine, but you can at least say, in response to the evidence, that the evidence directly bearing on the resurrection of Jesus is easier to explain if the Resurrection occurred than if it didn't. In other words, we can isolate one particular piece of evidence from the total evidence we have that bears on the issue and ask whether this piece of evidence supports the Christian claim that Jesus was resurrected or not.
Again, I think that the most important part of rejecting confirmation of R as derived from the Bayes factor is in rigorously defending a very small prior odds and presenting at least a very minimal case for skepticism as regards characterizations of the text like those employed by the McGrews. Both of these feats are easily done, I think, but I leave them to my betters for now.

3. There's much more to be said about this, but that discussion falls well outside of the salient facts as characterized by the McGrews.

4. Recall that there are 13, counting the original disciples minus Judas, Mathias, and James the Just (called `Brother of Jesus'). The details about James are sufficiently different that I would in future analyses recommend separating him from the rest of the disciples. In particular, he is argued to not have been a believer before Jesus died (p.22), and quite plausibly was not present to witness the events attested by the others (p.34).

5. I add also that we have many cases where people are willing to die for false witness. Does anybody here watch House? Have there ever been false confessions to murders? I'll leave this tangent to others.

Wednesday, July 27, 2011

Tim and Lydia McGrew on the Resurrection, part 4

[Continued from Part 3.]

I hope that by now readers - you better have read the previous parts if you are reading this! - understand that the McGrews' CCRJ cannot be dismissed in an ordinary blog comment which spells out things that are intuitive and obvious to a layman. I hope that I've convinced you already not to invest too heavily in highly dubious alternative explanations to the Resurrection. (I would hope that I wouldn't have to say that.) And I hope you have some idea of what to expect now that we are now actually calculating a Bayes factor to replace that proposed by the McGrews on their assumptions, roughly how we can expect to do that, and the limitations on our conclusions which that method imposes.

As I mentioned in Part 3, I for some time avoided mentioning explicitly the set of salient facts. As one reason, I gave that I do not accept the relevance of that set of salient facts. In particular, I do not think that the conversion of Paul should significantly affect a cumulative Bayes factor. Now that we've checked the depth of the waters so as to avoid high-diving into a kiddie-pool, we may now safely plunge into the subject. Recall that the McGrews place a value of 103 on the Bayes factor derived from conditioning on Paul's Damascene moment (See CCRJ pp.37-9 for their argument):



More specifically (p.39):

.

As against this, I propose that

,

where the bi-directional arrow denotes the equivalence of these claims. That equivalence is mathematically trivial, but conceptually challenging: why should I expect Paul's conversion to be equally likely whether or not the Resurrection occurred? I give a hint - also mentioned by the McGrews but not adequately pursued - that there is a qualitative difference between P and the other facts - recall that namely these are the women's testimony (W) and the witness of the disciples (D). I'll give another hint: how significant would Paul's conversion be in contrast to the range of reasonable argument over the contribution of the disciples - which alone, to the McGrews, is 1039 if you recall - if the factor produced by Paul's conversion can only be convincingly argued to be something as low as 5 or 10? In answering these, understand why I am not requiring that all involved recognize an exact equality. Given this sense of approximation and that I will be successful, reintroducing Paul's conversion as a significant fact should only be done after accepting that the more direct witness testimony is far less powerful and that the important range of priors includes some relatively large odds on the Resurrection.

The McGrews expend most of their brief effort on p(P|~R) and may not give any argument for p(P|R) at all. They say that "on the assumption of R there is no difficulty whatever in accounting for P" (p.39), making no other argument, unless their emphasizing that Paul would later insist on a physical resurrection is significant (p.38). On the contrary, I do not think that the facts around Paul's conversion support this `no difficulty' assertion at all. To see how this is the case, let's think about how their comments at the expense of a significant p(P|~R) reflect on p(P|R):
Delusions that change the minds of vicious persecutors and transform them into faithful martyrs are unfortunately quite rare; one looks in vain for comparable conversions among the notorious murdering zealots of the ages. (p.38)
While I think we probably can find cases with important parallels, I'm not sure that the McGrews want to insist on this statement. If the Resurrection had occurred and is supposed to make at all probable that someone like Paul would be transformed through a vision into an apostle, why then are Pauls so rare? Do we lack similar circumstances where a persecuted Church is suffering under a hostile regime? We can ask other uncomfortable questions as well. Why would we expect Jesus to wait for martyrs like Stephen to become such before making Paul a martyr? Is that how we should expect Jesus to send messages? Why should skeptics accept that, and further, if that is the case, why are Pauls so rare? And why Paul? If he was, as the McGrews insist, an unrepentant, guiltless zealot up to the Damascene moment, why not appear to more powerful persecutors? Why wait until the 4th century to send the Emperor a sign? Nothing about the Resurrection makes Paul's conversion likely, and if it did, we may generate a powerful argument against the Resurrection from the rarity of such conversions.

Before going further, something needs to be said about the inconsistencies in the scriptures describing Paul's conversion. I agree with the McGrews that one should not make too much of the minor inconsistencies in scripture, which they admit while pointing out that this is what we expect of any historical text (p.6). I'm not interested in inviting the hyper-literalists to the discussion. But I think that they are incautious wherever those non-fatal inconsistencies emerge. As I will discuss later, this is also important when they are describing some (relatively minor) secular facts surrounding the witness of the disciples. I think, in the argumentation for Paul's contribution especially, that the McGrews are sometimes uncharacteristically lax, uncharitable to skeptics, and preemptively dismissive. But then, this essay is part of an anthology, and there may have been space constraints. This would not excuse the casualness with which they approach these details, but it is worth keeping that eventuality in mind, along with the tentative and very restrictive nature of their conclusions.

To support these strong statements:

1. They claim that Jesus appeared to Paul in the flesh (p.38). To cut a quote from Loftus out of context and into context:
...Paul [claimed] to have experienced the resurrected Jesus in what is surely a visionary experience (so we read in Acts 26:19, cf. II Cor. 12:1-6; Rev. 1:10-3:21--although he didn't actually see Jesus, Acts 9:4-8; 22:7-11; 26:13-14)...
I have not seen McGrews cite Revelations, but Acts and II Corinthians are in necessary, regular appearance, and it is in Acts that it is not said that Paul actually saw Jesus, but only heard a voice. For example:
And he fell to the earth, and heard a voice saying unto him, Saul, Saul, why persecutest thou me? And he said, Who art thou, Lord? And the Lord said, I am Jesus whom thou persecutest: it is hard for thee to kick against the pricks. And he trembling and astonished said, Lord, what wilt thou have me to do? And the Lord said unto him, Arise, and go into the city, and it shall be told thee what thou must do. And the men which journeyed with him stood speechless, hearing a voice, but seeing no man. And Saul arose from the earth; and when his eyes were opened, he saw no man: but they led him by the hand, and brought him into Damascus. (KJV Acts 9:4-9)
This passage also says that Paul's companions heard a voice. That is explicitly contradicted elsewhere. This the McGrews recognize and accordingly claim to place no weight on the experience of Paul's companions earlier in CCRJ (p.24). They do appear to insist on the visual hallucination (p.25), however, but I'm unsure as to whether the difference between a visual, as opposed to merely auditory, vision is supposed to have a great effect. They rely heavily on the `complexity of the vision' - I wonder where that is - in dismissing delusion and hallucination as explanations of Paul's conversion. (Complexity-of-recall concerning hallucinations would validate the seeings of many a schizophrenic.) This does not change that Paul's conversion is almost surely sincere and almost surely involved a dramatic moment - more on this next - but I do not think that the McGrews were sufficiently diligent in explaining what exactly they reject, what they allow others to reasonably reject, and how those details should or should not be significant in making their case. And they did not make clear at the outset that the account of Paul's subsequent blindness would be involved, as it turned out to be, just as the supposed reaction of his companions on the road to Damascus would later be employed (p.38).

2. More culpable is their treatment of a hypothesis proposed by another scholar:
Perhaps aware of just how feeble [explanations like Paul not really converting or that he was the victim of a clever prank] might be, Strauss suggests delicately that Paul might have been overcome by feelings of doubt and guild during a thunderstorm [citation omitted]. This remarkable conjecture might be worth discussing were it not for the fact that the doubt, the guilt, and the thunderstorm are all invented out of whole cloth. Having made the insinuation, Strauss wisely drops this hypothesis and takes refuge behind the claim that the book of Acts cannot possibly be historical. (p.38)
Let's stop and ask: is the suggestion that Paul - evidently a man capable of great feats of conscience, as zealots often are - might have felt guilt over his actions ridiculously implausible? Even SS Concentration Camp guards occasionally felt guilt and uncertainty. This is dismissed out of hand, but the previously cited passage (Acts 9:4-9) makes the accusation of whole-cloth fabrication that much weaker: "it is hard for thee to kick against the pricks" naturally translates as "you know what you're doing is wrong, and it bothers your conscience." It appears elsewhere in the KJV, and does not appear in the NIV in Acts 9, so I'll leave whether or not this passage is crucial to those with more experience in textual criticism. It's just not obvious prima facie that Strauss was wise to drop that very very silly and unserious hypothesis of his. No effort was made here to state the case charitably. No mention of the fact that Strauss' proposed external stressor, a thunderstorm, was not crucial to his idea. Any strong stimulus or external stressor may have triggered a dramatic event, assuming Paul was predisposed to conversion. And though the McGrews say that it is "an odd sort of hallucination that is followed by three days of blindness," they give no reason why that blindness - if at all considered a common fact - should be expected (by skeptics) had Paul received a genuine vision (p.38). Nor do they mention that temporary blindness is known to be associated with severe emotional trauma and stress.

I agree with the McGrews that Paul can not credibly be thought of as a conscious fraud. I think that his conversion was sincere, and it is very well evidenced, as is Paul's historical personage. But they fail to imagine why Paul, a sincere convert, might manufacture a vision story because he's a sincere convert. Imagine that you are Paul: you have been overcome with horror at the guilt of your actions, and you wish to make amends. As a new-found Christian, you care deeply about Christians and the fate of the persecuted churches. There is, however, a small problem: you do not expect these beleaguered communities to accept a killer with open arms and smiles. You especially do not expect this beleaguered communities to recognize your education and expertise as conferring status upon you. What would you do to convince them? Claim a vision, and proudly, and take the very real risks of doing so.

This `emotive-incentive hypothesis', along with a serious look at Strauss' explanation, allows us to safely assert that p(P|~R) is not significantly less than the value of p(P|R), which has no convincing support.

Before moving on to the disciples and the women, a post on the assumptions of conditional independence, its importance, and how the McGrews actually employ it is in order, especially for the 13 disciples. Once this is addressed, I think that the tentative finish line will be in clear view.

Tim and Lydia McGrew on the Resurrection, part 3

[Continued from Part 2.]

I think that Part 2 alone accomplishes the goals which I set out in Part 1, most importantly, that the Bayes factor proposed by the McGrews, 1044, is a gross overestimate of the strength of the textual record. I also provided Bayesian formulas which are sufficiently comprehensive to be acceptable to all concerned and that provide a framework in which layman and experts can further pursue the various details and arguments. Albeit in passing, I further concluded that a layman, so long as he treats the disagreement in the expert community as even minimally legitimate, may be quite confident in the following statement: a cumulative Bayes factor produced by the textual record should not confirm the Resurrection against any reasonable prior odds on the same, assuming that a well-formed natural theology which confers a quite substantial prior is not in play.

So why pursue the topic further? As I mentioned, it is possible that natural theology can do the prerequisite work; and it may one day be the case that any legitimate disagreement whatever about the salient facts vanishes, unlikely as the latter prospect seems. There are other reasons which I also think are important.

Careful readers might have noticed that I have regularly referred to a set F of salient facts discussed by the McGrews without ever mentioning what these are. This was deliberate: I wanted to avoid thinking that detail overly important in the previous discussion, as I have explained. Another reason is that I do not wholly accept the McGrews' F as being relevant. This is obviously important when analyzing their argument, but it is especially important since the method rigorously implemented by the McGrews takes a fairly common starting point by arguing from `salient facts'. And of these, the trouble I mention is quite common, and I think it can only be clearly explained in the Bayesian framework employed by the McGrews.

The McGrews include the following as elements of F: the eyewitness testimony of 13 disciples (The original ones minus Judas, plus Mathias and James the Just) (D), the testimony of the women (W), and the conversion of Paul (P). The McGrews posit the conditional independence of these facts modulo R and ~R. (They do not do this casually. I'll explain what this means and discuss it later.) So their final Bayes factor is calculated as follows:



where

.

As I have mentioned, their final Bayes factor is 1044. The contributions of each term are, respectively, 103, 102, and 1039. So obviously, the really big factors are the independence assumptions - these are internal to D as well, each disciple multiplicatively contributes 103 to the total - and the strength of D. Minor variations in that specific estimate will swamp the other contributing factors. That said, I still want to argue the following: the conversion of Paul contributes nothing.

This will be our first voyage on the sea of calibrating a conditional probability, so some things need to be said before we undertake this adventure. In fact, there is so much to say in advance that Paul will have to wait for my next post.

Apologists often claim - and I think need claim to be successful - that the circumstances surrounding the Resurrection are in many important senses unique. And I agree. What this means in practice is that the most important means of calibrating a probability, frequency data, are in many decisive ways unavailable by virtue of there being no suitable reference class. In even more jargony terms, a frequentist, empirical probability p(A) is the number of occurrences of A over the number of trials, N. The set that N counts is called a reference class, and the indeterminacy or disputability of such classes is a powerful objection to objective interpretations of probability like frequency. Even if in a very limited sense some data are available, I do not think they capture `realistic' probabilities, as cases are so limited.

So how can we sensibly calibrate such conditional probabilities? I think that there are boundaries on the reasonable values which we might maintain; if you argue for a Bayes factor as small as 2, you are at one or several points uninviting Christians from the conversation, and your pretension to argument is merely an exercise in self-gratification. Yes, I think that cumulatively, the textual record should be recognized as providing an increased likelihood for the Resurrection in any sensible discussion. But do not worry about it too much - the question is the strength of that likelihood with respect to priors. Still, we can at least stop saying that there is no evidence for the Resurrection or Christianity.1 However, if we are faced with numbers like 1044, we should be immediately suspicious: how can you assert such a bold number with any confidence when we lack frequency data and are discussing unfamiliar events?

I think that the McGrews attempt this in a sensible, plausible way, though it only constitutes a rough beginning. To put it loosely: they look at the relevant conditional probabilities concerning a fact. They claim, usually plausibly, that the numerator p(fact|R) is high. Then they attempt to show that outstanding alternative explanations affecting the denominator p(fact|~R) are not plausible. But they are not pretending that this is comprehensive. They clearly illustrate and discuss why many of the important alternatives to the Resurrection are not at all explanatory of the fact in question. I will quote from this explanation, since it helped me to correct a common error in probabilistic thinking, namely the over-estimation of the importance of unlikely alternative hypotheses:
...we must be on guard against a plausible error. It might seem that our analysis of cumulative case arguments in terms of Bayes factors puts the emphasis on likelihoods in such a way that finding any sub-hypothesis under ~R that gives a high probability to some piece of evidence always represents a significant gain for the proponent of ~R. But when an auxiliary hypothesis Ha is very improbability given ~R, its contribution to the explanation of a fact F is negligible even when it has high likelihood [...] It is easy, also, to slip into a different false assumption -- that in making a probabilistic argument of the sort in question for R, we are obliged to restrict ourselves to those sub-hypotheses under ~R which make some attempt to explain the facts in question. (CCRJ, p.27)
I omit a formal illustration in the ellipses, but I think this sufficiently important that I have talked about it elsewhere already. The moral of the story here is that by focusing on hugely improbable theses like `mass hallucination', skeptics are needlessly driving themselves to distraction and discredit.2 A very important question is as follows: what sub-hypotheses actually dominate ~R in the sense that p(sub-hypothesis|~R) is significant? The McGrews answer correctly as follows: "The answer is that most of it is going to the generic hypothesis that Jesus died and that all went on as usual thereafter," but they continue with a more difficult assertion: "which provides no explanation, not even an attempted explanation, of the evidential facts in question" (p.28).

As I will elaborate when discussing the particular facts, the important question is as follows: what exactly does normal mean when we've accepted the background assumptions of the McGrews? Would we expect as `normal' in the circumstances that the disciples would abandon the teachings of Jesus altogether and fail to evangelize?

As we lack suitable frequency data or other accepted calibrating methods, we have to rely heavily on intuitions - intuitions about expectations of the psychology, interests, and behavior of 1st-century followers under duress in exceptional circumstances. One may think of the method as a psychological analogue to propensity: one attempts to empathize with the people in question and attempt to imagine what they might do. A very limited knowledge of their circumstances, cultural differences, and a layman's knowledge of the topic means that we have to be very cautious. It also means we should be suspicious of Bayes factors which are supposed to be large enough to convince us that a well-evidenced, putative law of nature has been violated.

That all said, I can start with Paul.



1. It is very often said, by e.g. PZ Myers and Massimo Pigliucci, that one cannot evidence Christianity or gods because they are not coherent hypotheses. More needs to be said about this, but I would at least suggest the following: if the evidence for the Resurrection really is extremely convincing to reasonable people on the assumption of coherency, we should take an attitude similar to that which I think we take to science: some conceptual fuzziness is to be tolerated, barring flat contradiction, where overwhelming evidence for an aspect of a theory is available. Were I to find the evidence for the Resurrection convincing, I know I would be working very diligently to craft a coherent Christian philosophy to accommodate it. So to me, the coherency difficulty is in many ways secondary, unless that difficulty is so severe that one cannot even begin to discuss relevant evidence. I think we usually manage to do so. Wouldn't you agree?

2. You'll notice that this is a common theme of mine. I agree with the McGrews (p.11, elsewhere) that critics of Christianity have often been unreasonably prejudiced against reasonable claims which seem to credit Christianity - and apparently for that reason. I think that this prejudice can be remedied by having skeptics understand that they do not need to invest heavily in this-or-that dubious alternative to the Resurrection by understanding the significance of likelihoods, properly understood. In failing to understand, they send the (perhaps accurate) impression that their views are prejudicial, and where observers are led to believe that skeptics have to rely on an absurd confidence in a mass hallucination to argue against the Resurrection, they will understandably feel that the argument favors the Christians, or at least feel safe in equivocating between skeptics and Christians on the matter. And they'll tend to make familiar noises about the true ulterior motive of atheists, that though they deep down believe in God, they hate Him and want to live in sodomy, adultery, abortiony, or other sinnery. If you ask me what exactly I think happened in 1st century Palestine, I would say very little to satisfy you. What probability teaches us is that we must learn to be comfortable with generalized alternatives instead of specific, highly detailed explanations. Those are by nature hard to come by with any confidence on any issue, much less issues of distant historical inference. Proving a particular negative is very difficult, but a generalized negative like ~R is often manageable. As we will see, it requires work and some cleverness, but it can be done.