Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences

    Abstract

    A key obstruction to the twistor programme has been its so-called ‘googly problem’, unresolved for nearly 40 years, which asks for a twistor description of right-handed interacting massless fields (positive helicity), using the same twistor conventions that give rise to left-handed fields (negative helicity) in the standard ‘nonlinear graviton’ and Ward constructions. An explicit proposal for resolving this obstruction—palatial twistor theory—is put forward (illustrated in the case of gravitation). This incorporates the concept of a non-commutative holomorphic quantized twistor ‘Heisenberg algebra’, extending the sheaves of holomorphic functions of conventional twistor theory to include the operators of twistor differentiation.

    1. Introduction: basic twistor algebra

    The central aim of twistor theory is to provide a distinctive formalism, specific to the description of basic physics. Space–time points are taken as secondary constructs in the twistor approach. An individual twistor can be regarded as representing the entire history of a free classical massless particle—usually with non-zero spin, of a definite helicity s. If s=0, such a history is a null geodesic—henceforth called a ray—which provides the most immediate picture of what is referred to as a null twistor. An individual space–time point is identified in terms of the family of rays through that point. In relativity theory, such a family has the structure of a conformal sphere, interpreted in twistor theory as a Riemann sphere, i.e. a complex projective line. Twistor theory gains much of its strength from complex geometry and analysis, bringing together many features of relativity and quantum mechanics.

    So long as space–time curvature can be ignored, the basic twistor space Inline Formula is a complex four-dimensional vector space with pseudo-Hermitian scalar product of split signature (++−−). Geometrical notions are often best expressed in terms of the projective twistor space Inline Formula (a complex projective 3-space Inline Formula). I use abstract indices, so a twistor Z (an element of Inline Formula) can be written Zα. Its complex conjugate Inline Formula (i.e. Inline Formula is a corresponding element of the dual twistor space Inline Formula, the scalar product between twistors Z and Y being written alternatively as

    Display Formula
    and the norm of Z is
    Display Formula
    We say that a twistor is right-handed, left-handed or null according as ∥Z∥>0, ∥Z∥<0 or ∥Z∥=0, the respective portions of twistor space being Inline Formula, Inline Formula and Inline Formula, with projective versions Inline Formula, Inline Formula and Inline Formula.

    Any projective null twistor Z (element of Inline Formula) represents a ray (null geodesic) in Minkowski 4-space Inline Formula, where for the full correspondence we must include rays at infinity—generators of the ‘light cone at infinity’ in the compactified Minkowski space Inline Formula, a smooth compact conformal-Lorentzian 4-space, topologically S1×S3, which can be identified as the space of lines through the origin in the zero-locus of a quadratic form of signature (++−−−−). The physical interpretation for a projective null twistor Inline Formula is thus the world-line of a classical (non-spinning) free massless particle, where idealized particles at infinity are also included. The orthogonality condition Inline Formula (or, equivalently, its complex conjugate Inline Formula between null twistors Y and Z has the direct space–time interpretation that the corresponding rays y and z in Inline Formulaintersect (possibly at infinity). The twistor Zitself, up to the phase freedom Z↦eiθZ (θ real)—so that a positive real-number measure of scaling is incorporated—provides a 4-momentum for the massless particle. We shall be seeing later that the phase also has a key geometrical role to play in the palatial twistor theory introduced in §5.

    If the particle possesses a non-zerospin, which must be directed parallel or anti-parallel to its velocity—positive or negative helicitys, respectively—then its space–time trajectory is not precisely (relativistically invariantly) defined as a world-line, but can be specified in terms of its 4-momentum pa and 6-angular momentum Mab about some chosen space–time origin point O. These must be subject to

    Display Formula
    (curved or square brackets around indices, respectively, denoting symmetric or antisymmetric parts), where εabcd=ε[abcd] is the Levi-Civita tensor fixed by its component value ε0123=1 in a right-handed orthonormal Minkowskian frame (with time-axis basis vector Inline Formula, so p0 is the particle's energy, in units where the speed of light c=1). The quantity s is the helicity, positive for right-handed spin and negative for left-handed.

    These quantities are explicitly represented algebraically in terms of a twistor Z (uniquely defined up to phase) and its complex conjugate dual twistor Inline Formula. To see this, we need the expression of a twistor Z in terms of its 2-spinor parts [1,2], where we write

    Display Formula
    The complex conjugate of Z is the dual twistor
    Display Formula
    A general dual twistor W=(λ,μ) has the explicit index form Wα=(λA,μA).

    A massless particle's 4-momentum pa and 6-angular momentum Mab (in 2-spinor abstract-index notation [1]) can constructed from a twistor's spinor parts by

    Display Formula
    and all the above conditions are satisfied, provided that πA≠0. Conversely, the twistor Z (with πA≠0) is determined, uniquely up to a phase multiplier eiθ, by pa and Mab, subject to these conditions. The helicity s finds the very simple (and fundamental) expression
    Display Formula

    Under a change of origin Oq, the spinor parts of Z undergo

    Display Formula
    where qa is the position vector Inline Formula. For a dual twistor W, with Wα=(λA,μA), we correspondingly have
    Display Formula
    This is consistent with the standard transformation of Mab (and pa) under origin change, where the position vector xa of a space–time point x correspondingly undergoes
    Display Formula
    This is consistent also with the incidence relation
    Display Formula
    between a twistor Z=(ω,π) and a space–time point x, which is the condition for the complex projective line X (Riemann sphere) represented by x in Inline Formula, should pass through the point Z in Inline Formula. In matrix terms, this incidence relation is
    Display Formula
    where (t,x,y,z) are standard Minkowski space–time coordinates (with c=1) for x. When Z is a null twistor, the real points x which are incident with Z are simply the points that constitute the ray z in Inline Formula (at infinity, in Inline Formula, if π=0). When Z is non-null, then there are no real points incident with Z. However, there will be complex points—points of the complexified space–time Inline Formula incident with Z (but if π=0, only at infinity, in Inline Formula). This will have importance for us in §3.

    2. Wave functions for massless particles

    Up to this point, we have been concerned with classical theory. Quantum twistor theory involves commutation laws

    Display Formula
    and
    Display Formula
    [2,3], where now the twistors are taken to be linear operators generating a non-commutative algebra Inline Formula (with an important role in §§5 and 6), acting on some appropriate space. We shall think of this space as a quantum ‘ket-space’ |…〉 of some kind [4], but it is best not to be specific about this, just now. We could alternatively think of our operators as dual twistors, subject to the commutation laws
    Display Formula
    and
    Display Formula
    which is the same thing as before, but with Inline Formula re-labelled as Wα.

    These commutation laws are almost implied by the standard quantum commutators for 4-position and 4-momentum

    Display Formula
    but there appears to be an additional input related to the issue of helicity. By direct calculation, we may verify that the twistor commutation laws reproduce exactly the (more complicated-looking) commutation laws for pa and Mab that arise from their roles as translation and Lorentz-rotation generators of the Poincaré group. In this calculation, there is no factor-ordering ambiguity in the expressions for pa and Mab in terms of the spinor parts of Zα and Inline Formula (owing to the symmetry brackets). Yet, the calculation for the helicity s (writing the operator as s) yields
    Display Formula
    In accordance with standard quantum-mechanical procedures, in order to express wave function for massless particles in twistor terms, we need functions of Zα that are ‘independent of Inline Formula’. This means ‘annihilated by Inline Formula’, i.e. holomorphic in Zα (Cauchy–Riemann equations). Thus, a twistor wave function (in the Z-description) is holomorphic in Z and the operators representing Zα and Inline Formula act
    Display Formula
    Alternatively, we could be thinking of functions of Inline Formula that are ‘independent of Zβ’, i.e. anti-holomorphic in Zα. Here, it would be better to re-name Inline Formula as Wα and consider functions holomorphic in Wα. Accordingly, in the dual twistor W-description, a wave function must be holomorphic in W and we have the operators representing Inline Formula and Wα, again satisfying the required commutation relations, but now with
    Display Formula
    If we are asking that our wave function describe a (massless) particle of definite helicity, then we need to put it into an eigenstate of the helicity operators, which, by the above, is
    Display Formula
    in the Z-description, and
    Display Formula
    in the W-description. These are simply displaced Euler homogeneity operators
    Display Formula
    so a helicity eigenstate, with eigenvalue s, in the Z-description requires a holomorphic twistor wave function f(Z) that is homogeneous of degree
    Display Formula
    where I henceforth adopt Inline Formula. Then 2s is an integer (odd for a fermion and even for a boson). In the W-description, the dual twistor wave function Inline Formula is homogeneous of degree Inline Formula, where
    Display Formula
    In ordinary space–time terms, the position-space wave function of a massless particle of helicity 2s [1] satisfies a field equation, expressible in the 2-spinor form
    Display Formula
    for the integer 2s satisfying s<0, s=0, or s>0, respectively, where we have total symmetry for each of the |2s|-index quantities
    Display Formula
    Some of these field equations are more familiar in tensor form. In the case |s|=1, we can write (in abstract indices, a pair of capital spinor indices, unprimed and primed, standing for a single tensor index)
    Display Formula
    the antisymmetric quantities εAB and εAB giving the symplectic structure of the two-dimensional spin spaces, related to the space–time metric by
    Display Formula
    Then our field equations become Maxwell's free-field equations on Fab (∇[aFbc]=0, ∇aFab=0). When |s|=2 we write
    Display Formula
    finding that Kabcd has the symmetries of a trace-free Riemann (or Weyl) tensor Kabcd=K[cd][ab], K[abc]d=0, Kabca=0, satisfying the vacuum Bianchi identities: ∇[aKbc]de=0. This gives us the weak-field (linearized) Einstein vacuum equations. Moreover, the case |s|=1/2 gives the Dirac–Weyl massless neutrino (or anti-neutrino) equation.

    When |s|=1 or |s|=2 (or |s|=0) we can read our equations either classically or quantum mechanically. With quantum wave functions, we would normally demand a positive-frequency condition on the ψ and Inline Formula quantities; then the ψ-part would describe the left-handed (i.e. negative helicity) component of the particle's wave function, the Inline Formula-part describing the right-handed (positive-helicity) component. On the other hand, we can obtain the classical solutions of these field equations if, instead of demanding positive frequency, we demand that Fab or Kabcd be real, i.e. that the ψ-part and Inline Formula-part be complex conjugates

    Display Formula
    The part of Fab or of Kabcd involving ψ is called the anti-self-dual part and that involving Inline Formula the self-dual part.

    What is the connection between the twistor wave function f(Z), or dual twistor wave function Inline Formula, with these space–time equations? In most direct terms, it is given (for constants k, k′) by contour integrals [2]:

    Display Formula
    and
    Display Formula
    Here ABE or AB′…E′ are |2s| in number, and the 1-form δπ is
    Display Formula
    The contour lies within the Riemann sphere, in Inline Formula, of twistors Z=(ω,π) satisfying the incidence relation ω=ixπ (which removes the ω-dependence, introducing x-dependence, and then the integration removes the π-dependence leaving us with just x-dependence). Satisfaction of the field equations is an immediate consequence of these expressions. The 2-form ‘d2π’=(1/2) dδπ=dπ0′∧dπ1′ is sometimes more appropriate to use, rather than δπ, the contour then being two-dimensional, lying in Inline Formula rather than Inline Formula. In the dual twistor description, there are corresponding expressions.

    3. Twistor cohomology

    For the above contour integral expressions to give non-zero answers, it is necessary that the holomorphic function f possess singularities in appropriate regions. The exact nature of the singularity and contour locations in relation to the domains of non-singularity of the resulting ψ and Inline Formula fields had initially been somewhat puzzling—as had the conformal/Poincaré non-invariance of such domains—until it later became clear [2,5] that twistor wave functions are really to be thought of as elements of sheaf cohomology. We shall need to understand just the basics of this. It is easiest in terms of a Čech description and this is the route that I follow here.

    The issue is most clear-cut in the case of wave functions, and for these we require a condition of positive frequency. A convenient description of this is simply that our space–time functions (ψ or Inline Formula) extend holomorphically into the forward-tube domainInline Formula, which is the set of complex space–time points x+iy (points of Inline Formula) for which the imaginary part y is timelike and past-pointing. In twistor terms, complex space–time points are represented by complex projective lines in Inline Formula; those in Inline Formula by lines entirely within Inline Formula.

    Accordingly, for a twistor wave function, we are interested, specifically, in holomorphic functions f whose ‘domain’ is in some sense the region Inline Formula. But what sense can this be? In order for the contour integration in the above expressions to work, we require that it have singularities in two disconnected closed subsets of Inline Formula which intersect all the complex lines—these being Riemann spheres—in Inline Formula. The function f is then holomorphic throughout the region Inline Formula that is complementary, within Inline Formula, to these two singular regions. Thus, any complex line R that lies in Inline Formula (R representing a complex point r in Inline Formula) intersects Inline Formula, and it does so in an annular way, separating the two regions where f is singular. For any such line R in Inline Formula, the contour integral is then a loop within this annulus on the Riemann sphere, separating the two regions of singularity.

    A more appropriate way to think about this geometry, however, is in terms of a covering of Inline Formula by two open sets Inline Formula and Inline Formula, the function f being taken holomorphic throughout their intersectionInline Formula, within which the contour is located:

    Display Formula
    If any function holomorphic throughout Inline Formula or else holomorphic throughout Inline Formula is added to f, this makes no difference to the result of the contour integral, each such additional contribution adding nothing to the answer, as the contour can be deformed away on one side or the other of the Riemann sphere. We can generalize this to coverings by many open sets Inline Formula, Inline Formula with functions fij (=−fji) defined on intersections Inline Formula, taken modulo functions hk defined on entire sets Inline Formula in the manner of Čech (sheaf) cohomology, where refinements of such coverings and direct limits are taken when required. It is not necessary to go into the details of this here, as we shall find that 2-set coverings will be sufficient for our needs. The upshot is that twistor 1-particle wave functions should really be thought of, mathematically, as elements of holomorphic first (sheaf) cohomology on Inline Formula. For more details, see [2,5].

    The matter that will concern us particularly, however, is not to do with detailed issues concerning this standard linear cohomology, but with the way in which such twistor cohmology ideas can sometimes extend to nonlinear generalizations that express basic physical interactions. Most specifically, I shall be concerned with the way that the linear massless fields for spin 2 (|2s|=4) can be generalized to nonlinear (vacuum) general relativity, and also to gauge-field interactions of electromagnetism and Yang–Mills theory (|2s|=2). The basic constructions, namely those of the nonlinear graviton and the Ward gauge-field construction, were found almost 40 years ago [68], but they dealt only with the left-handed helicity interactions (s=−2 and s=−1) in standard twistor conventions. I indicate both of these only very briefly in the next paragraph, but we shall come to the gravitational construction in more detail in §4. The googly problem has been the issue of extending such procedures to include, also, the right-handed helicity in a way that allows both to be taken into consideration simultaneously as part of the same procedure. (It may be noted that ‘googly’ is a term used in the game of cricket for a ball bowled with right-handed helicity using the apparent action that would normally give rise to left-handed helicity.) This issue will be addressed in §§5 and 6.

    The procedures of Čech first cohomology, just referred to, involve taking a covering, by open sets, of the region of twistor space under consideration and regarding a twistor function (or family of functions) as something ‘passive’ that simply resides on the pairwise intersections of the open sets of the cover, the cohomology element provided by this family of functions having no active geometrical influence on the twistor space itself. However, under appropriate circumstances such functions can indeed be considered to be playing an active role, such as with the transition functions between ‘coordinate patches’ in the piecing together of a curved manifold, or by constructing a non-trivial bundle over a given manifold by gluing together pieces of trivial bundles. These two procedures are indeed what are involved in the nonlinear graviton and Ward constructions, respectively [68]. In the next section, I describe (in outline) how this works in the gravitational case.

    4. Nonlinear graviton construction

    The nonlinear graviton construction provides a twistor representation of a curved complex-Riemannian 4-space Inline Formula, where we find a very simple way of ensuring that Inline Formula is an Einstein manifold, i.e. Rab=Λgab (for given cosmological constant Λ). This works only in the case where Inline Formula has anti-self-dual Weyl curvature but is otherwise completely general. In standard flat-space twistor theory (see §1), a complex space–time point r in Inline Formula is represented by a complex lineR (a Riemann sphere) in Inline Formula. A very similar situation holds for Inline Formula, applying to any small-enough open neighbourhood Inline Formula of a point Inline Formula, and we examine how an arbitrary point r of Inline Formula arises as a corresponding lineR (Riemann sphere in an appropriate topological family) in a certain complex 3-manifold Inline Formula, a deformed version of a tubular neighbourhood Inline Formula of a line P in Inline Formula.

    A striking feature of this construction is that there is nolocal curvature information in the ‘curved’ twistor space Inline Formula (where Inline Formula is its projective version), despite the fact that there is actual local curvature in the space Inline Formula that is constructed from Inline Formula. This curvature arises entirely from global features of Inline Formula. Locally, Inline Formula would be identical, when Λ=0, to the twistor space Inline Formula of §1. When Λ≠0, it would be locally identical, instead, to the twistor space arising from de Sitter 4-space Inline Formula with (positive) cosmological constant Λ (or anti-de Sitter space if Λ<0). In order to clarify this distinction, I need first to be more explicit about the structure that Inline Formula actually acquires in order that the space–time metric can be encoded into Inline Formula's structure, in these two cases.

    Both in the case of Minkowski space Inline Formula and de Sitter space Inline Formula (and also in anti-de Sitter space) there are particular antisymmetric 2-valent twistors, fixing the metric structure of the space–time, which are referred to as infinity twistors [2]. These are Iαβ and Iαβ, taken to be both complex conjugates and duals of one another:

    Display Formula
    and
    Display Formula
    where εαβρσ and εαβρσ are Levi-Civita twistors, fixed by their antisymmetry and ε0123=1=ε0123 in standard twistor coordinates. For the infinity twistors, we have, in standard twistor descriptions
    Display Formula
    For de Sitter space Inline Formula, the infinity twistors provide a complex symplectic structure defined by the 2-form:
    Display Formula
    Also there is a symplectic potential1-form
    Display Formula
    When Λ=0, this symplectic structure becomes degenerate, the matrices for Iαβ and Iαβ becoming singular. When Λ≠0, they are essentially inverses of one another:
    Display Formula
    but annihilate each other if Λ=0.

    To construct Inline Formula, we consider our above tubular neighbourhood Inline Formula, of a line P in Inline Formula. Let us regard the Riemann sphere P as made up of two slightly extended (open) hemispherical regions whose union is P and whose intersection is an annular region, as is appropriate for the contour integrals of §2. Each hemispherical region is to be locally thickened out into the ambient complex 3-space to open sets Inline Formula and Inline Formula, each of Euclidean topology Inline Formula, so that

    Display Formula
    the annular intersection Inline Formula having topology Inline Formula, a thickened up version of the overlap between the extended hemispheres, as for the contour integrals earlier. The idea is to glue Inline Formula to Inline Formula in a seamless way, so that the twistor-space complex-manifold structure matches on the overlap and so also does the structure—that I call the I-structure—defined by Iαβ and Iαβ, for a given value of Λ.

    However, as things stand, this I-structure is not adequately defined, the infinity twistors being given in relation to the non-projective space Inline Formula, rather than Inline Formula. We need to phrase things in terms of ‘non-projective’ complex 4-spaces Inline Formula, where Inline Formula is some subregion of Inline Formula. Here, Inline Formula will be a Inline Formula-bundle over Inline Formula. (I am excluding the origin of Inline Formula in these considerations.) The Inline Formula-fibres of Inline Formula are integral curves of the Euler operator Υ. Thus, the ‘I-structure’ of Inline Formula really refers to Inline Formula, the Euler operator Υ being assumed given on Inline Formula for any Inline Formula in Inline Formula. We may note, also, that when Υ is applied to (i.e. contracted with) the 2-form Inline Formula, we get the 1-form Inline Formula, so that, in the presence of Υ, the I-structure of any such Inline Formula is simply equivalent to the complex symplectic structure Inline Formula (degenerate when Λ=0) restricted to Inline Formula.

    We shall first see how to deform Inline Formula merely infinitesimally, where we start with the two regions Inline Formula and Inline Formula overlapping along Inline Formula to make Inline Formula, as in §3. We can then obtain a general finite small deformation, preserving the I-structure, by ‘exponentiating’ the procedure considered at the end of §2 for a linearized anti-self-dual gravitational field. There we took a ‘passive’ twistor function f(Z), homogeneous of degree +2, defined throughout the intersection region Inline Formula, where Inline Formula is glued to Inline Formula, but we are now to think of f(Z) in an active way, telling us how to ‘slide’ the patches Inline Formula and Inline Formula across each other, preserving the matching of their I-structures. Infinitesimally, we can achieve this by performing an infinitesimal shift along the zero homogeneity vector field:

    Display Formula
    We see, immediately, noting vanishing of the Lie derivative of Iρσ with respect to this vector field (and its zero homogeneity, whereby Υ is also preserved) that this infinitesimal shift preserves the I-structure. When exponentiated, this provides us with a space Inline Formula which encodes a genuinely curved complex 4-space Inline Formula.

    It turns out that any complex-Riemann coformally anti-self-dual complex 4-space solution of the Einstein (Λ-)vacuum equations can be locally described from such a deformed twistor space with a globally defined I-structure. How does this work? First, we need the ‘lines’ within a Inline Formula (obtained by such means). I cannot go into full details here, but theorems of Kodaira and others can be invoked to establish the fact that spaces Inline Formula, constructed in this way (and not deviating too far from the initial Inline Formula) contain a complex 4-parameter family of ‘lines’ defined solely by the fact that they are imbedded Riemann spheres, with complex structure inherited from the ambient Inline Formula and belonging to the appropriate topological family, these lines being represented as the points of the space Inline Formula. An explicit geometrical procedure involving Inline Formula's I-structure then naturally assigns a complex-Riemannian metric g to Inline Formula [6,8], where g turns out to be anti-self-dual and Einstein. (The complex-conformal anti-self-dual metric of Inline Formula is defined by Inline Formula's complex-manifold structure, even without Inline Formula's I-structure, simply from the fact that intersecting lines in Inline Formula correspond to null-separated points in Inline Formula [6,8].)

    5. Palatial patching and twistor quantization

    We have seen that not only can linearized vacuum general relativity be encompassed in a natural (albeit somewhat surprising) way by twistor theory, but so also can the nonlinear theory—albeit restricted, as yet, to the left-helicity case. This provides some encouragement for the twistor programme, as a means towards describing Nature. Yet, these positive features were profoundly offset by the apparent inability of the theory to resolve the so-called ‘googly problem’, whose resolution ought to allow both left- and right-helicities to be twistorially represented together, according to full nonlinear Einstein theory. It is therefore fortunate that a new outlook is to hand, offering genuine hope for a complete solution to this long-standing conundrum.

    The key idea behind this altered outlook is to regard the underlying twistor structure as being modelled, in effect, not on the spaceInline Formula but on the non-commutative (holomorphic) twistor quantum algebraInline Formula referred to at the beginning of §2. For a (conformally) curved space–time, we would have a deformed such algebra Inline Formula that is, in an appropriate local sense, the same as Inline Formula, but whose global structure would encode the entire (conformal) geometry of a given curved space–time Inline Formula. The algebra Inline Formula itself is to be thought of as, in effect, the algebra of linear operators acting on (germs of?) holomorphic entities of some twistorial kind, constituting an imagined ‘ket-space’ |…〉 envisaged at the right of all these operators. An indication of this is given at the end of this section, but a full understanding of what is required has not yet become altogether clear. (The choice of ket-space is basically the notion, in standard quantum mechanics, of choosing a ‘complete set of commuting variables’. It is closely related to the issue of choosing a ‘polarization’ in geometric quantization [9].) In basic terms, Inline Formula is to be taken as the (Heisenberg) algebra generated by Zα and ∂/∂Zα, but where infinite series in these (non-commuting) operators would also need to be considered as belonging to Inline Formula. This raises issues of convergence and locality that need to be sorted out in due course, but for present purposes I shall ignore these more subtle issues and merely explain the general idea.

    As with the left-handed construction outlined in §4, we attempt to build our entire structure from pairs of local pieces, analogous to Inline Formula and Inline Formula, each containing no local information specific to Inline Formula, whose intersection seamlessly continues the twistor structure from one to the other. Yet, the unionInline Formula encodes the (Lorentzian) conformal structure of a local region of Inline Formula. When this ‘twistor structure’ appropriately incorporates an I-structure, as in §4, then Inline Formula automatically satisfies the Einstein Λ-vacuum equations—completely generally! At least that is the idea.

    We are now concerned with patching together two relevant ‘regions’ of the algebraInline Formula, corresponding to two ‘pieces’ like Inline Formula and Inline Formula, rather than simply patching together two pieces of a manifold, as in §4. As yet, it is not altogether clear how this is to be interpreted, as we do not actually have a twistor space, like Inline Formula or Inline Formula, leading to Inline Formula or Inline Formula, above. Instead, we appear to have a form of non-commutative geometry [10] arising from some kind of deformation Inline Formula of the algebra Inline Formula.

    Fortunately, for a real space–time Inline Formula, we can explicitly construct a global (real) 5-manifold Inline Formula analogous to the 5-space Inline Formula and, moreover, a non-projective 7-dimensional version Inline Formula analogous to the 7-space Inline Formula. The idea is to use Inline Formula to provide us with a key part of Inline Formula's structure. The curved Inline Formula is the space whose points represent the individual null geodesics—or rays—in Inline Formula. It is best to assume that Inline Formula is globally hyperbolic, as this ensures that Inline Formula is a Hausdorff (5-real-dimensional) space [11]. If we include a (null-vector) momentump (index form pa), pointing along each ray and parallel-propagated along it—to give what I call a scaled ray—then we get a 6-real-dimensional space Inline Formula, whose points represent these scaled rays. In fact, Inline Formula is naturally a realsymplectic 6-manifold, with symplectic potential 1-form Φ and closed symplectic 2-form Σ, given [2] by

    Display Formula
    (where, in coordinate notation, ‘dxa’ stands for the coordinate 1-form basis, and in abstract indices dxa is just a ‘Kronecker delta’ translating the abstract index on ‘pa’ to conventional 1-form notation). When Inline Formula, so our symplectic 6-manifold is the canonically given Inline Formula, we can apply twistor notation, finding
    Display Formula
    Equality of the two expressions for Φ follows from the nullity of Zα, since Inline Formula.

    At this point, the idea is to appeal to the procedures of geometric quantization [9], according to which a bundle connection is provided, the bundle being a circle bundle over the symplectic manifold (here Inline Formula) under consideration, the curvature of this connection being the given 2-form Φ. In the present situation, we are fortunate in the fact that the appropriate circle bundle, namely Inline Formula, is already to hand, the circle being the phase freedom in πA, where the momentum null (co-)vector pa, taken to scale the rays, is spinorially split:

    Display Formula
    The 2-spinor πA is also taken parallel-propagated along each ray γ—providing a π-scaled ray Γ—the phase freedom applying to each ray as a whole. This defines our required bundle 7-space Inline Formula. In fact (up to a twofold sign ambiguity) the phase is geometrically realized as a null 2-plane (‘flag plane’ [1]) through the null-vector direction determined by pa. In the flat-space case, this phase freedom is simply the Z↦eiθZ noted in §1, our circle bundle Inline Formula over Inline Formula being Inline Formula.

    The geometric (pre-)quantization connection [9] is defined by the 1-form Inline Formula, in the canonical flat case). The connection applies to helicity-charged fields on Inline Formula. This ‘helicity charge’ refers to a dependence on the phase eiθ above, and would be determined by the eigenvalue of the homogeneity operator Υ. This connection is consistent with the flat-space replacements

    Display Formula
    and gives them geometrical meaning for operations withinInline Formula also for a curved Inline Formula.

    This does not, however, extend unambiguously to curved analogues of Inline Formula and Inline Formula. The idea would be that, although locally possible, such extensions would be essentially non-unique, this freedom playing an important role for the palatial patching procedures. The key issue is the holomorphicity that the above replacements achieve, eliminating the anti-holomorphic quantity Inline Formula in favour of the holomorphic Zα throughout. The intention is that by such means, the algebra Inline Formula would be maintained as entirely holomorphic, as required.

    In the case of flat (or de Sitter) space–time, the above replacements are not only well defined but also fully consistent with the twistor formalism with regard to a notion of Hermitian inner productg|f〉. This applies to twistor functions f(Zα) and g(Zα) (actually representatives of first cohomology), being bilinear in Inline Formula and f(Zα), and is, in an appropriate sense, positive definite. Merely for notational reasons in what follows, it will be convenient to express this inner product in terms of a holomorphic bilinear scalar product {h|f} between functions Inline Formula and f(Zα):

    Display Formula
    due to Andrew Hodges (2014, unpublished data; see also [3]), involving two eight-dimensional contour integrations lying in Inline Formula, the first having a seven-dimensional (S7) boundary in WZ=0, the second being closed, where Inline Formula and Inline Formula are the natural complex 4-volume forms defined on Inline Formula (by εαβρσ) and on Inline Formula (by εαβρσ), respectively.

    Writing ∂α for ∂/∂Zα, we find, from various integrations by parts, that

    Display Formula
    Accordingly, ∂/∂Zα and −Wα have identical effects, when inserted between any ‘bra’ {…| and ‘ket’ |…}. This justifies the correspondence Inline Formula of §2, since in the Hermitian inner product, the variable Wα is playing the role of Inline Formula (though independent of Zα for the purposes of the contour integration).

    A similar calculation gives us the relation Inline Formula with Inline Formula (playing the role of Inline Formula, which at first sight appears to give the correspondence Inline Formula, with the wrong sign. However, this is a notational confusion, because if we think of the operator Inline Formula as being inserted between the {…| and the |…} in the expression Inline Formula, it would really acting to the left, as Inline Formula; i.e. Inline Formula. From integration by parts, this is equivalent to Inline Formula inserted between the {…| and the |…}, acting towards the right.

    This is an important point of the notation. In §2, we were thinking of all the quantities Zα, ∂/∂Zα, Inline Formula, Inline Formula, as acting on what follows to the right of them (ultimately on some unspecified ket-space |…〉), and the sign in the commutation relations in §2 is dependent on this. Here, we are taking of the ket-space as being represented by holomorphic first cohomology in the Zα variables. Accordingly, we indeed get consistency also with the correspondence Inline Formula of §2. The bra space 〈…| would be represented by anti-holomorphic cohomology, in term of the conjugate Inline Formula variables, which would be consistent with the reverse operator ordering throughout.

    6. Local twistors, palatial algebra and Einstein's equations

    When it comes to the deformed algebra Inline Formula needed for a curved space–time, we have to allow that no specific ket-space |…〉 be singled out globally to represent the algebra, as in §5, but that we might have different such representations, each defined only ‘locally’, in some sense, but where the ‘Heisenberg algebra’ would be independent of the particular |…〉 representation, and isomorphic, locally, to that provided at the end of §5, namely Inline Formula. A central question arises here, concerning the appropriate meaning of ‘local’ in this context. Although these issues are not yet fully resolved, we do have the (Hausdorff) space Inline Formula defined globally, and we have a well-defined notion of local neighbourhoods within Inline Formula.

    In fact, assigned to each single point of Inline Formula, i.e. to each ray γ in Inline Formula (and therefore also to each point Γ of Inline Formula, providing a π-scaling for γ), there is a canonically and conformally invariantly defined flat twistor space Inline Formula, which plays a role of a kind of ‘complex cotangent space’ to Inline Formula at Γ. This is obtained from the notions of a local twistor, and local twistor transport [2]. A local twistor is a quantity Zα=(ωA,πA), defined at a point q of the space–time Inline Formula, which transforms as

    Display Formula
    under a rescaling of Inline Formula's metric, according to gabΩ2gab. Since a local twistor is a quantity that can be assigned separately to each point of Inline Formula, we need to be careful when relating this concept to the notion of twistor used earlier, in §§1–3, where the 2-spinor pair (ωA,πA) referred globally to the (flat) space–time Inline Formula, assigning coordinates to the complex 4-space Inline Formula that is associated with Inline Formula. The notation in this section does correspond exactly to that of §§1–3, but only if we think of q as at the particular space–time origin point O.

    Recall from §1 that, when the origin is displaced to a general point q (whose position vector from O is qa), the twistor (ωA, πA) defined with respect to O becomes (ωA−iqAAπA, πA) when defined with respect to q. The local twistor perspective used here is that (ωA, πA), defined at the point O, when carried to q by local twistor transport, becomes (ωA−iqAAπA, πA), defined at q. When Inline Formula (or, indeed, when Inline Formula is any simply connected conformally flat space–time) the notion of local twistor transport is path-independent but this is not true in general.

    The definition of local twistor transport along a smooth curve γ in Inline Formula with tangent vector ta is

    Display Formula
    where
    Display Formula
    Taking γ to be a ray—which is simply connected, with topology Inline Formula (by Inline Formula's global hyperbolicity)—we use local twistor transport to propagate (ω, π) uniquely all along γ, thereby providing us with our canonical twistor space Inline Formula, assigned to γ. Correspondingly, we shall have spaces Inline Formula, Inline Formula and Inline Formula, just as in §1.

    We ask what the relation between each Inline Formula and the global space Inline Formula of rays in Inline Formula might be. Within each Inline Formula, the ray γ, when π-scaled to Γ, can itself be unambiguously represented by (0,πA) all along γ, this being unchanged by local twistor transport along γ (since Inline Formula and πAπA=0). When Inline Formula is confomally flat (and simply connected), the integrability of local twistor transport allows us to achieve this globally for the whole of Inline Formula, where a π-scaled ray η in Inline Formula that meets γ in a point q would be represented at q by the local twistor (0,ηA), in both Inline Formula and Inline Formula, where ηA provides the direction and π-scaling for η. In fact the spaces Inline Formula are all canonically isomorphic with each other, and (locally) with Inline Formula itself.

    On the other hand, in the general case, the non-integrability of local twistor transport prevents such a global twistorial representation of Inline Formula in this way. Instead, the idea of palatial twistor theory is that the holomorphic twistor Heisenberg algebras associated with each Inline Formula, though not necessarily canonically identified with one another locally, would constitute a kind of Inline Formula-bundleInline Formula over Inline Formula that is holomorphic in an appropriate sense. Such holomorphicity would not arise simply from the normal geometrical structures in Inline Formula, in the presence of conformal curvature, because the complex structure of Inline Formula is interpreted, in Inline Formula, in terms of the vanishing of shear in ray congruences [2], whereas the Weyl tensor provides the measure of change of shear along rays. Accordingly, when Inline Formula is conformally curved, we do not get a natural complex structure for Inline Formula (or, rather, natural CR-structure, like the one that Inline Formula inherits from Inline Formula). In palatial twistor theory, we obtain a holomorphic structure by removing all places where complex conjugates arise in the normal geometrical procedures and translate them into holomorphic procedures in accordance with the twistor quantization rules of §2. Most particularly, in accordance with the above relations for local twistor transport, and the twistor quantization rules, we have (like the local twistor transport equations for Inline Formula, as the complex conjugate of (ωA,πA))

    Display Formula
    Each of the twistor spaces Inline Formula will have its corresponding quantum algebra Inline Formula, but we have no reason to expect a canonical isomorphism between these algebras for different rays γ, when Inline Formula is conformally curved. However, I would expect that we can, for a topologically and holomorphically trivial open region Inline Formula of Inline Formula—that I refer to as a simple region—deform, continuously and holomorphically, the various Inline Formula so as to obtain a holomorphic ‘trivialization’ of the portion of Inline Formula lying above Inline Formula, thereby obtaining (by no means uniquely) a single algebra Inline Formula, continuously/holomorphically isomorphic to each Inline Formula for Inline Formula (and therefore isomorphic to Inline Formula) appropriately consistently over the whole of Inline Formula. This notion of ‘consistency’ should demand that there be a consistent ‘ket-space’ |…〉 for the entire region Inline Formula. The point is that ‘locally’—in the sense of over any simple region Inline Formula of Inline Formula—we can obtain Inline Formula, isomorphic to Inline Formula, with a consistent ket-space, but this consistency would not, in general, be possible globally.

    Each such ‘trivial’ Inline Formula is to be thought of in the spirit of a ‘coordinate patch’. Over the intersection Inline Formula of two simple regions Inline Formula and Inline Formula we require consistency of the algebras Inline Formula and Inline Formula in the sense of having a continuous/holomorphic deformation of one to the other, but we do not require a common ket-space to be present. Our global notion of the quantum twistor algebra Inline Formula for Inline Formula, and assigned therefore to the whole of Inline Formula, is obtained by taking a covering Inline Formula of Inline Formula by simple regions, with consistency over all (multiple non-trivial simple) intersections of the whole of Inline Formula of π-scaled rays in Inline Formula. Our requirement is that Inline Formula restricts to simple subsets Inline Formula, of Inline Formula in the way just described above. This algebra Inline Formula is, of course, to be taken in entirely abstract sense, the specific Inline Formula representations obtained from particular coverings having no special relevance to Inline Formula's structure.

    In order to identify the points of Inline Formula in terms of the algebra Inline Formula, we cannot do this by means of intersections of rays, because this condition, given in §1 as Inline Formula, involves a complex conjugation and does not directly survive within the local structure of Inline Formula. Instead, the points of Inline Formula have to arise by non-local considerations (as was the case with the nonlinear graviton construction of §4). Corresponding to any particular point r of Inline Formula there would be a locus R in Inline Formula representing r, namely the family of all rays through r, topologically S2 (Inline Formula acquiring a structure Inline Formula in Inline Formula), the idea being that the consistency (i.e. trivialization, in the above strong sense of having a consistent ket-space) of the Inline Formula-bundle over R is what determines such an S2 locus as representing a point of Inline Formula. For this to have a chance of working, as a sufficiently restrictive proposal for locating Inline Formula's points in terms of such a twistorial construction, we must ensure that the bundle Inline Formula is, indeed, in an appropriate sense holomorphic, so that the rigidity of holomorphicity can be appealed to.

    It does not seem unreasonable to me that Inline Formula, together with its conformal structure, would be obtainable in this kind of way. Although the nonlinear graviton construction, as outlined in §4, applies to complex space–times, so that the role of the space Inline Formula is not directly applicable, one can nevertheless see that in a complexified form the current construction reduces to it, in a degenerate case. The same would apply to the dual construction, where we must now employ a ket-space of dual twstor variables, this providing what has been referred to as a googly nonlinear graviton.

    Yet, there is considerable mathematical speculation and conjecture in the descriptions above, aimed at the non-local coding of the structure of a general (presumably analytic) Lorentzian globally hyperbolic real 4-manifold Inline Formula. There are many mathematical issues that need to be sorted out, not the least being a need for some suitable generalization of the Kodaira theorem [6] that is central to the construction of §4. Moreover, none of this encodes the formulation of Einstein's equations.

    It is perhaps remarkable, therefore, to find that Einstein's Λ-vacuum equations are themselves very simply encoded into this structure. For these equations provide precisely the necessary and sufficient condition that the local twistor spaces Inline Formula possess an I-structure (for given Λ), as defined in §4 (being constant under local twistor transport) and we now require that all the needed continuous/holomorphic deformations of the Inline Formula algebras preserve their nature as algebras on Inline Formula with this I-structure. If all these procedures (or something like them) indeed work as intended, with generalizations to the Yang–Mills equations and other aspects of physics, then there would appear to be significant openings for twistor theory in basic physics, not envisaged before.

    Competing interests

    I declare I have no competing interests.

    Funding

    I am grateful to the Leverhulme Foundation for supporting me with an Emeritus Fellowship during part of the time that this research was carried out.

    Acknowledgements

    I am grateful for valuable input from Michael Atiyah and Andrew Hodges, and also for useful discussions with Michael Enciso. The majestic ambiance of the unusual location (Buckingham Palace) of a brief discussion with Atiyah, no doubt provided inspiration for the initial thought that non-commutative twistor algebra should be the key to those subsequent developments described in this paper.

    Footnotes

    One contribution of 13 to a theme issue ‘New geometric concepts in the foundations of physics’.

    References