Among Winter Cranes

“Even as birds that winter on the Nile…” (Purgatorio XXIV.64)

The Quarterly of the Christian Poetics Initiative | Vol. 7 Issue 2 | Spring 2024


The Contributions of Empirical Analysis to Christian Poetics: A Proposal

by Stephen Ramsek

Stephen Ramsek is an MA student in English at Baylor University and an assistant on the Templeton Religion Trust project “Truth in Fiction: A Cognitivist Approach to Literature as a Source of Spiritual Understanding.” His poetry and fiction have appeared in Modern Reformation and The Clayjar Review.

 

Abstract

  Some advocates of aesthetic cognitivism maintain that ‘understanding’ is too slippery of a construct to quantify and thus can’t be measured psychologically. In this essay, I’ll first argue that understanding can be quantified, advocating for a shotgun approach that aims at gathering the many cognitive outcomes involved in understanding and generating large pools of items to measure these outcomes. Second, I’ll argue that if understanding as such can be quantified, then so can spiritual and religious understanding. Third, I’ll suggest a strategy for the reliable measuring of spiritual/religious understanding through literature and suggest what this may contribute to a Christian poetics.

Introduction

  The central aim in this essay is to suggest a practical way for spiritual/religious understanding-via-literature (SUL) to be measured empirically. In order to do this, I’ll argue, first, that understanding is something that can be measured empirically; and, second, that spiritual-religious understanding can be measured empirically. The final section, a suggested method of scale construction for measuring SUL, will depend on these arguments being successful.

  By way of introduction, I’ll explain some of the relevance of this suggested project to a Christian poetics. This explanation is necessary because it is not immediately obvious what bearing empirical studies may have on the theoretical business of Christian poetics. Many scholars may express doubt about how an empirical approach to literature can actually advance the kind of understanding that literary studies is after. Do not empirical studies of literary reception merely reflect the subjective experiences of readers? Do not empirical studies of literary texts simply reiterate what we can already tell from shrewd, educated reading? These are fair questions, and they remind us that an empirical literary studies should always be content to remain a species of literary studies and not strive to be its replacement. But this does not mean there are no substantive benefits to measuring how literary texts impact readers. On the contrary, the value of empirical studies of literature lies in their ability to foreground intriguing patterns and unexpected data points.

  For instance, an empirical study of how texts mediate spiritual or religious understanding could show that “realism” correlates negatively (or positively) with increases of spiritual/religious understanding, a phenomenon which would then have to be analyzed and explained theoretically. Similar studies could isolate the factors most commonly involved in promoting understanding, perhaps apt metaphors or striking descriptions, which lead the reader to see things in new ways and make better connections between things. These data points would produce fresh insights into subjects of study like figures of speech, which have otherwise been exhausted theoretically. These are only a few examples, but they demonstrate the point that empirical studies of literature provide new, interesting lines of research for theory-oriented scholars, including scholars of Christian poetics. I’ll now turn to the two arguments which, if they are successful, will establish the possibility of conducting empirical studies such as these in a reliable and fruitful way.

The Trouble with Understanding

  The impetus for these two initial arguments is the skepticism expressed by some scholars of aesthetic cognitivism about the empirical measurement of understanding. Aesthetic cognitivism is a theory of aesthetic value which holds that (1) artworks have cognitive value, and (2) the cognitive value of artworks is a part of their value qua artworks. The classic quote from Nelson Goodman’s Ways of Worldmaking captures the heart of aesthetic cognitivism well: “a major thesis of this book is that the arts must be taken no less seriously than the sciences as modes of discovery, creation, and enlargement of knowledge in the broad sense of advancement of the understanding.”1 While aesthetic cognitivism is concerned with the way artworks mediate all kinds of cognitive achievements, including propositional knowledge, it is especially concerned with the way artworks mediate understanding. The rather obvious reason for this focus on understanding is that artworks are generally non-propositional, so while some art forms (such as poetry or fiction) might mediate some propositional knowledge, most art forms do not contain large numbers of propositions which can be true and justified, and, when believed, produce “knowledge” in the reader. Propositional knowledge is most often mediated by science and educational materials. Art, on the other hand, is especially suited to mediate understanding, which is a broader and more dynamic cognitive achievement.

  The value of understanding is also its problem, however. Understanding is defined by many proponents of aesthetic cognitivism as an objectual knowledge, a knowledge of a thing, instead of a fact; the sort of knowledge we have of people or places, which is perhaps not less than but is certainly more than a collection of propositions mentally assented to. Baumberger classifies several kinds of cognitive achievements that count as understanding: (1) grasping new categories, (2) gaining new perspectives, (3) raising new questions, (4) obtaining phenomenal knowledge, (5) contriving thought experiments, (6) grasping new connections, and (7) gaining/improving cognitive skills and abilities.2 Literature scholar Michael Wood presents a similar list of kinds of understanding potentially mediated by literature: (1) self-understanding through contemplation of characters’ thoughts, (2) intimate understanding of other people, and (3) understanding of the structure and meaning of life.3 Many other such lists could be cited, which present a variety of distinct outcomes that apparently have nothing in common other than failing to count as knowledge proper. It is this complexity and subjectivity inherent in the construct of understanding that leads aesthetic cognitivist Jukka Mikkonen to say:

If we construe understanding from the point of view of the reader’s phenomenological experience of the work, it is difficult to see how the actual cognitive benefits of literature could ever be quantified and measured. How could we test, for instance, how literature helps us to see the significance of things or gives meaning to our experiences or helps us to make our lifeworld? Such things can be evaluated only from the perspective of the subject, who gives the work a meaning, not outside him or her.4

If understanding is an experiential sort of cognitive achievement, Mikkonen says, it is too subjective to be measured. Gibson echoes this view: “since the kind of insight art offers is not propositional, not expressible in terms of an acquired truth, one will have a rough time telling one’s peers precisely what he has learnt from an artwork. It does not, in other words, seem like a particularly quantifiable kind of information or insight …”5

Quantifying Understanding: Sketching an Approach

  The supposed problem is simple: because understanding is a complex, subjective, and multi-dimensional construct, it is too difficult to quantify and measure reliably. However, I suggest that the complexity and multi-dimensionality of understanding simply calls for a complex and multi-dimensional method of measurement. I’ll now outline my proposed method, but since it remains at the proposal level, some details will be left untreated.

  In keeping with best practices for psychological scale development,6 the first step in developing a measure of understanding would be to define its components in sufficiently granulated terms. At this stage a literature review of sources in both aesthetic cognitivism and the philosophy of understanding would be conducted, with the goal of sieving through overlapping components to determine the core cognitive outcomes associated with understanding. Once isolated, these outcomes would need to be defined and distinguished from one another as clearly as possible.

  In my preliminary literature review I found at least three distinct types of cognitive outcomes said to be linked to understanding: phenomenological, imaginative, and skill-based. Under each of these three categories are a variety of particular cognitive outcomes, such as gaining a new way of seeing something; gaining phenomenal knowledge of a situation or experience; developing increased attention toward something; asking new questions; considering possibilities; considering implications of actions or experiences; and being able to discern patterns and apply new concepts, or old concepts in new ways. Once the literature review has been conducted and redundancies in the different outcomes have been eliminated, a team of experts across philosophy and psychology would need to think carefully about each outcome and locate it in relation to established cognitive, affective, and conative processes, detailing (1) what mediates the outcome, (2) what temporal processes are involved in producing the outcome, and (3) how the outcome might manifest itself behaviorally. After each outcome has been defined and the outcomes have been grouped into distinct categories, a pool of items should be put together for each outcome. Table 1 provides a rough example of items for three possible outcomes.

  These pools of items should be tested against measurements of similar constructs to confirm validity and should be subjected to exploratory factor analysis, which will reveal whether the items are effective at all, and, if so, which items are more effective than others. In this iterative process of review and refinement, researchers may discover that certain outcomes are in fact just versions of other outcomes, or that certain outcomes theorized to be associated with understanding don’t play as big of a role as they are thought to. This is the advantage of the shotgun approach; that it is loose and can be tailored and toyed with until it is tight enough to be applied with perhaps only one or two questionnaires. But in order to capture the variety of outcomes involved in understanding, a psychological measure of understanding must be flexible. And it is my suggestion that if a shotgun approach were attempted, it would (eventually) be a reliable way of measuring understanding and improvements in understanding, because it would be developed in the same way as any other scale would be.

  I realize there might be a worry about such an approach relying on self-report. But because understanding is a cognitive-affective experience and not just a mental change (like gaining knowledge of new facts is), self-report is the only way to measure understanding accurately, just as self-report is the only way to measure emotion. The subject will just have to be trusted, and researchers will have to accept that there will always be some degree of uncertainty in the results of their measurements.

The Trouble with Spiritual/Religious Understanding?

  If it be granted that understanding can in fact be measured, it is still not obvious that spiritual or religious understanding could be measured. Isn’t spiritual and religious understanding outside the bounds of what we can measure? Isn’t that sort of thing purely subjective? I suggest it is not. On the contrary, I think if understanding can be measured, it is a construct especially well-suited to capture spiritual and religious changes in individuals. This is because understanding, as I explained, consists primarily in either (1) seeing things in new ways, (2) relating things in new ways, or (3) gaining or enhancing skills. All three of these aspects of understanding are experienced in the same way, no matter their content or object.

  A person can see something in a new way regardless of whether the object is fictional, imagined, represented, or presented experientially. Similarly, someone can relate things in new ways, or relate aspects of something in new ways, without having to believe in the facticity or truth of that thing. One can understand a hoax or a conspiracy theory just as one can understand a phenomenon in physics or biology. Understanding takes the same form regardless of its object because understanding, unlike knowledge, doesn’t require justification. Its only condition (if it has one) is that it should reflect the structural form of its object, which is a non-veridical condition.

  Therefore, understanding of religious concepts or spiritual entities will take the same form as any other kind of understanding; it will have the same phenomenological structure. Of course, as a Christian, I believe spiritual/religious understanding can also be an understanding of something real, true, factual, and valuable. But understanding’s object doesn’t have to be real in order for it to be real understanding. So, if understanding can be reliably measured using a shotgun approach, and if spiritual/religious understanding has the same phenomenological structure as understanding in general, then spiritual/religious understanding, too, can be measured.

Quantifying SUL: Sketching an Approach

  Having argued for these two points about understanding and spiritual/religious understanding, I’ll now turn to my suggestion about how spiritual/religious understanding-via-literature (SUL) can be measured and how this relates to the formations, and formulations, of a Christian poetics. My first two points, as I laid out in the beginning of this essay, were a part of a response to some aesthetic cognitivists’ objections to quantifying understanding. However, my third point, a suggested method of measuring SUL, explicitly assumes an aesthetic cognitivist position about literature: that literature has cognitive value, and that literature’s cognitive value is a part of its value qua literature. If literature’s value is partially cognitive, then it would be good to reliably measure how literature mediates understanding in groups of readers. However, I add to the cognitivist position an amendment: that the value of some works of literature is partially spiritual-cognitive and/or religious-cognitive. This is not as radical of an idea as it might seem prima facie; all it means is that, for some works of literature which touch on spiritual/religious themes, a part of their value lies in their ability to mediate cognitive outcomes concerning spiritual and/or religious concepts.

  My suggestion is that spiritual/religious understanding in particular can be measured by modifying ‘understanding’ items to reflect elements of literary texts. Here is a short quotation from “A Simple Heart” by Gustave Flaubert, in which a humble woman lives a quiet life of service and love and dies a peaceful death. Throughout the story she develops a religious fascination with her parrot, which she treats as an embodiment of the Holy Spirit. This is the last paragraph of the story:

A blue cloud of incense was wafted up into Félicité’s room. She opened her nostrils wide and breathed it in with a mystical, sensuous fervour. Then she closed her eyes. Her lips smiled. Her heart-beats grew slower and slower, each a little fainter and gentler, like a fountain running dry, an echo fading away. And as she breathed her last, she thought she could see, in the opening heavens, a gigantic parrot hovering above her head.7

Table 2 provides an example of an item designed to measure one form of SUL mediated by this text.

  There are at least two ways that SUL scales could be developed. The first would be a text-by-text approach in which items would be gathered from the pools associated with each cognitive outcome and then tethered to features in a particular text. This process would need to be repeated for each different text. The second would be a feature-driven approach, in which a new pool of items could be created for each textual feature (such as metaphor, striking description, ethically interesting character interactions, etc.) and its related cognitive outcome. Then, researchers would need to conduct careful rhetorical analysis of a text and identify which features associated with which cognitive outcomes are present in the text, and then collect the relevant items into a unique questionnaire based on these textual features. I’m not sure which of these approaches would be easier to implement, nor do I know which would be more effective. But they are suggestions to be considered and weighed by experts in both poetics and psychology.

  In sum, my suggestion is that while measuring understanding, and SUL specifically, may not be easy, it is nevertheless possible and is a worthy object of pursuit. By no means should my suggestion be taken as a theory on its own or as a falsifiable, scientific claim about how understanding can be measured. It’s simply been my goal to offer some thoughts and suggestions which may prompt more qualified researchers to engage in the actual development of these sorts of measurements.

  So, perhaps understanding can be quantified after all. Perhaps SUL can be measured. But how does all this relate to a Christian poetics? It is not my claim in suggesting this line of research that texts ought to be judged by their cognitive effects on readers, which would amount to no more than an updated reader-response criticism. Nor do I claim that poetics should take an empirical turn and shore itself up with statistics and psychological data. Rather, I think empirical research into literature’s cognitive effects on readers, and specifically literature’s capacity to mediate spiritual/religious understanding can act as a healthy and fruitful supplement to theoretical inquiry into Christian poetics.

  An SUL scale would have the most relevance to what David Mahan terms the “literary creation” aspect of poetics, which studies the work of literature itself, including its “formal elements” and the “effects it works on us,” its readers.8 From studies using SUL measurements would emerge patterns, such as which species of understanding are especially related to religious and spiritual change, which formal features of texts are most statistically relevant to increases in understanding, how length or medium (digital, auditory, physical) influence understanding, and to what degree particular texts or authors or genres lead to increases in spiritual/religious understanding. As these patterns surface, they will provide fodder for future research into certain rhetorical devices, genres, and perhaps unexpected authors or works, with the aim of exploring their role in mediating spiritual/religious understanding. Significant differences will also surely appear between fiction and poetry (and perhaps even drama) in terms of their capacity to produce different kinds of understanding, which will call for new and interesting interdisciplinary studies.

 

Stephen Ramsek

M.A. Student in English, Baylor University
Assistant, Templeton Religion Trust project “Truth in Fiction: A Cognitivist Approach to Literature as a Source of Spiritual Understanding.”

sramsek@gmail.com


1 Nelson Goodman, Ways of Worldmaking (Indianapolis: Hackett, 1978).
2 Christoph Baumberger, “Art and Understanding: In Defence of Aesthetic Cognitivism,” in Bilder sehen: Perspektiven der Bildwissenschaft, ed. Mark Greenlee, 1. Auflage, Regensburger Studien zur Kunstgeschichte, Bd. 10 (Regensburg: Schnell + Steiner, 2013), 10–17.
3 Michael Wood, Literature and the Taste of Knowledge (Cambridge: Cambridge University Press, 2005), 17–20.
4 Jukka Mikkonen, “On Studying the Cognitive Value of Literature,” The Journal of Aesthetics and Art Criticism 73, no. 3 (July 2015): 273–82, https://doi.org/10.1111/jaac.12172, 277. Emphasis added.
5 John Gibson, “Cognitivism and the Arts,” Philosophy Compass 3, no. 4 (July 2008): 573–89, https://doi.org/10.1111/j.1747-9991.2008.00144.x, 14.
6 Following Lee Anna Clark and David Watson, “Constructing Validity: New Developments in Creating Objective Measuring Instruments.,” Psychological Assessment 31, no. 12 (December 2019): 1412–27, https://doi.org/10.1037/pas0000626.
7 Gustave Flaubert, Three Tales, trans. Robert Baldick (London: Penguin Books, 1987), 56.
8 David Mahan, “The Critical Task of a Christian Poetics,” Among Winter Cranes 6, no. 1 (Winter 2023).

 
 

Spencer Collection, The New York Public Library. “Momoyogusa = Flowers of a Hundred Generations.” The New York Public Library Digital Collections. 1909. http://digitalcollections.nypl.org/items/510d47e0-cb13-a3d9-e040-e00a18064a99

Dante Aligheri. The Divine Comedy: Purgatorio. Trans. Allen Mandelbaum. New York: Bantam Dell, 2004.


Previous
Previous

The Literary Afterlives of Simon Weil: Interview with Cynthia Wallace | Vol. 7 Issue 3

Next
Next

Perichoretic Hymnody: Perelandra as Model for Theological Poetics| Vol. 7 Issue 2