What does library assessment have to do with Victorian ideas about information? Quite a bit—including an inclination toward quantitative measurements, a practice of surveillance, and institutional strategic planning.
I’ve just finished reading The Imperial Archive: Knowledge and the Fantasy of Empire, written by English professor Thomas Richards and published by Verso in 1993. This is a fascinating look at information systems and the British empire—and it also reveals something about the imperial history and characteristics of library assessment.
As laid out by Richards, the central project of the imperial archive was the construction of a positivist and comprehensive knowledge of the world, which in turn would enable the British state to control and ultimately dominate the world’s people and resources. For the Victorian imperialists, knowledge truly was power. Through a series of literary analyses, the book demonstrates the info-paranoia of the imperialists as they worked—futilely—to construct a total knowledge of the world while also working to prevent rival states from constructing their own archives. Richards shows that Victorian information science covered a lot of ground still familiar to us today, including mapmaking, information retrieval, and information system design. In a neat twist, Richards concludes by showing that Victorian efforts to order information with a perfect classification system in fact resulted in even greater disorder that contributed to imperial collapse.
Underlying Britain’s imperial pursuit of total knowledge was a bias for quantitative measures. Richards quotes from a Victorian-era stats textbook that reflects the thinking of 19th-century England:
“Many people, in fact, have been led by their enthusiasm for numerical data to regard knowledge of a non-quantitative kind as hardly deserving the name ‘knowledge’ at all. Towards the close of the nineteenth century it was possible for Lord Kelvin to say: ‘When you can measure what you are speaking about and express it in numbers you know something about it; but when you cannot measure it, when you cannot express it in numbers, your knowledge is of a meagre and unsatisfactory kind.’” An introduction to the theory of statistics, 1911, p. xiii
Richards quotes further from this text in noting that the statistical theory of measurement at this time was linked to concepts of surveillance:
“[T]he progressive modern state finds itself under the necessity of keeping a close and quantitative eye on all that goes on within or without its frontier.” An introduction to the theory of statistics, 1911, p. xiv
Richards argues, however, that numbers cannot give anything like a complete representation of the objects they are supposed to describe, and that the self-serving fiction of total information control was always going to be a failure. Victorian approaches to information were hubristic and exclusionary, producing not only an illusory archive but also a set of tragically dedicated but disoriented archivists—information workers given the impossible task of quantifying all of the world’s knowledge in the name of imperial strategy. The imperial archive, as a folly of information practice, continues to have resonance today, especially with respect to three key areas of library assessment:
- quantitative bias, including standardized measures like LIBQUAL+ [1. Lilburn, J. (2017). Ideology and Audit Culture: Standardized Service Quality Surveys in Academic Libraries. portal: Libraries and the Academy 17(1), 91-110. doi:10.1353/pla.2017.0006.]
- privacy and surveillance, including learning analytics [2. Jones, K. M. L., & Salo, D. (2018). Learning Analytics and the Academic Library: Professional Ethics Commitments at a Crossroads. College & Research Libraries, 79(3), 304-323. doi.org/10.5860/crl.79.3.304.]
and student agency [3. Hathcock, A. (2018, January 24). Learning Agency, Not Analytics. At The Intersection. aprilhathcock.wordpress.com/2018/01/24/learning-agency-not-analytics/.] - measures that primarily serve institutions and the status quo of inequality, together with capitalism, [5. Gregory, L., & Higgins, S. (2017). In Resistance to a Capitalist Past: Emerging Practices of Critical Librarianship. In K. P. Nicholson & M. Seale (Eds.), The politics of theory and the practice of critical librarianship (pp. 21–38). Library Juice Press.] neoliberalism, [6. Seale, M. (2013). The Neoliberal Library. In Information literacy and social justice: Radical professional praxis (pp. 39-62). Litwin Books in association with GSE Research. http://eprints.rclis.org/20497/.] the drive to demonstrate value, [7. Robertshaw, M.B., & Asher, A. (2019). Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies. Library Trends 68(1), 76-101. doi:10.1353/lib.2019.0031.] and the role of the library in historical oppressions [8. de jesus, n. (2014). Locating the Library in Institutional Oppression. In the Library with the Lead Pipe. inthelibrarywiththeleadpipe.org/2014/locating-the-library-in-institutional-oppression/.]
Assessment librarians of today and imperial archivists of yesterday are linked through shared practices of collecting, storing, analyzing, and controlling information in support of institutional strategic objectives. Reading this book made me think of our contemporary library assessment practice as something akin to the 19th-century imperial archive: overly quantitative measures of internal surveillance less concerned with the liberation of oppressed peoples and more concerned with supporting long-established institutions and the structural inequalities that sustain them.
The book’s argumentation also finds parallels with emerging discourse around critical assessment. Critical assessment calls on practitioners to self-reflect on issues of individual and institutional power and privilege, to seek qualitative methods in critical balance with quantitative approaches, and to foreground subjects of assessment as co-equal participants in the research process. [9. Magnus, E., Belanger, J., & Faber, M. (2018). Towards a Critical Assessment Practice. In the Library With the Lead Pipe. inthelibrarywiththeleadpipe.org/2018/towards-critical-assessment-practice/.] The act of critically reflecting on power and privilege involves honestly confronting our past so that we can begin to build a better future. [10. Sentance, N. (2018, April 8). Engaging with the Uncomfortable. Archival Decolonist. archivaldecolonist.com/2018/04/08/engaging-with-the-uncomfortable/.] From the perspective of critical assessment, it is productive for white, western practitioners like me to reflect on the long history of information control as a tool of imperialism. From this point of recognition, we can begin to contribute to more equitable assessment practices that are capable of producing social and material benefits for the people who have been historically oppressed by empire.
A number of researchers and practitioners are already working in this direction with practices like assessment as care, [11. Douglas, V. A. (2018). Assessment as Care. ACRLog. acrlog.org/2018/12/04/assessment-as-care/.] community-based archives, [12. Zavala, J., Migoni, A. A., Caswell, M., Geraci, N., & Cifor, M. (2017). ‘A process where we’re all at the table’: Community archives challenging dominant modes of archival practice. Archives and Manuscripts, 45(3), 202-215. doi.org/10.1080/01576895.2017.1377088.] ethnographies, [11. Tomlin, N., Tewell, E., Mullins, K., & Dent, V. (2017). In Their Own Voices: An Ethnographic Perspective on Student Use of Library Information Sources. Journal of Library Administration. doi.org/10.1080/01930826.2017.1340776.] and other qualitative, participatory, human-centered approaches to assessment. [13. Punzalan, R. L., Marsh, D. E., & Cools, K. (2017). Beyond Clicks, Likes, and Downloads: Identifying Meaningful Impacts for Digitized Ethnographic Archives. Archivaria, 84(1), 61-102. muse.jhu.edu/article/684162; Marsh, D. E., Punzalan, R. L., Leopold, R., Butler, B., & Petrozzi, M. (2016). Stories of impact: The role of narrative in understanding the value and impact of digital collections. Archival Science, 16(4), 327-372. doi.org/10.1007/s10502-015-9253-5.] I enjoyed that this book sharpened my self-reflective perspective on the history of information, further reinforcing the need for justice-oriented approaches to assessment.