Category Archives: Non classé

“disant ses heures” : from HIMANIS to HORAE

We are delighted to announce that the French research agency is funding the HORAE project (ANR-17-CE38-0008). HIMANIS also highlights why it is important with one example:

Disant ses heures… (Paris, Archives Nationales, JJ44, fol. 98r)

un certain lieu ou il estoit alé disant ses heures

(translation: a place where he went saying his Hours; image Paris, Archives Nationales, JJ44, fol. 98r)

In another example, the book of hours of a Jehannette, daughter of Jehan Petit is central to the plot, since it is the cause of the crime! Used to force a date with the young Jehannette, it created a fight between the father and the daughter’s friend…

Thomas, par esbatement print les heures de ladite Jehannette qui estoient sur une fenestre dudit hostel en la presence de ladite Jehannette et de son consentement les emporta et dist a ycelle Jehannette qu’elle les alast querir a vespres en l’eglise, laquelle lui respondi que si feroit elle. Et tantost aprés, ledit Jehan Petit ala aprés ledit Thomas ou cymetiere de ladite eglise ou il estoit et de felon courage lui dist qu’il lui rendist ses heures, ou si non qu’il l’en poursuiroit et que faulsement et mauvaisement il les lui avoit emblees.

qu’il lui rendist ses heures (Paris, Archives Nationales, JJ 162)

At the core of the late medieval society…

HORAE (Hours – Recognition, Analysis, Editions) is a cross-disciplinary research project studying religious practices and experiences in the late Middle Ages through the books of hours, the absolute medieval best seller. In a public-private partnership, it gathers three partners in the Humanities and Computer Science: the Institut de Recherche et d’Histoire des Textes (IRHT, UPR 841), the private company TEKLIA and the Laboratoire des Sciences du Numérique de Nantes (LS2N, UMR6004). Books of hours forms, with more than 5000 preserved manuscripts, a vast and crucial ensemble to understand the medieval mindset. Yet, their textual content is very scarcely studied, although the massive production of such a large number of manuscripts is a pivotal cultural and industrial phenomenon to the profound changes in the medieval religious life. Not only a proto-industrial book production arises and the economics of demand shifts to the economics of offer, but also the awakening of the individual and the internalization of faith take places in an increasingly church controlled world. Books of hours are at the same time deluxe objects, implying social staging, and intimate objects, with devotional, memorial and eschatological challenges.

HORAE combines the research and expertise of all three partners in artificial intelligence applied to Computer Vision and image analysis, in Natural Language Processing (NLP), and in book history and religious practices. The research project aims at creating an integrated chain from image treatment to producing new knowledge by placing the end user at the center of the developments, by managing formats, interoperability and long term preservation, but also ergonomics and data visualization.The aims encompass: (1) re-using the many digitized manuscripts, which are online but underused resources; (2) new open source software for Handwritten Text Recognition (HTR); (3) tools for segmentation and plagiarism detection, adapted to the transcription of medieval manuscripts produced by the machine in order to identify the texts in the books of hours; (4) identifying and editing unpublished texts; (5) visualization of manuscript clusters, which share the same textual characteristics in the order of the different parts (Officium Beatae Mariae Virginis, votive offices, suffrages, prayers), but also in the order of textual units to identify the liturgical use; (6) studying the diffusion and circulation of devotional and liturgical texts at the end of the Middle Ages in order to better understand the cultures and faith in the 13th c.-16th c.

With its aims and methods, HORAE profoundly changes the ways of doing research in auxiliary sciences and tackles the challenges of big data. Books of hours have been too scarcely studied until new because they are too numerous, too complex and their text is very repetitive: now, their very number, repetitions and complexities make possible for this project to develop new and efficient technologies and methodologies and gain new knowledge on the Middle Ages.



Return on the language used for acts registration at the French Royal Chancery


The simple query of part of the protocol formula [ dei gratia francorum ] in the HIMANIS search engine return results that confirm what we already know about language used by the French Royal Chancery for recording acts.

Some warning.

  1. The complete formula ([name of the king] dei gratia Francorum rex…) is often skip and replace by “[name of the king] etc.”
  2. As the search engine is not yet lemmatized, distinction is made between “gratia” and “gracia”. To have more precise results, one can add the results of a second query [ dei gracia francorum ]
  3. Some noise might also be introduced by the vidimus copy of an act within an act.

Nevertheless, as from the first register (JJ35) the French Royal Chancery used both Latin and French and that one prevailed over the other at different periods, all major transitions are outlined by this query.

Serge Lusignan, in his 2004 book La langue des rois au Moyen Âge, point out how langage used evolved. From his observations, we can explain the major breaks-up in the following graph that we made from our query (number of query results are in red in the graph; in blue are the total number of acts for each register):

  1. JJ35-49: French is seldom used as language of registration by Philippe IV (5%)
  2. French is a little more used by Philippe IV two elder sons: JJ50-52 Louis X (19%) ; JJ53-60: Philippe V (10%).
  3. JJ53-65A: The French conquest begins slowly under his younger son, Charles IV (11% at the beginning; 26% at the end).
  4. JJ65B-79: Major break-up appears during the reign of Philippe VI. No reason is known, but in October 1330 French overthrow Latin for around 80% of act are registered in French from this date.
  5. JJ80-95: When Jean II become king (JJ80), Latin regain his place (2% of French only) until his capture. During the Regency of the Dolphin Charles (JJ84-95), French progressively take back his ground: from 32 % in 1358 it reaches 75% by the end of 1360. Back from his captivity, Latin is back again, but not with the past glory (21% French).
  6. JJ96-117: When Charles V becomes king in 1364 what today could be named a “Language policy” is put in place. From now, language is determined by the nature of the act recorded: French for remission; Latin for ennoblement, legitimation, Amortization and almost everything Church related. As Remission count for 62% of the registered act during his reign, French became predominant from now on.

NEW : improved fonctionalities for correcting query results

We improve the way to correct the results by adding two new functionalities:

1/ After a query, on the spotted words, when you click on the word you are asked if the word is correctly spotted. Not entirely sure of the result you got, we add a third option (“not sure”)  to “correct” or “incorrect”.

2/ When clicking on a word to see if it has been recognized, you have now a dropdown menu suggestions of the recognized word in order of confidence. You can now just select the correct answer from the list rather then typing it. Of course, if none of the suggested result is good you can still type the correct word manually.

The bounding box surrounding the word now appears and they are in color (green, yellow, red or grey) so you can have an idea of the confidence level of the word you are going to select. And don’t worry if the suggest word in the bounding box have nothing to do with the one you clicked: the system will only take into account the pixel on which you clicked on.

Lemmatized search is on it’s way. We are still testing it on a small sample of the corpus but it will be implement in the coming month.

A glimpse at the coverage of extant inventories

Last week, I was in Graz, talking about “Automated indexing of medieval manuscripts: the HIMANIS research project and the registers of the French royal chancery” at a Lunchtime Lecture of the Zentrum für Informationsmodellierung at the University of Graz.

For this lecture, I prepared a small slide which I had ever wanted to do: just give an idea of the coverage of the inventories at a glimpse. Well, it is easy and difficult at the same time.

The Virtual Reference Room of the National Archive indicates many inventories for the fonds JJ. Not fewer than 42!

But, if you simplify a bit, then, you have the systematic printed inventories from JJ 37 to JJ 79 (1300-1350), then you have handwritten unpublished inventories for the years 1350-1364 (JJ 80 to JJ 95), and, besides some particular text editions, esp. regarding the Poitou region, some geographic inventories for JJ 35 to JJ 266, covering the provinces of Gascogne, Blésois, Orléanais, Chartrain, Languedoc and Rouergue.
In the map above, there are of course some catches: I’ve avoided the question of the exact limits of the older provinces by using a map with actual departements. But I hope this gives a good idea of how much we have to discover in the Chancery registers 😀

Update on the inventories of the Chancery registers

Inventory of Archives Nationales, JJ 84 (11v-12r)

On December 5, during our second plenar meeting, held in Valencia (Spain), we discussed (among other topics) various issues that we have encountered with the inventories of the French royal chancery registers. Until the HIMANIS project, those were the only tools available to find particular information in those registers. They exist in different formats: printed or handwritten; some are already converted in EAD (in different flavours), but, despite the efforts of the Archives Nationales, not all available for the general public yet.

As we intend to use these inventories in the project in order to collect correct identifications for place and person names, as well as to evaluate the precision/recall of indexing, we need to have them in a interoperable electronic format (TEI / EAD).

The oldest inventory which we will use, and the only one covering the entire corpus, is the three volume manuscript inventory made in the nineteenth century by A. Longnon and A. Coulon, providing very short Latin summaries for each document. This inventory was retyped by the Archives Nationales and converted in the EAD format.

A second series of inventories encompass the geographical inventories which were elaborated for Gascogne; Languedoc and Rouergue; Berry, Blésois, Chartrain, Orléanais, Touraine. They cover the whole corpus (JJ 35 – JJ 266), but not all the acts in the corpus as they are limited by the region that they are interested in. It is also a short summary with index. We converted the OCR made by Gallica and converted them into TEI as already mentioned a year ago in our post on Named entities and ground-truth: progress report

Modern systematic inventories elaborated by the Archives Nationales come in different formats: printed, typed or are still at manuscript stage (Registres du Trésor des Chartes, Inventaires analytique, 6 vol. in 3 t.).

  • T. I: Philippe IV (1300-1314) [JJ 37 – 50]
    • OCR by AN; EAD with subjects index coded
    • Index (place names + persons) : TEI by IRHT
  • T. II: Fils de Philippe le Bel (1314-1328)
    • T.II.1 : Louis X, Philippe V (1314-1321) [JJ 50 – 60]: EAD by AN
    • T.II.2 : Charles IV (1322-1328) [JJ 61 – 64]: TEI by IRHT
    • No index existing
  • T. III: Philippe de Valois (1328-1349)
    • T. III.1 1328-1349 [JJ 65A – 69]: OCR by IRHT; TEI
    • T. III.2 1336-1346 [JJ 70 – 75]: OCR by AN; EAD
    • T. III.3 1339-1350 [JJ 76 – 79B]: OCR by AN; EAD
    • Index (subjects, person, place names, chancery notes): OCR by IRHT; TEI

Typed unpublished inventories have been retyped by the Archives Nationales (AN) :

  • Jean II and Charles Dauphin
    • JJ 80 – JJ 81: OCR by AN; plain text converted to TEI
    • JJ 83: OCR by AN; .xls to be converted to TEI
    • JJ 82 – 95: Ms. Index on cardboard files (persons and subjects) about 30.000 files; re-typed by AN
    • JJ 96 – 97: Ms. Index on cardboard files (persons, place names, subject): 4.500 files; retyped by AN
  • Charles V (1364-1366)rc
    • JJ 96 to JJ 98: abstracts and index in .xls to be converted to TEI

Last but not least, our main concern were with the 12 inventories that  were still in handwritten stage (JJ84-95 or about 1400 pages). Those where remained in the manuscript (JJ84-95 for the reign of Jean II and a part of Charles V). We therefore asked our partner A2ia if they can perform HTR on those. But how did we proceed to achieve this task?


First, the AN provided us with high resolution reproduction of those 12 inventories, or 1429 pages, at 300 dpi in tiff format. We then produce ground truth, which consisted of the 4 first pages of each inventories (1079 lines of text). Then A2ia trained and performed HTR. We were lucky as the inventory have only one hand and as the layout is very stable from one inventories to the other. Using a standard French model and lexicon from the printed inventories, this operation was able to be carried out quickly in less then 4 weeks and produced results that went beyond our expectations with a very high recognition rate and transcript almost usable as is.

Inserted acts and vidimus copies in the registers of the French royal Chancery: Originals without originality?

During the colloquium L’acte original, entre conceptions médiévales et concept diplomatique (Nancy, 6-7 oct. 2016), we presented a paper about the practice of “insertion”, which consists in transcribing an earlier document into the body of another act. This practice is used, according to the Vocabulaire international de diplomatique (International vocabulary of diplomatics), either to give legal support to this act (for example, by transcribing the powers of prosecutors or commissions), or to confer authenticity to the transcribed act, known as “vidimus”. This double practice is massive in the registers of the French Royal Chancery, going as far as to produce vidimus of vidimus.

Using the materials accumulated so far in the HIMANIS project, encompassing several text editions and all available inventories (despite the differences in structure),  we quantified this practice and documented its evolution from the reign of Philip IV (1286-1314) until Louis XI (1461-1483) and were able to show diachronic variation (with a maximum under the reigns of Philip IV’s sons and a sharp decrease under Charles V and his successors) as well as geographic differences.

We also studied the diplomatic features (beneficiaries etc.) and indications of collation (becoming quasi systematic under Philip VI) and mise en texte within the registers.

On the usefullness of Scholarly Digital Editions

During a workshop at the University of Saint-Quentin-en-Yvelines on digital text editions, we had the pleasure to make a provocative pun. Scholarly Digital Editions, a concept largely defined by our friends James Cummings and Franz Fischer (cf. their “Criteria for Reviewing Scholarly Digital Editions” online : and Elena Pierazzo (cf. her book DIgital Scholarly Editing: Theories, Models, Methods, available on HAL-SHS), are not only thought for the Humanists, but also for the machines. Indeed the better the edition is, the better it is to teach computer to read reading skills on medieval documents to beginners, i.e. Computers. We demonstrated that and how electronic editions can have a second life as a teacher for Artificial Intelligences, far from their original intent. In fact, our “ground-truth” is mostly based on the electronic edition by Ecole de Chartes of chancery documents published by Paul Guerin more than a hundred years ago: but to be good teachers, they need to be enhanced and upgraded to a more elaborate scholarly level.

Of course, this is not all. They also serve, along with indexes and inventories, to measure the accuracy and recall, and we all have to think about what it means to index (and not to edit) for the remnant parts and what conclusions we can draw from uncertain questions. That was the rest of our talk 😉

Old and new tools for retrieving information in a massive textual corpus

Seeking information in the registers of the French royal chancery was never an easy task. During the conference Administrer par l’écrit au Moyen Âge held at the IRHT in Paris on June 1st, 2016, our colleague Olivier Canteaut pointed out during our joint paper, it also applied to medieval researchers. Indeed, even in the Middle Ages, reading registers cover to cover was not excluded for retrieving a particular document because tables of contents and rubrics were more than often not sufficient to find the information that was needed. And to avoid such a tedious task, the king was sometimes gathering living witnesses of his predecessor’s act rather than searching for a copy in his registers! Still today, making research in those registers is daunting, especially for the time period following the reign of Jean II (1350-1364) where modern inventories are either partial or difficult to access.

A list is provided in the Virtual Inventory Room of the French National Archive [direct link to JJ inventories]

Screenshot of the list of inventories to access the JJ series in the French National Archive
Screenshot of the list of inventories to access the JJ series in the French National Archive


Therefore, as the main technological challenge of the HIMANIS project is to develop effective new tools for retrieving information in a massive document corpus like the chancery registers, how about merging ancient and new technologies?

Auto-indexation of the chancery register will provide keyword spotting across all the documents kept in the chancery registers. Combining this with all the existing materials (converted to electronic format), we aim at allowing simultaneous browsing between the auto-indexed digital images, document level segmentation, existing inventories, edited documents and indexed places names and persons.

IRHT's interface proposal to access the Chancery corpus: aligning and merging early modern inventories (tables of contents), 20th c. inventories and indexes, partial editions, and the result of automated indexing performed in the HIMANIS project
IRHT’s interface proposal to access the Chancery corpus: aligning and merging early modern inventories (tables of contents), 20th c. inventories and indexes, partial editions, and the result of automated indexing performed in the HIMANIS project


Text-Image Alignment: from alignment to enhancement

The first batch of our ground-truth and images has been processed. That are 489 pages, 7100 lines, 132’700 words! All on HD images provided by the French National Archive and based on the text edition by Paul Guérin. We now are able to see the text on the image :
Aligned text and image at word level on Paris, Archives Nationales, JJ 35, fol. 18v

From then on, we are now working on
1) the validation/correction of the alignment or segmentation… and here we have to acknowledge that our “ground-truth” was far from being 100% accurate (some links to images were wrong, some text paragraphs were omitted by Paul Guérin, and all sorts of funny discoveries)
2) the enhancement of the text edition, esp. by enriching it with the abbreviations as to create better models and a better ground-truth. For that, we have played with a little tool, which indicates which abbrevations are possible for a given word :

Web interface to select which abbreviations are present in a given word


Manuscripts are among the most important witnesses to our European shared cultural heritage. In recent years, large quantities of historical handwritten documents are being scanned and made available through web portals. Yet, the wealth of information conveyed by the text captured in these images remains largely inaccessible. General users and researchers more and more expect to query handwritten resources in plain text like printed books, but current handwritten text recognition technology is still far from offering sufficiently accurate transcripts on historical documents. This situation raises the need of searching approaches specifically designed for text images. HIMANIS aims at developing cost-effective solutions for querying large sets of handwritten document images. To this end, innovative keyword spotting, indexing and search methods will be developed, tested, adapted and/or scaled up to meet the real world conditions required. HIMANIS associate Computer Science (A2iA, UPVLC and RUG), Humanities (IRHT) and Cultural Heritage (The European Library, the Archives Nationales of France and Bibliothque Nationale de France) institutions and produce technology to generate new, research-based knowledge from historical manuscripts. As a challenging and particularly interesting case study, the large collection of registers produced by the French royal chancery (14th-15th c.) will be used as a test bed. This will allow sustainable use and management of this important cultural resource. Implementing user feedback will also increase our understanding of the meanings that it holds for people and how they perceive, use and interpret it, thereby meeting societal challenges in promoting its use and re-use. The expected outcomes of this project are: a) a new indexing/searching technology for historical manuscripts, brought to the market by A2iA; b) a new paradigm to study our historical heritage, as conveyed by manuscripts, by using full text search technology. c) a new vision of the raise of nation states in Europe via a new study of the corpus under this paradigm.