• Main Navigation
  • Main Content
  • Sidebar

Russian Digital Libraries Journal

  • Home
  • About
    • About the Journal
    • Aims and Scopes
    • Themes
    • Editor-in-Chief
    • Editorial Team
    • Submissions
    • Open Access Statement
    • Privacy Statement
    • Contact
  • Current
  • Archives
  • Register
  • Login
  • Search
Published since 1998
ISSN 1562-5419
16+
Language
  • Русский
  • English

Search

Advanced filters

Search Results

Comparison of Approaches to the Problem of Automatic Generation of Official Reply Letters using LLM

Ivan Evgenievich Nikolaev, Andrey Vitalievich Melnikov, Kirill Evgenievich Alekseev, Alexander Sergeevich Belonogov, Mikhail Aleksandrovich Rusanov
1174-1188
Abstract:

One of the key automation challenges for government agencies is the preparation of official response letters. This article presents an empirical comparison of two approaches to the automatic generation of official response letters: one based on templates defining the letter structure and one based on relevant letter examples selected using RAG. The original GovLetter dataset, which includes real-life business correspondence from government agencies in the Khanty-Mansi Autonomous Okrug – Yugra, was used as a basis. Generation was performed using a locally deployed open-source language model. The quality of the results was assessed according to 12 criteria using the Schema-Guided Reasoning (SGR) framework and the LLM-as-a-Judge methodology. The experimental results demonstrate that the example-based approach outperforms the template-based approach in most metrics, particularly in the accuracy of arguments, formal tone, and correct formatting. The obtained results confirm the potential of solutions based on document history for the effective automation of official response letter preparation.

Keywords: text generation, official correspondence, large language models, RAG, quality assessment, SGR.
1 - 1 of 1 items
Information
  • For Readers
  • For Authors
  • For Librarians
Make a Submission
Current Issue
  • Atom logo
  • RSS2 logo
  • RSS1 logo

Russian Digital Libraries Journal

ISSN 1562-5419

Information

  • About the Journal
  • Aims and Scopes
  • Themes
  • Author Guidelines
  • Submissions
  • Privacy Statement
  • Contact
  • eLIBRARY.RU
  • dblp computer science bibliography

Send a manuscript

Authors need to register with the journal prior to submitting or, if already registered, can simply log in and begin the five-step process.

Make a Submission
About this Publishing System

© 2015-2026 Kazan Federal University; Institute of the Information Society