How do I build my own language model? Fine-tuning a Large Language Model (LLM)

by Helle Hannken-Illjes on May 24, 2024

Large Language Models (LLM), such as those behind ChatGPT, are transforming technical communication. There are many use cases for AI, from text generation to voice assistants. However, despite their power, generic LLMs sometimes do not provide the right solution for a company's specific projects. Generic AIs have a lot of general knowledge and can handle many languages and general texts – but they often struggle with requests from specific domains.

Is it possible to train a generative AI in a corporate language and to train it with the knowledge of the company?

We have trained and fine-tuned an LLM with technical documentation in two languages and examined the effects. In our presentation, we show the selection criteria for an LLM, the process of fine-tuning the LLM, and the results of the company-specific LLM.

What you will learn:

  • What are Large Language Models?
  • Use of language models in technical communication
  • Fine-tuning a large language model: process and results
  • Outlook for productive use in technical communication

The video is a recording of the presentation given by Helle Hannken-Illjes and Ulrike Parson at the tekom annual conference 2023. The presentation is in German.

How do I build my own language model? Fine-tuning a Large Language Model

We advise on the use of artificial intelligence, for example through the use of language models such as ChatGPT, in technical communication and for the various target-group- oriented channels. Find out more!

Add new comment

Your email address will not be published.

You might also be interested in

tekom regional group Munich: AI in technical communication: Use cases, legal aspects, and the future of our profession

June 05, 2024

AI applications such as ChatGPT are disrupting traditional text and image generation and will have a profound impact on technical communication.

In her presentation, Ulrike Parson will give an overview of current developments in AI and possible applications of AI in the creation and use of technical documentation, using examples from various systems. She will also discuss legal aspects such as the AI Act and the implications for our profession. more...