PLaMo Translation with LM Studio

1
<|plamo:op|>dataset
2
translation
3
{% for message in messages %}
4
<|plamo:op|>input lang=English
5
{{ message['content'] }}
6
<|plamo:op|>output lang=Japanese
7
{% endfor %}

1
<|plamo:op|>dataset
2
translation
3
{% for message in messages %}
4
<|plamo:op|>input lang=Japanese
5
{{ message['content'] }}
6
<|plamo:op|>output lang=English
7
{% endfor %}

1
<|plamo:op|>

1
## PLaMo Translation
2

3
On May 27th of this year, Preferred Networks Inc. (PFN) [released PLaMo Translation](https://tech.preferred.jp/ja/blog/plamo-translate/).
4
For a detailed introduction to PLaMo Translation, please refer to the official blog, but to briefly summarize, this model is a translation system based on large-scale language models (LLMs), much like the well-known ChatGPT.
5

6
The PLaMo Translation model is available on [HuggingFace](https://huggingface.co/pfnet/plamo-2-translate) and comes with a [demo page](https://translate.preferredai.jp/).
7
Since the model is publicly available on HuggingFace, it means we can run it on our local PC as well.
8
PFN has also announced a [PLaMo Translation CLI tool](https://tech.preferred.jp/ja/blog/plamo-translate-cli/) for command-line use.
9

10
While there are multiple methods to run the model, here we'll demonstrate how to execute it using LM Studio.
11

12
## LM Studio
13

14
[LM Studio](https://lmstudio.ai/) is a graphical user interface (GUI) application that allows you to easily run LLM models in your local environment.
15
To install it, simply download the installer from the [downloads page](https://lmstudio.ai/download),
16
and execute it to complete the installation process.
17

18
### Downloading the Model
19

20
After launching LM Studio, proceed to download the model.
21
You can access the download screen by clicking on the magnifying glass icon on the left side of the window that appears after launch.
22

23
<Img src="./images/lm-studio_launch.png" />
24

25
To download the PLaMo Translation model, enter a search term like "plamo translate" in the search field. This will display several matching models; select the one published by the user mmnga and click the "Download" button. In the screenshot above, the text "Use in New Chat" indicates that you have already downloaded this model.
26

27
<Img src="./images/lm-studio_donwload-model.png" />
28

29
### Model Configuration
30

31
After completing the model download, click the folder icon on the left side of the window to open the screen displaying your downloaded models.
32
You should find a model with the name `plamo-2-translate` in the list of available models; then click on the gear icon in the "Action" column of that row.
33

34
<Img src="./images/lm-studio_model-list.png" />
35

36
This will display configuration settings for editing the default parameters of the model.
37
To use PLaMo Translation with LM Studio, you need to modify the settings under both the **Prompt** tab's "**Promp Template**" and "**Stop String**" options.
38
While writing this article, I noticed that changing the "**Additional Stop String**" instead of "**Stop String**" might also work well.
39

40
<Img src="./images/lm-studio_model-template.png" />
41

42
#### Prompt Template
43

44
Delete all the default template text ("Template (Jinia)"), and replace it with the following template:
45

46
```txt
47
<|plamo:op|>dataset
48
translation
49
{% for message in messages %}
50
<|plamo:op|>input lang=English
51
{{ message['content'] }}
52
<|plamo:op|>output lang=Japanese
53
{% endfor %}
54
```
55

56
The current configuration is set up for "English to Japanese translation."
57
For "Japanese to English translation," you should configure it as follows:
58

59
```txt
60
<|plamo:op|>dataset
61
translation
62
{% for message in messages %}
63
<|plamo:op|>input lang=Japanese
64
{{ message['content'] }}
65
<|plamo:op|>output lang=English
66
{% endfor %}
67
```
68

69
#### Stop String
70

71
Next, configure the "Stop String" as follows:
72

73
```txt
74
<|plamo:op|>
75
```
76

77
<Img src="./images/lm-studio_termination.png" />
78

79
After entering the text in the textarea and pressing Enter, you'll see tag indicators displayed on the screen as shown below.
80

81
### Let's Try It Out
82

83
After completing the settings, click the speech bubble icon on the left side of the window to display the chat UI interface for using LLM models.
84

85
<Img src="./images/lm-studio_chat.png" />
86

87
Next, to load your model, click on "Select a Model" at the top of the window.
88
This will display the list of downloaded models; select "Plamo 2 Translate."
89

90
<Img src="./images/lm-studio_load-model.png" />
91

92
You'll then be prompted with some settings, but here we'll leave everything as default and click "Load Model."
93

94
<Img src="./images/lm-studio_model-configuration.png" />
95

96
This will display the familiar UI similar to ChatGPT, so simply enter some English text and press Enter.
97
PLaMo Translation will then provide you with the Japanese translation.
98
In these screenshots, I have provided a [description](https://etc.usf.edu/lit2go/41/the-merchant-of-venice/) of Shakespeare's "The Merchant of Venice."
99

100
<Img src="./images/lm-studio_translate.png" />
101

102
<Img src="./images/google-translate.png" />
103

104
Compared to Google Translate, I feel there are many parts that have been paraphrased rather than directly translated,
105
but the translation doesn't lose the original context, so it may prove useful when you need to quickly compile and translate large amounts of English information.
106
I'll try using it for machine translation of this blog, and if the results are satisfactory, I think I'll adopt it.
107

108
### Important Note
109

110
As a note, since the model hasn't been trained for conversational usage, providing translation instructions won't be effective.
111

112
<Img src="./images/lm-studio_plamo_response.png" />
113

114
While the settings allow you to choose whether to translate from English → Japanese or Japanese → English,
115
the system will only function correctly when provided with language combinations matching those specific settings.
116

117
### Eject
118

119
Finally, be sure to either fully stop LM Studio or eject the model to prevent memory allocation when the model is unused.
120

121
<Img src="./images/lm-studio_eject.png" />