ImageTrans is an image translation software which supports all kinds of images. We can use it as a manga translator, as well.

Here are the steps to translate manga images.

  1. Put all the images in a folder.
  2. Open Imagetrans and create a new project. You can configure the language pair of the project, like Japanese to English.
  3. Import the images in the folder.
  4. Use balloon detection or heuristic text detection to detect all the text areas.
  5. Select a Japanese OCR, like mangaOCR, to extract the text of all the text areas.
  6. Select a machine translation engine, like Baidu or Google, to translate all the text areas.
  7. Check the “Translated” checkbox and you can see the translated image with the original text removed and the translation injected.
  8. (Optional) Since the Japanese is in vertical layout, to improve the English typesetting, you can enable the option to convert vertically aligned text areas for horizontal text in the project.

Example

Original:

Japanese manga

Translated:

English translation

Image source: https://github.com/mantra-inc/open-mantra-dataset

Video Tutorial