mangatranslation

PHP manga automatic translator library (Works with Google Cloud Platform)

CPU Only, no cuda, no opencv, no local machine learning

Warning

• I am not a dev, this project work well, but the code quality is probably shi...
• In order to get acceptable result, your manga/comic raw quality has to be near perfect!!
• Google translate work well when translated from chinese(manhua), but not so well from Japanese(Manga)

Frontend

If you want to test the library you can use the following example.php file or use the dedicated frontend : https://github.com/hcharbonnier/mangatranslation-frontend

Translation examples

Source

Translated

Workflow summary

• Open image (jpeg, png, gif or bmp)
• Detect textboxes
• Detect font size
• OCR Text in textboxes
• Remove old text from textboxes
• Check in sqliteDB if we already know the translation for the current string
• Use Google API to translate (or free Deepl API)
• Expand textboxes if possible
• Adapt translation font size to fit in textboxes
• write translation in the corresponding textboxes
• export image

Known Issues

• Let me know

Installation

create a composer.json file in your project, and add:

{
    "minimum-stability": "dev",
    "require": {
         "hcharbonnier/mangatranslation": ">=1.3.0"
    }
}

then install depedencies:

composer install
mkdir uploads

Requirement

• php-7.4 (not tested with php<7.4 but could work)
• php-gd
• php-openssl
• php-bcmath
• php-curl
• php-sqlite3
• A google cloud platform project configured with translate and vision enable. (https://cloud.google.com/dataproc/docs/guides/setup-project)
• A free DeepL account if you prefer DeepL translation

Dev additionnal requirements

• php-7.4-xml
• php-7.4-xmlrpc
• php-7.4-mbstring

Example

example.php

<?php
require_once __DIR__ . '/vendor/autoload.php'; // Autoload files using Composer autoload

use hcharbonnier\mangatranslation\MangaImage;

$trans=new MangaImage($argv[1]);
$trans->detect_block();
$trans->merge_near_block();
$trans->ocr();
$trans->translate("google");  // possible values are "google" (default) or "deepl" 
$trans->remove_empty_block();
$trans->clean_raw();
$trans->write_translation();
$trans->export($argv[2],90);

Then run:

$ export GOOGLE_APPLICATION_CREDENTIALS=PATH_TO_GOOGLE_PROJECT.json
$ php example.php image.jpg translated.jpg

Extra features

Mangatranslation can be integrated with a custom frontend to perform better translation. This functions allow user to interact with the process:

Get list of textbox

$trans->get_blocks() : array

Manually specify additional a textbox

$trans->add_block($x1,$y1,$x2,$y2,$x3,$y3,$x4,$y4) : void

Get translation of textbox $id_block

$trans->get_block_translation(int $id_block) : string

Get OCR of textbox $id_block

$trans->get_block_ocr(int $id_block) : string

Manually specify translation

//to be call BEFORE translate() !!!
$trans->set_block_translation(int $id_block,"Translated text") : void

Manually specify cleaned raw image

$trans->set_cleaned_raw("toto_clean.jpg") : void