For a current project, I’ve been struggling with my language files. They’re all JSON files, and will always fallback to English if translations aren’t available.

My problem is that when a new key is required, I use my english file by default. This leads to situations where my client wants to translate new keys to other languages, and I have to spend time looking at all files, figuring out which keys i haven’t added there.

Essentially I want to get to a point where I can give all the translation files to my client, and he returns them with the translated content.

What do you guys use for managing this? And how would you solve the situation i’ve found myself in.

  • properlypurple@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    18
    ·
    1 year ago

    Is there a specific reason your translations are in json files, and not using a system such as gettext? IMO those .po files are much easier to translate for non-tech people, especially with many third party apps available for editing them. There are libraries available for many languages, so you don’t have to do anything manually in most cases.

    • BetaSalmon@lemmy.worldOP
      link
      fedilink
      arrow-up
      10
      ·
      1 year ago

      No real reason for using json files, other than it’s a web app build in JavaScript, so json was kinda the default for it. Definitely open to changing to whatever makes it more convenient to manage.

  • o11c@programming.dev
    link
    fedilink
    arrow-up
    16
    ·
    1 year ago

    Stop reinventing the wheel.

    Major translation systems like gettext (especially the GNU variant) have decades of tooling built up for “merging” and all sorts of other operations.

    Even if you don’t want to use their binary format at runtime, their tooling is still worth it.

  • Durotar@lemmy.ml
    link
    fedilink
    arrow-up
    10
    ·
    1 year ago

    I have to spend time looking at all files, figuring out which keys i haven’t added there

    It sounds like a simple bash script could do that for you. Take keys from the English language file, compare against other language files, find missing keys for each language.

  • DaleGribble88@programming.dev
    link
    fedilink
    English
    arrow-up
    7
    ·
    1 year ago

    A trick the indie game development community has used for years is just a simple excel file. CSVs are the easiest to work with if you are unfamiliar. First column is the ID of the text that you can reference in code, and each column is a translation of that text. Get the initial translation in place, typically English, then email the excel file to anyone who ask to create as fan translation. Also, unless you are translating the Illiad, the extra memory use is negligible.

    • Faresh@lemmy.ml
      link
      fedilink
      English
      arrow-up
      4
      ·
      edit-2
      1 year ago

      CSVs are the easiest to work with if you are unfamiliar

      A disadvantage with this is, if you ever want to collaborate with someone else using version control, it will increase the amount of merge conflicts, because multiple strings will be on the same line.

      • DaleGribble88@programming.dev
        link
        fedilink
        English
        arrow-up
        4
        ·
        1 year ago

        True, but if there is a large project with many different collaborators, they’d need a more verbose system than a CSV file anyway. (And likely a more senior developer who knows how to handle situations like this.) My point is that excel files, and CSVs in particular, are easy to parse, easy to check for completeness, and easy to distribute to less technical people. Basically, while not optimal, they will just work.

  • starman@programming.dev
    link
    fedilink
    English
    arrow-up
    6
    ·
    edit-2
    1 year ago

    You could write a script that updates other files based on english file. It could put someting like

    "key": "UNTRANSLATED"
    

    to missing fields.

    • coloredgrayscale@programming.dev
      link
      fedilink
      arrow-up
      3
      ·
      1 year ago

      Usually a translation system might return the key value if the translation is missing. By translating with “untranslated” as a default you’d get just that text filled as fallback.

      Unless you reinvent the wheel for lookup and can just ignore your magic value, or put an if on every value lookup.

      Might be a risk there.

        • Vorpal@programming.dev
          link
          fedilink
          arrow-up
          1
          ·
          1 year ago

          Your idea will work with minor changes (if comments are supported in your file format). At work our tooling create entries like 123="English text" // UNTRANSLATED. Obviously not quite the same format, but it should be adaptable to any format that supports comments.

  • Almamu@lemmy.world
    link
    fedilink
    arrow-up
    4
    ·
    1 year ago

    Part of my CI/CD is a script that makes builds fail if any of my languages are missing keys, it takes English as the desired result and checks all the keys to ensure they all exist and prints a report of the ones that are missing in csv format so I can send them to translators. I generally run this manually before committing, but having it in the CI/CD helps preventing these errors from making it into production…

  • DonWito@lemmy.techtailors.net
    link
    fedilink
    arrow-up
    3
    ·
    edit-2
    1 year ago

    If you are using TypeScript it’s quite easy to create a system where the type system will enforce the existence of all translations. I think it should be possible to create a similar solution for other languages as well.

    For example:

    const enTranslations = { MENU: ‘’ };

    const plTranslations: typeof enTranslations = { MENU: ‘’ } as const;

    const t = (key: keyof typeof enTranslations) => get language() == ‘pl’ ? plTranslations[key] : enTranslations[key];

    Missing keys will fail compilation. If you want to skip check you can always use //@ts-ignore

    Additionally the type system will enforce only valid translation keys so you won’t be able to make a typo it forget to add English translation.

    • BetaSalmon@lemmy.worldOP
      link
      fedilink
      arrow-up
      2
      ·
      1 year ago

      I think I actually just want a system, which will take my English file as the default, and add the missing keys to the rest of the language files.

      • towerful@programming.dev
        link
        fedilink
        arrow-up
        3
        ·
        edit-2
        1 year ago

        Perhaps, the “fallback to English translations file at runtime” is obscuring errors.
        Might be worth redefining the system to throw an error when a translation key in the chosen language isn’t found. Even if that’s only done in Dev, whereas the fallback happens in prod.
        This will ensure a translation file has all the keys, even if the values are still default.

        Some tooling for you to easily add a new key, and have it also add that to all language files as [word] or something. So, the English word is still used, but the square brackets shows that it’s untranslated.
        Maybe some tooling to find all values that have the [], to generate a translation to-do list.
        Probably a tool to create a new translation file as well, which would duplicate the English file, but apply the “this is not translated” pattern to all the values

      • DonWito@lemmy.techtailors.net
        link
        fedilink
        arrow-up
        1
        ·
        1 year ago

        Quite a lot of IDEs will key you just click “add missing properties” action on the translation object to create a language file.

      • pinchcramp@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        Obviously I don’t know your codebase but couldn’t you do something like the following?

        function loadTranslations(locale) {
          const fallbackTranslations = require("/i18n/en.json");
          const translations = require(`/i18n/${locale}.json`);
          return {
             ...fallbackTranslations,
            ...translations
          };
        }
        
        • BetaSalmon@lemmy.worldOP
          link
          fedilink
          arrow-up
          1
          ·
          edit-2
          1 year ago

          That won’t work quite well because a lot of it is nested. But shouldn’t be too hard to account for that in a couple of lines of code.

          • pinchcramp@lemmy.dbzer0.com
            link
            fedilink
            English
            arrow-up
            2
            ·
            edit-2
            1 year ago

            Yeah, I don’t know the exact structure of your translation files but a deep merge of your fallback files and the requested locale file should be enough.

    • DonWito@lemmy.techtailors.net
      link
      fedilink
      arrow-up
      1
      ·
      edit-2
      1 year ago

      It’s also quite ready to transform this file to JSON and send it to translators through any service that supports his format.

  • Vorpal@programming.dev
    link
    fedilink
    arrow-up
    2
    ·
    1 year ago

    There are existing approaches: GNU gettext and Mozilla fluent comes to mind. I would try to use one of those. I understand that Mozilla Fluent has good support for the Web (unsurprisingly).

  • 🅿🅸🆇🅴🅻@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    edit-2
    1 year ago

    We return / display the translation key name if no translation is available for that language, including for the default (English).

    Also, on dev / test environments we can enable a config (.env) setting to append the text " [UNTRANSLATED]" to every value that doesn’t have a translation, as they’re easier to spot in the website / interface.

    I’m talking about a PHP /Laravel project so it was easy to override the default translation engine behaviour.

    • BetaSalmon@lemmy.worldOP
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      I suppose my main issue is with the actual language files. In terms of translation we also default to English. It’s just a tedious job to remember to add they new key to every language file, which is a problem I’m facing now.

      Due to so many new features, the non-English language files are quite outdated.