I’m looking for a solution to generate document (ideally docx but pdf is ok) from a database

Ex: I have a project entry (with client info, dates, information about the project, etc.) and I want to generate documents from a tender templates, containing selected entries from the database.

Here is what I tried until now :

  • Custom database (tinyDB) + custom webpage form + a docx template with jinja markups served by a homemade webpage hosted on pythonanywhere (lot of work and not reliable as I’m doing everything myself)
  • Nocodb form and database (no document generation yet) (self-hosted or on cloud)
  • Airtable (closed source and on cloud) for forms, database and document generation

Airtable is what I’m currently trying because it’s the only one that I found that have lot of support and adds on.

There are a few options on Airtable for document generation, lot of which cost around $30/month which is why I’m looking for a viable alternative. Ideally I would like to be able to upload my already made templates.

More point to the solution if it’s supports geodata

I’m considering keeping airtable and using the api to generate document with the python program I used on the first point, but I’d like to know if there is more options.

EDIT2: to be concise: I’m looking for an alternative to Airtable + Make. Ideally, FOSS and self-hostable or on cloud

Edit: precision: I need to create a document that contains multiple items of the db. Ex: I need to create a resume with different experiences that are saved in the database

Here is an example of a template:

  • megaman@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    0
    ·
    6 months ago

    Ive got some stuff that i think is similar to what you are trying where i have an excel file template and use python to read from the database and populate cells in excel and then save a pdf.

    There are a couple different options for python libraries - openpyxl, xlwings, or pywin32.

    It is annoying and goofy, but works. Excel can be very flexible with getting everything sized just right for what your final output/pdf should look like.

    • Biorix@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      0
      ·
      6 months ago

      Thank you !

      It’s pretty much the solution I already have: I generate a doc with DocxTemplate through a webpage made with Flask.

      What I’m looking for is a solution with a user-friendly pipeline that can be easily used by anyone once it’s set up

      Form > generate new entry in a db

      Entry > Select entry from tags > generate documents from template

      Airtable is already proposing something similar, which is why I’m currently trying it with zapier, Documint, and other automation solutions

      I’m looking for a self host solution but mostly a free and polished one

      • florian@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        6 months ago

        I seems a long time ago, I build the same thing as you. For templating I used https://github.com/christopher-ramirez/secretary and as “database” I used Google sheets. Still use it at work.

        It never was really user friendly so I am looking to replace it. That is also the main issue with your self build solution? Or are there other issues as well?

        I didn’t know about Documint. Looks interesting, will check it out, thanks 👍

        • Biorix@lemmy.worldOP
          link
          fedilink
          English
          arrow-up
          0
          ·
          6 months ago

          Nice!

          Secretary looks exactly like Docxtemplate, which I used on my homemade webpage. Maybe it’s a fork.

          It never was really user friendly so I am looking to replace it. That is also the main issue with your self build solution? Or are there other issues as well?

          Yes exactly. I need people to be able to use the tools easily and reliably and to be able to add templates themselves.

          Also, my main job is not developing tools and I can only do it on my spare time, so the fastest it is to implement the better.

          After a week to try, Airtable + Make seems to be the easiest. Airtable also offers to generate documents directly in it, but it lacks options.

          My main issue with a lot of tool (except Docxtemplate or similar) is to renders array of data. Most solution replace a {{tag}} with an info, but what I would need is a {{array[i]}} and to be able to generate different paragraphs.

          • florian@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            6 months ago

            What is “Make”? Hard to Google name.

            Have you considered open sourcing you self built solution?

            • Biorix@lemmy.worldOP
              link
              fedilink
              English
              arrow-up
              2
              ·
              5 months ago

              It used to be integromat. You can look it up more easily, haha

              I almost succeeded with it, but to integrate multiple entries in one document, it was too complicated.

              So, I’m modifying the code I originally made to make API calls to Airtable, and I assemble the doc with docxtpl

              I started by creating an API on my already functioning flask app, so everything can be done through Airtable page. But I was worried about opening an API to the world, so I decided to make a local python app that I’ll probably compile to .exe

              And yes, I can open source, but it’s really tailored to me needs

  • stuner@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    6 months ago

    Is using Latex an option? I’ve done that and it works quite nicely. You can easily populate a template e.g. using Python.

    • Biorix@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      0
      ·
      6 months ago

      It is, but the main issue is how to select the values from the database and to render without the user needing to tweak anything

      Latex, MD, Word is equivalent (although Word is preferred) since I’ll just place universal markers in it

      • dave@hal9000@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        6 months ago

        I am working on something similar and also planning on LaTex because it will be so easy to do find and replace because it’s plain text (just adding placeholders like ##NAME## or whatever), but I’m only planning on outputting PDFs, which would be easy enough. I don’t think there’s many viable solutions to go LaTex to docx if that’s a big requirement for you

        • Biorix@lemmy.worldOP
          link
          fedilink
          English
          arrow-up
          1
          ·
          5 months ago

          I’m using docxtpl which uses jinja placeholder to set values.

          For your solution, you should use jinja It’s used for whatever text files you want, htlm, txt, latex, MD, etc. And you can put code into the document (see my examples document in the post)

          • dave@hal9000@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            5 months ago

            Ah thanks! I am working with .NET, and I was surprised how there’s little out there in terms of (open source) libraries for LaTex (I did some research since this comment). I might end up going with docx via the OpenXML API. Also, I haven’t really used LaTex before (has been on on my learning to-do list), and once I started messing with some templates, I realized I need to learn a lot more first.

            One thing with my documents is that find and replace alone won’t work, as I need to replace some patterns. I am generating resumes, so I need to take something like a pattern for a job, and then repeat it several times

            • Biorix@lemmy.worldOP
              link
              fedilink
              English
              arrow-up
              2
              ·
              5 months ago

              Yes, that why I recommand jinja. as it can be used in OpenXML as well as latex or anything in plain text.

              Let’s say you want to place a table that corresponds to a certain pattern, you could add it to your file conditionally. In your Word document, you could add that :

              {% for job in jobs %}
                 {% if job.style == 1 %}
                     {{ job.name }} |  {{ job.date}} | ...
                 {% else %}
                     - {{ job.name }}
                     - {{ job.date}}
                     - ...
                  {% endif %}
              {% endfor %}
              

              I don’t know .NET but you can probably call a Jinja tools

              Also for the resume, you might be insterested in Rx Resume

              • dave@hal9000@lemmy.world
                link
                fedilink
                English
                arrow-up
                2
                ·
                edit-2
                5 months ago

                Ah thanks for letting me know about Rx Resume! Great resource, and actually solves the last mile problem (creating the document) of my little personal app. I am a bit of a jack of all trades, so I made a little database for the resume where the lowest level item (the little bullet points in the experience) can have tags attached to them. So I might describe the same job/experience in multiple ways depending on who the audience is, and then filter for the tags to only get the bullet points that are relevant for that position and generate a resume.

                Now instead of going into some whole slog of coding document generation, I can just export that bit as JSON and import into Rx Resume! Thanks again!