1. Mailing Lists
  2. Contributors
  3. Re: How to auto pull only selected folder (addon) from multiple OCA repo into one repo.

Contributors mailing list archives

contributors@odoo-community.org

Browse archives

Re: How to auto pull only selected folder (addon) from multiple OCA repo into one repo.

Re: How to auto pull only selected folder (addon) from multiple OCA repo into one repo.

Avatar

Re: How to auto pull only selected folder (addon) from multiple OCA repo into one repo.

by
Akretion France., Sébastien Beau
- 18/06/2019 12:34:16
Hi Jordi, Kitti

Regarding Ak the branch is here : https://github.com/akretion/ak

The concept is really simple
- you create a spec.yaml which is a light version of repo.yaml of git aggregate (exemple here : https://github.com/akretion/docker-odoo-shopinvader/blob/10.0/odoo/spec.yaml)
- when you launch ak build, it generate a repo.yaml file (the format of gitaggregator) and launch gitaggregator
- then you can launh ak freeze that will generate a frozen.yaml (format of gitaggregator but with all commit version specify)
- also ak will can generate symlink to specify exactly which module we want in the addons path

So basically ak is just a helper that improve the experience of gitaggregator

Regarding the docker part we use the https://github.com/camptocamp/docker-odoo-project

En example of project can be found here : https://github.com/akretion/docker-odoo-shopinvader/tree/10.0

The next step for use are :
- doing some tutorial
- sharing a pre-build image (the idea is to have a docker base image with the most used branch of OCA, so we can update a full project customer by just using the last pre-build image)



Le mar. 18 juin 2019 à 12:02, Jordi Ballester Alomar <jordi.ballester@eficent.com> a écrit :
Kitti, that was a similar idea to what O was proposing to David. And this 'aggregated' repo could be customer specific, or generic. Thia repo is automatically built out of a YAML repo/modules specification, like most projects here use.

So, +1 to your idea.


Given that, I must say that we use doodba very often, and it is good. The only thing I miss is the ability to understand the code diff when you want to do a new deployment to a customer. And that's where the above apporoach can work

El mar., 18 jun. 2019 9:52, Kitti Upariphutthiphong <kittiu@ecosoft.co.th> escribió:
Hi everyone,

While I am reading thorough all these cool options, which are about pulling addons from github from remote repo to local first, before spinning it up for use.

My other, may be weird idea, is to prepare the new github repo that aggregate all the needed addons from multiple repos (and PRs), all to happen inside github itself. If there is configuration yaml file to point to source, it it might also be in that repo. I am not sure we can create some kind of bot in github to do that?

In other words, a self maintained github repo that get itself updated (with predefined number of addons) as soon as the source gets updated.

This way, on the server(s) that we run Odoo, we just pull from this one special github repository, without worry about having to clone or prepare so many repositories first.

We try to make things tight because we want to maintain all same addons versions across projects. which we never achieved in the past.

Is this sound practical / possible to you?

On Tue, Jun 18, 2019 at 12:15 PM Kitti Upariphutthiphong <kittiu@ecosoft.co.th> wrote:
Love the gimmick in odooup :)

image.png

On Mon, Jun 17, 2019 at 8:02 PM David Arnold <dar@xoe.solutions> wrote:
Hi

And there is yet another one https://pypi.org/project/odooup/

It's just a tiny small wrapper around DockeryOdoo to help to init a new project. It also has a hidden gimmick :-)

It doesn't use git aggregator, just plain git submodules.

We found this most useful, because we can't resist at times, as a good fellow citizens, the urge to cleanly contribute back to upstream.

Therefore submodules are just trump.

Best Regards,

David A.

El lun., 17 jun. 2019, 7:52 a.m., Jordi Riera <jordi.riera@numigi.com> escribió:
Hello,

here at Numigi, we have tested git-aggregator and while it is great, we found the relation to the git repositories to tight. Our need was to pull add-ons and to add them to a docker. As simple as that. In this regard, we built gitoo (https://github.com/Numigi/gitoo). It does what we needed, nothing more. It pulls repository in a temporary folder, remove all the git related stuff and copy the wanted add-ons to the target directory.

We found in its simplicity what the company needed, and even some of our clients now us it.

It is open source and all the feedback/pull requests are welcome.

Hope it helps,
Jordi

Le lun. 17 juin 2019 à 04:32, David Beal <david.beal@akretion.com> a écrit :
Hello kitti,

Thanks to Pedro to present most of the tools. It seems they all use https://github.com/acsone/git-aggregator

Some of them are all in one solutions, but for your particular problematic I confirm it can be solved by symbolic links.

You can have a look to this lib


Doc is not fully and update documented

But here is the format you need to expose
spec.yaml.png

You see the format for merged branch and how to specify which modules (account-fin ...) are collected to 'links' directory gather all symbolic links

addons path is then only : /odoo/src/addons', '/odoo/src/odoo/addons', '/odoo/links', '/odoo/local-src'

finally `ak build` cmd : generate a repo.yaml file required by git aggregator which clone and update branch

Let me know if you need information

My 2 cts

Regards


David BEAL - akretion.com
Chef de projet
Odoo Développement / Intégration


Le lun. 17 juin 2019 à 08:22, Kitti Upariphutthiphong <kittiu@ecosoft.co.th> a écrit :
Thanks you Pedro, I will take a good look at it.

At first I was thinking about using Apache Airflow to automate git things (also to explore other aspect).

On Sun, Jun 16, 2019, 6:07 PM Pedro M. Baeza (Tecnativa) <pedro.baeza@tecnativa.com> wrote:
Hi, Kitti,

With "manual" deployments, it's difficult to handle all the possible needs you have for an Odoo installation. Before created a deployment system, what I did is to git clone full repos, and add in the addons path only one extra folder, in which I made symbolic links of each addon I want to put in the database. With that, you only need to do git pull on each repository for updating it, but symbolic links will keep the same number of addons.

But then, pull requests come to be important also, because you can't wait for the PR to be merged for having it in the installation. And also to auto-update concerning addons, and to have staging environment...

So we created Doodba (DOcker ODoo BAse) as a general solution for deployment: https://github.com/Tecnativa/doodba. It includes all the tools that our know how have recommended over the time, with all these questions solved: we have an addons.yaml file where you declare the repository and the addons, and they are auto-populated. You can put in repos.yaml possible pull requests and they will be auto-merged in your deployment. Auto-update, protected staging environment, Mailhog for checking outgoing mails, etc is the set of features you have.

For not being promoting only my solution, I have to say that other deployment methods have been done by other felow companies that are OCA contributors, like the pip system, packaging modules as pip packages and being able to do `pip install`, or other Docker based solutions like Dockery, Akretion docker-odoo or Camptocamp docker-odoo-project. Sorry if I miss any other one, but this is what I have in my head right now. Any other project can be mentioned as reply.

Regards

_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe

_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe

_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe



--
Jordi Riera - VP Technique
NUMIGI SOLUTIONS INC.
(514) 317-7944

Longueuil, Québec, Canada

_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe

_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe

_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe

_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe

Reference