Contributors mailing list archives

contributors@odoo-community.org

Re: runbot status update: we have docker

by
Vauxoo, Moisés López Calderón
- 27/11/2016 19:32:07
There are small changes to consider with runbot dockerized builds:

1. A TESTS=1 is required from .travis.yml

2. If you use pycrypto now is required add it to requirements.txt (This library is installed by default from travis without declare it)

Optional:
3. Use first "TESTS=1 REPO=odoo/odoo"
Runbot use the first build with TESTS=1, then If there is a "TESTS=1 REPO=OCA/OCB" before of "TESTS=1 REPO=odoo/odoo" runbot will use it OCA/OCB instead odoo/odoo to build.


2016-11-16 10:08 GMT-06:00 Laurent Mignon <laurent.mignon@acsone.eu>:
Thank you Moises for these infos.
Indeed the need to isolate required apt packages justifies the use of docker...


On Wed, Nov 16, 2016 at 2:53 PM Moises Lopez <moylop260@vauxoo.com> wrote:

Virtualenv was the first option... But we can isolate the apt packages here.

A good example is https://github.com/OCA/delivery-carrier/pull/91

We need a particular version of a package.
Travis is green but runbot is red.

Then if we install that version of a package other repository could fail.
And we need explain to server admin (Alexander) why we need this version to install it manually.

This is not posible with virtualenv.

Then most used CI in the world is travis.
Are they using just virtualenv?

We saw that they are using docker.

Why they are using docker and work fine?

The main concept is VE (Virtual Environment) this is not a VM (Virtual Machine).

But the full post is here:
https://blog.travis-ci.com/2014-12-17-faster-builds-with-container-based-infrastructure/


El 16/11/2016 2:38 a.m., "Laurent Mignon" <laurent.mignon@acsone.eu> escribió:
Thank you for this work but I'll never understand why we use docker since virtualenv exists... 

On Wed, Nov 16, 2016 at 8:52 AM Pierre Verkest <pverkest@anybox.fr> wrote:
Thanks for all this huge works.

2016-11-15 19:22 GMT+01:00 Pedro M. Baeza (Tecnativa) <pedro.baeza@tecnativa.com>:
Thank you very much for summarizing them!

Regards.

2016-11-15 19:08 GMT+01:00 Moises Lopez <moylop260@vauxoo.com>:
@Alexander
Thanks again.

@Pedro
I can reply you with a small (very small) summarize:

- Auto-Configured
OCA projects now are self-configured from github project using (1) MQT with meta-files like as:
 - .travis.yml (apt-get install)
 - requirements.txt (pip install)
 - oca_dependencies.txt (git clone)

For runbot we need create a custom configuration to reproduce the same environment.
 - apt-get install
 - pip install manually
 - Configuration of repositories dependencies manually.

Use runbot_travis2docker allow us use the same OCA projects self-configured in runbot and avoid create issue to install packages:

- Isolated
Before runbot use the same environment for all projects.
Then if your project require the version of a package freeze and other one require other particular version is not posible because is the same environment.

Using runbot_travis2docker you can use postgresql-9.5 or a custom freeze version of a packages because is isolated from other environments.
Example:
Imágenes integradas 1

- Reproduce it locally
Many times we have a error in runbot or travis but we can't reproduce it in local.
This environment allow us enforce the tools to reply a build in local with travis2docker (2)
Examples:

- Use of docker
Use docker open infinite possibles way to improvement the builds in the future:
 - @Jairo Yopis have good ideas about using concepts like as: serverless (More info with Jairo, please)
 - Use docker could allow us create a ssh connection to the build-instance isolated using our github.com/USER.keys

2016-11-15 10:22 GMT-06:00 Pedro M. Baeza (Tecnativa) <pedro.baeza@tecnativa.com>:
Thank you again for the hard work. Can you summarize the advantages of having this new architecture?

Regards.
2016-11-15 17:07 GMT+01:00 Alexandre Fayolle <alexandre.fayolle@camptocamp.com>:
Hello,

Thanks to Moyses Lopez who fixed a small issue (caused by a local patch
applied on our runbot), we now have dockerized builds working.

I don't have enabled docker builds on all repositories for now, so you
only get dockerized builds for:

* rma
* server-tools
* web
* website
* account-financial-tools

Please report any issue experienced on runbot builds on these projects.

If everything seems fine, I'll do a real smoke test over a week end:
reboot the servers to ensure that no builds are up, configure docker on
all repositories and trigger a rebuild of all 8.0, 9.0 and 10.0
branches. Then I'll burn a candle in the nearby church and hope for the
best...

Still on my todo list: set up a weekly cron to run docker-gc.

-- 
Alexandre Fayolle
Chef de Projet
Tel : +33 4 58 48 20 30

Camptocamp France SAS
Savoie Technolac, BP 352
73377 Le Bourget du Lac Cedex
http://www.camptocamp.com

_______________________________________________
Mailing-List: http://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: http://odoo-community.org/groups?unsubscribe

_______________________________________________
Mailing-List: http://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: http://odoo-community.org/groups?unsubscribe

--
Moisés López Calderón
Vauxoo - OpenERP's Gold Partner
Mobile: (+521) 477-752-22-30
Office: (+52) 477-773-33-46
web: http://www.vauxoo.com
twitter: @vauxoo
           @moylop260           

_______________________________________________
Mailing-List: http://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: http://odoo-community.org/groups?unsubscribe

_______________________________________________
Mailing-List: http://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: http://odoo-community.org/groups?unsubscribe

--
Anybox
Pierre Verkest
06 51 35 50 50
Github: petrus-v - Twitter: petrusv84

_______________________________________________

_______________________________________________
Mailing-List: http://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: http://odoo-community.org/groups?unsubscribe

_______________________________________________
Mailing-List: http://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: http://odoo-community.org/groups?unsubscribe

_______________________________________________
Mailing-List: http://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: http://odoo-community.org/groups?unsubscribe




--
Moisés López Calderón
Vauxoo - OpenERP's Gold Partner
Mobile: (+521) 477-752-22-30
Office: (+52) 477-773-33-46
web: http://www.vauxoo.com
twitter: @vauxoo
           @moylop260