Accounting mailing list archives

accounting@odoo-community.org

Avatar

Re: Performance / Error / timeout ? issue in general ledger report (module account_financial_report_webkit)

by
6it, Jean-Marc Dupont
- 14/10/2016 15:29:23
With pleasure ;-)


Jean-Marc DUPONT 

Agence Web, e-Commerce et Systèmes d'entreprise 

68, rue du Refuge - 84200 Carpentras

T. 06.24.91.02.03  -  04 84 25 17 94

Éditeur de la marque Provenc.io

1° marque e-Commerce 100% Provence





2016-10-14 15:23 GMT+02:00 Carlos Liébana <carlos.liebana@factorlibre.com>:
We're going to make your day because we've just ported to v8 (and improved) some specific modules we developped in v7 for a customer, that calculates all this financial webkit reports in background. They have around 2 M account entries, I think on Monday we will make the PR to OCA. In exchange, you'll be our official reviewer. ;)

2016-10-14 15:07 GMT+02:00 Jean-Marc Dupont <jmd@6it.fr>:
Hi,

Any idea ??




2016-10-12 16:26 GMT+02:00 Jean-Marc Dupont <jmd@6it.fr>:
Sorry, I will mention the version next time
So is there a solution for v8 ?
Should we follow the solution given by Odoo support (Denis Ledoux) : to modify the view, by cutting the HTML table into parts of 500 lines



Jean-Marc DUPONT 

Agence Web, e-Commerce et Systèmes d'entreprise 

68, rue du Refuge - 84200 Carpentras

T. 06.24.91.02.03  -  04 84 25 17 94

Éditeur de la marque Provenc.io

1° marque e-Commerce 100% Provence





2016-10-12 16:08 GMT+02:00 Alexandre Fayolle <alexandre.fayolle@camptocamp.com>:
Sorry my bad, I thought you were running odoo 9, when you are on odoo 8, it seems. Sorry for not reading the stack trace with enough attention. Still it's a good idea to clearly mention the version of Odoo you're using. :-) Alexandre On 10/10/2016 16:22, Jean-Marc Dupont wrote: > OK > > But what is the link between account_financial_report_qweb (which is not > installed on my client instance) and account_financial_report_webkit > module (in which we have the problem) ? > > > should we install account_financial_report_qweb instead of > account_financial_report_webkit ? > > > > 2016-10-10 16:07 GMT+02:00 Alexandre Fayolle > <alexandre.fayolle@camptocamp.com > <mailto:alexandre.fayolle@camptocamp.com>>: > > Hi Jean-Marc, > > We've been successfully generating reports in xslx for one of our > customer, involving ~5 million account.move.lines. This takes a few > minutes with the optimisations made by Julien Coux a few weeks ago. Be > sure to get these optimisations on your instance > (https://github.com/OCA/account-financial-reporting/commit/13d43100ee38e572900b7d0d63cee28912c403e0 > ) > > > The traceback suggests that you are hitting some of the limits > configured on the workers on your instance (wkhtmltopdf receives a > SIGKILL signal, hence the -9 error code reported). Try raising these. > > Alexandre > > On 10/10/2016 15:08, Jean-Marc Dupont wrote: > > Yes, but we also have the error > > > > Sometimes, the Excel version succeeds and the PDF version fails, > > depending on number of months asked, but they both failed with 8 months > > or more as time filter > > They both succeed with 6 months or less > > > > > > Odoo support (Denis Ledoux) suggested me to modify the view, by cutting > > the HTML table into parts of 500 lines > > > > > > That's what they did on the official report_generalledger view > > > > > > > > > > 2016-10-10 11:22 GMT+02:00 Alexandre Fayolle > > <alexandre.fayolle@camptocamp.com > <mailto:alexandre.fayolle@camptocamp.com> > > <mailto:alexandre.fayolle@camptocamp.com > <mailto:alexandre.fayolle@camptocamp.com
>>>: > > > > Did you try generating the GL as a spreadsheet? > > > > Alexandre > > > > On 02/10/2016 17:53, Jean-Marc Dupont wrote: > > > Hello everybody, > > > > > > We encounter a performance / timeout issue when generating general > > > ledger report > > > For 6 months : 8.000 invoices, 20.000 account moves et 100.000 account > > > move lines > > > After 5 to 10 minutes, there is an error : > > > > > > 2016-09-30 13:27:11,872 25522 ERROR o80_odoo openerp.service.report: > > > Exception: ('Webkit error', "The command 'wkhtmltopdf' failed with > > > error code = -9. Message: No diagnosis > > > message was provided") > > > Traceback (most recent call last): > > > File "/home/it-traceurdirect/aoe-80/base/openerp/service/report.py", > > > line 93, in go > > > result, format = openerp.report.render_report(cr, uid, ids, object, > > > datas, context) > > > File "/home/it-traceurdirect/aoe-80/base/openerp/report/__init__.py", > > > line 40, in render_report > > > return registry['ir.actions.report.xml'].render_report(cr, uid, ids, > > > name, data, context) > > > File "/home/it-traceurdirect/aoe-80/base/openerp/api.py", line 268, in > > > wrapper > > > return old_api(self, *args, **kwargs) > > > File > > > "/home/it-traceurdirect/aoe-80/base/openerp/addons/base/ir/ir_actions.py", > > > line 156, in render_report > > > return new_report.create(cr, uid, res_ids, data, context) > > > File > > > "/home/it-traceurdirect/aoe-80/base/addons/report_webkit/webkit_report.py", > > > line 377, in create > > > result = self.create_source_pdf(cursor, uid, ids, data, report_xml, > > > context) > > > File > > > "/home/it-traceurdirect/aoe-80/base/openerp/report/report_sxw.py", line > > > 462, in create_source_pdf > > > return self.create_single_pdf(cr, uid, ids, data, report_xml, context) > > > File > > > "/home/it-traceurdirect/aoe-80/addons-partners/account_financial_report_webkit/report/webkit_parser_header_fix.py", > > > line 277, in create_single_pdf > > > parser_instance=parser_instance) > > > File > > > "/home/it-traceurdirect/aoe-80/addons-partners/account_financial_report_webkit/report/webkit_parser_header_fix.py", > > > line 169, in generate_pdf > > > (status, error_message)) > > > except_orm: ('Webkit error', "The command 'wkhtmltopdf' failed with > > > error code = -9. Message: No diagnosis > > > message was provided") > > > 2016-09-30 13:27:12,023 25522 ERROR o80_odoo > > > openerp.addons.web.controllers.main: An exception occured during an http > > > request > > > Traceback (most recent call last): > > > File > > > "/home/it-traceurdirect/aoe-80/base/addons/web/controllers/main.py", > > > line 70, in wrap > > > return f(*args, **kwargs) > > > File > > > "/home/it-traceurdirect/aoe-80/base/addons/web/controllers/main.py", > > > line 1575, in index > > > request.session.db, request.session.uid, request.session.password, > > > report_id) > > > File "/home/it-traceurdirect/aoe-80/base/openerp/http.py", line 881, > > > in proxy_method > > > result = dispatch_rpc(self.service_name, method, args) > > > File "/home/it-traceurdirect/aoe-80/base/openerp/http.py", line 115, > > > in dispatch_rpc > > > result = dispatch(method, params) > > > File "/home/it-traceurdirect/aoe-80/base/openerp/service/report.py", > > > line 34, in dispatch > > > res = fn(db, uid, *params) > > > File "/home/it-traceurdirect/aoe-80/base/openerp/service/report.py", > > > line 141, in exp_report_get > > > return _check_report(report_id) > > > File "/home/it-traceurdirect/aoe-80/base/openerp/service/report.py", > > > line 119, in _check_report > > > raise openerp.osv.orm.except_orm(exc.message, exc.traceback) > > > except_orm: (u'Webkit error', u"The command 'wkhtmltopdf' failed with > > > error code = -9. Message: No diagnosis > > > message was provided") > > > > > > > > > HTML file is generated in /tmp directory, and wkhtmltopdf process is > > > running on the server after we accept error message in Odoo, but it's > > > too late, no PDF file is generated > > > > > > Server parameters :: > > > > > > limit_memory_hard = 2684354560 > > > > > > limit_memory_soft = 2147483648 > > > > > > limit_request = 8192 > > > > > > limit_time_cpu = 1200 > > > > > > limit_time_real = 2700 > > > > > > > > > Can anybody help us ? > > > > > > Thanks in advance > > > > > > > > > * > > > * > > > > > > *Jean-Marc DUPONT * > > > > > > *Agence Web, e-Commerce et Systèmes d'entreprise * > > > > > > 68, rue du Refuge - 84200 Carpentras > > > > > > T. 06.24.91.02.03 - 04 84 25 17 94 > > > > > > Éditeur de la marque *Provenc.io * > > > > > > 1° marque e-Commerce 100% Provence > > > > > > > > > > > > > > > _______________________________________________ > > > Mailing-List: http://odoo-community.org/groups/accounting-28
> > > > > > Post to: mailto:accounting@odoo-community.org <mailto:accounting@odoo-community.org> > > > Unsubscribe: http://odoo-community.org/groups?unsubscribe > > > > > > > > -- > Alexandre Fayolle > Chef de Projet > Tel : +33 4 58 > 48 20 30 > > Camptocamp France SAS > > Savoie Technolac, BP 352 > 73377 Le Bourget du Lac Cedex > > http://www.camptocamp.com > > > _______________________________________________ > Mailing-List: > http://odoo-community.org/groups/accounting-28 > > > Post to: > mailto:accounting@odoo-community.org > <mailto:accounting@odoo-community.org> > > <mailto:accounting@odoo-community.org > <mailto:accounting@odoo-community.org>> > Unsubscribe: > http://odoo-community.org/groups?unsubscribe > > > > > > _______________________________________________ > Mailing-List: > http://odoo-community.org/groups/accounting-28 > > Post to: > mailto:accounting@odoo-community.org > <mailto:accounting@odoo-community.org> > Unsubscribe: > http://odoo-community.org/groups?unsubscribe > > -- Alexandre > Fayolle Chef de Projet Tel : +33 4 58 48 20 30 30> Camptocamp France SAS Savoie Technolac, BP 352 73377 Le Bourget > du Lac Cedex http://www.camptocamp.com > > _______________________________________________ > Mailing-List: http://odoo-community.org/groups/accounting-28 > > Post to: mailto:accounting@odoo-community.org > <mailto:accounting@odoo-community.org> > Unsubscribe: http://odoo-community.org/groups?unsubscribe > > > > _______________________________________________ > Mailing-List: http://odoo-community.org/groups/accounting-28 > Post to: mailto:accounting@odoo-community.org > Unsubscribe: http://odoo-community.org/groups?unsubscribe > -- Alexandre Fayolle Chef de Projet Tel : +33 4 58 48 20 30 Camptocamp France SAS Savoie Technolac, BP 352 73377 Le Bourget du Lac Cedex http://www.camptocamp.com

_______________________________________________
Mailing-List: http://odoo-community.org/groups/accounting-28
Post to: mailto:accounting@odoo-community.org
Unsubscribe: http://odoo-community.org/groups?unsubscribe



_______________________________________________
Mailing-List: http://odoo-community.org/groups/accounting-28
Post to: mailto:accounting@odoo-community.org
Unsubscribe: http://odoo-community.org/groups?unsubscribe




--
--------------------------

CARLOS LIÉBANA ANERO
Director | factorlibre.com
+34 635 86 67 92
@carlosliebana

_______________________________________________
Mailing-List: http://odoo-community.org/groups/accounting-28
Post to: mailto:accounting@odoo-community.org
Unsubscribe: http://odoo-community.org/groups?unsubscribe


Reference