Date: 2012-01-09 07:09:19 +0100
From: james.laign
To: SQL devs <>
Version: -- development
CC: @mlkersten, @njnes

Last updated: 2012-03-16 14:56:52 +0100

Comment 16758

Date: 2012-01-09 07:09:19 +0100
From: james.laign

User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:9.0.1) Gecko/20100101 Firefox/9.0.1
Build Identifier: 11.5.9

mserver5 slowly consumes memory when processing queries.

Reproducible: Always

Steps to Reproduce:

1. Send lots of queries

Actual Results:

Memory usage grows approx 20MB per 2000 queries.

I compiled MonetDB from the 11.5.9 sources, using:
./configure --enable-debug=yes --enable-optimize=no
--enable-testing=yes --enable-developer=yes --enable-valgrind=yes

uname -a outputs:
Linux 3.0-ARCH 1 SMP PREEMPT Wed Aug 17 21:55:57 CEST 2011 x86_64
Intel(R) Core(TM)2 CPU 6700 @ 2.66GHz GenuineIntel GNU/Linux

Comment 16759

Date: 2012-01-09 07:11:17 +0100
From: james.laign

Created attachment 95
valgrind log

How i produced the log file:

1. starting mserver5 with the command:
   valgrind --log-file=valgrind_mserver.log --show-possibly-lost=no --leak-check=full --tool=memcheck /usr/local/bin/mserver5 --dbname=test_db --dbfarm=/mnt/160a/ --dbinit="include sql;" --set mapi_open=true --daemon=yes

2. running the attached python script, it does the following:
   a) Creates a new table 'test_tbl' with 4 int columns.
   b) Generates 1000 rows, and loads them with COPY INTO...
   c) sends 2000 simple SELECT queries with mclient.

3. stopping valgrind.

Attached file: valgrind_mserver.log (application/octet-stream, 13906 bytes)
Description: valgrind log

Comment 16760

Date: 2012-01-09 07:12:52 +0100
From: james.laign

Created attachment 96
python script used to generate data and send queries.

Attached file: test_monetdb.py (text/x-python, 992 bytes)
Description: python script used to generate data and send queries.

Comment 16761

Date: 2012-01-09 08:06:52 +0100
From: @mlkersten

Dear James,

Thank you for the report and test script. We will look into it a.s.a.p.

Comment 17011

Date: 2012-02-27 19:34:25 +0100
From: @njnes

leaks have been fixed

Comment 17095

Date: 2012-03-16 14:56:52 +0100
From: @grobian

Released in Dec2011-SP2