Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

monetdbd crash while creating & loading database #3135

Closed
monetdb-team opened this issue Nov 30, 2020 · 0 comments
Closed

monetdbd crash while creating & loading database #3135

monetdb-team opened this issue Nov 30, 2020 · 0 comments
Labels
bug Something isn't working high priority major Server Tools
Milestone
Ancient Release

Comments

@monetdb-team
Copy link

Date: 2012-08-01 12:21:34 +0200
From: info
To: Merovingian devs <>
Version: 11.11.5 (Jul2012)

Last updated: 2012-08-23 10:14:39 +0200

Comment 17588

Date: 2012-08-01 12:21:34 +0200
From: info

User-Agent: Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:14.0) Gecko/20100101 Firefox/14.0.1
Build Identifier:

While creating & loading a database through a bash script monetdbd crashes, and the loading action freezes.

note: There are 2 different versions of monetdbd running within the network (april-2011 and jul-2012), the april-2011 version doesn't have these crashes, the jul-2012 version does not crash until we create & load a database on that version.

OS used: Ubuntu 10.04.2. 64 bits

The bash script:

monetdb stop testns
monetdb destroy -f testns
monetdb create testns
monetdb release testns
monetdb start testns

mclient -dtestns -s'CREATE TABLE "sys"."data" (
	"col1"     CHAR(32)      DEFAULT NULL,
	"col2"      CHAR(32)      DEFAULT NULL,
	"col3"      TIMESTAMP     DEFAULT NULL,
	"col4"            CHAR(1)       DEFAULT NULL,
	"col5"   INTEGER       DEFAULT NULL,
	"col6"  INTEGER       DEFAULT NULL,
	"col7"  INTEGER       DEFAULT NULL,
	"col8" INTEGER       DEFAULT NULL,
	"col9"       CHAR(32)      DEFAULT NULL
);'

mclient -dtestns -s"COPY 1242000 OFFSET 1 RECORDS INTO data FROM '/data/testdata/loadfile.csv' USING DELIMITERS '|','\n','\"' NULL AS '' locked;"
mclient -dtestns -s"COPY 1242000 OFFSET 1 RECORDS INTO data FROM '/data/testdata/loadfile.csv' USING DELIMITERS '|','\n','\"' NULL AS '' locked;"
mclient -dtestns -s"COPY 1242000 OFFSET 1 RECORDS INTO data FROM '/data/testdata/loadfile.csv' USING DELIMITERS '|','\n','\"' NULL AS '' locked;"
mclient -dtestns -s"COPY 1242000 OFFSET 1 RECORDS INTO data FROM '/data/testdata/loadfile.csv' USING DELIMITERS '|','\n','\"' NULL AS '' locked;"
mclient -dtestns -s"COPY 1242000 OFFSET 1 RECORDS INTO data FROM '/data/testdata/loadfile.csv' USING DELIMITERS '|','\n','\"' NULL AS '' locked;"
mclient -dtestns -s"COPY 1242000 OFFSET 1 RECORDS INTO data FROM '/data/testdata/loadfile.csv' USING DELIMITERS '|','\n','\"' NULL AS '' locked;"

Reproducible: Always

Steps to Reproduce:

see script in details.

Actual Results:

see attached merovingian.log

Merovingian log:

2012-08-01 11:01:09 MSG merovingian[11107]: Merovingian 1.6 (Jul2012) starting
2012-08-01 11:01:09 MSG merovingian[11107]: monitoring dbfarm /monetdb/dbfarm
2012-08-01 11:01:14 MSG merovingian[11107]: accepting connections on TCP socket 0.0.0.0:50000
2012-08-01 11:01:14 MSG merovingian[11107]: accepting connections on UNIX domain socket /tmp/.s.monetdb.50000
2012-08-01 11:01:19 MSG discovery[11107]: listening for UDP messages on 0.0.0.0:50000
2012-08-01 11:01:19 MSG control[11107]: accepting connections on UNIX domain socket /tmp/.s.merovingian.50000
2012-08-01 11:01:19 MSG discovery[11107]: received leave request for unknown database mapi:monetdb://PP-001A:50000/S001A_20120801 from PP-001A
2012-08-01 11:01:19 MSG discovery[11107]: new database mapi:monetdb://PP-001A:50000/S001A_20120801/S001/1/status1 (ttl=660s)
2012-08-01 11:01:19 MSG discovery[11107]: received leave request for unknown database mapi:monetdb://PP-001A:50000/S001A_20120731 from PP-001A
2012-08-01 11:01:19 MSG discovery[11107]: new database mapi:monetdb://PP-001A:50000/S001A_20120731/S001/2/status1 (ttl=660s)
2012-08-01 11:01:19 MSG discovery[11107]: received leave request for unknown database mapi:monetdb://PP-001A:50000/S001A_20120730 from PP-001A
2012-08-01 11:01:19 MSG discovery[11107]: new database mapi:monetdb://PP-001A:50000/S001A_20120730/S001/3/status1 (ttl=660s)
2012-08-01 11:01:19 MSG discovery[11107]: new neighbour PP-002A (PP-002A)
2012-08-01 11:01:20 MSG discovery[11107]: new database mapi:monetdb://PP-002A:50000/testns (ttl=660s)
2012-08-01 11:01:20 MSG discovery[11107]: new database mapi:monetdb://PP-100A:50000/MF_100A0 (ttl=660s)
2012-08-01 11:01:20 MSG discovery[11107]: registered neighbour PP-100A:50001
2012-08-01 11:01:20 MSG discovery[11107]: received leave request for unknown database mapi:monetdb://PP-001B:50000/S001B_20120801 from PP-001B
2012-08-01 11:01:20 MSG discovery[11107]: new database mapi:monetdb://PP-001B:50000/S001B_20120801/S001/1/status2 (ttl=660s)
2012-08-01 11:01:20 MSG discovery[11107]: received leave request for unknown database mapi:monetdb://PP-001B:50000/S001B_20120731 from PP-001B
2012-08-01 11:01:20 MSG discovery[11107]: new database mapi:monetdb://PP-001B:50000/S001B_20120731/S001/2/status2 (ttl=660s)
2012-08-01 11:01:20 MSG discovery[11107]: received leave request for unknown database mapi:monetdb://PP-001B:50000/S001B_20120730 from PP-001B
2012-08-01 11:01:20 MSG discovery[11107]: new database mapi:monetdb://PP-001B:50000/S001B_20120730/S001/3/status2 (ttl=660s)
2012-08-01 11:01:21 MSG discovery[11107]: registered neighbour PP-001A:50001
2012-08-01 11:01:21 MSG discovery[11107]: registered neighbour PP-001B:50001
2012-08-01 11:01:27 MSG control[11107]: (local): served status list
2012-08-01 11:01:30 MSG control[11107]: (local): served status list
2012-08-01 11:01:30 ERR control[11107]: (local): received stop signal for non running database: testns
2012-08-01 11:01:30 MSG control[11107]: (local): served status list
2012-08-01 11:01:30 MSG discovery[11107]: removed neighbour database mapi:monetdb://PP-002A:50000/testns
2012-08-01 11:01:30 MSG control[11107]: (local): destroyed database 'testns'
2012-08-01 11:01:30 MSG control[11107]: (local): created database 'testns'
2012-08-01 11:01:30 MSG control[11107]: (local): served status list
2012-08-01 11:01:30 MSG control[11107]: (local): released database 'testns'
2012-08-01 11:01:30 MSG discovery[11107]: new database mapi:monetdb://PP-002A:50000/testns (ttl=660s)
2012-08-01 11:01:30 MSG control[11107]: (local): served status list
2012-08-01 11:01:30 MSG merovingian[11107]: starting database 'testns', up min/avg/max: 0s/0s/0s, crash average: 0.00 0.00 0.00 (0-0=0)
2012-08-01 11:01:30 MSG testns[11119]: arguments: /data/programs/MonetDB/bin/mserver5 --set gdk_dbfarm=/monetdb/dbfarm --dbname=testns --set merovingian_uri=mapi:monetdb://PP-002A:50000/testns --set mapi_open=false --set mapi_port=0 --set mapi_usock=/monetdb/dbfarm/testns/.mapi.sock --set monet_vault_key=/monetdb/dbfarm/testns/.vaultkey --set gdk_nr_threads=2 --set max_clients=64 --set sql_optimizer=default_pipe --set monet_daemon=yes
2012-08-01 11:01:30 MSG testns[11119]: MonetDB 5 server v11.11.5 "Jul2012"
2012-08-01 11:01:30 MSG testns[11119]: Serving database 'testns', using 2 threads
2012-08-01 11:01:30 MSG testns[11119]: Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked
2012-08-01 11:01:30 MSG testns[11119]: Found 23.583 GiB available main-memory.
2012-08-01 11:01:30 MSG testns[11119]: Copyright (c) 1993-July 2008 CWI.
2012-08-01 11:01:30 MSG testns[11119]: Copyright (c) August 2008-2012 MonetDB B.V., all rights reserved
2012-08-01 11:01:30 MSG testns[11119]: Visit http://www.monetdb.org/ for further information
2012-08-01 11:01:30 MSG testns[11119]: Listening for UNIX domain connection requests on mapi:monetdb:///monetdb/dbfarm/testns/.mapi.sock
2012-08-01 11:01:30 MSG testns[11119]: MonetDB/JAQL module loaded
2012-08-01 11:01:30 MSG testns[11119]: MonetDB/SQL module loaded
2012-08-01 11:01:31 MSG discovery[11107]: removed neighbour database mapi:monetdb://PP-001B:50000/S001B_20120801/S001/1/status2
2012-08-01 11:01:31 MSG discovery[11107]: new database mapi:monetdb://PP-001B:50000/S001B_20120801/S001/1/query (ttl=660s)
2012-08-01 11:01:31 MSG discovery[11107]: removed neighbour database mapi:monetdb://PP-001B:50000/S001B_20120731/S001/2/status2
2012-08-01 11:01:31 MSG discovery[11107]: new database mapi:monetdb://PP-001B:50000/S001B_20120731/S001/2/query (ttl=660s)
2012-08-01 11:01:31 MSG discovery[11107]: removed neighbour database mapi:monetdb://PP-001B:50000/S001B_20120730/S001/3/status2
2012-08-01 11:01:31 MSG discovery[11107]: new database mapi:monetdb://PP-001B:50000/S001B_20120730/S001/3/query (ttl=660s)
2012-08-01 11:01:31 MSG control[11107]: (local): started 'testns'
2012-08-01 11:01:31 MSG merovingian[11107]: proxying client (local) for database 'testns' to mapi:monetdb:///monetdb/dbfarm/testns/.mapi.sock?database=testns
2012-08-01 11:01:31 MSG merovingian[11107]: target connection is on local UNIX domain socket, passing on filedescriptor instead of proxying
2012-08-01 11:01:31 MSG merovingian[11107]: proxying client (local) for database 'testns' to mapi:monetdb:///monetdb/dbfarm/testns/.mapi.sock?database=testns
2012-08-01 11:01:31 MSG merovingian[11107]: target connection is on local UNIX domain socket, passing on filedescriptor instead of proxying
2012-08-01 11:01:31 MSG testns[11119]: SQL catalog created, loading sql scripts once
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 09_like.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 10_math.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 11_times.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 12_url.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 13_date.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 14_inet.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 15_history.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 16_tracelog.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 17_compress.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 18_dictionary.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 19_cluster.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 20_vacuum.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 21_dependency_functions.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 22_clients.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 23_skyserver.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 24_zorder.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 25_debug.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 39_analytics.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 80_udf.sql
2012-08-01 11:01:31 MSG testns[11119]: loading sql script: 99_system.sql
2012-08-01 11:01:31 MSG merovingian[11107]: proxying client (local) for database 'testns' to mapi:monetdb:///monetdb/dbfarm/testns/.mapi.sock?database=testns
2012-08-01 11:01:31 MSG merovingian[11107]: target connection is on local UNIX domain socket, passing on filedescriptor instead of proxying
2012-08-01 11:01:31 MSG merovingian[11107]: proxying client (local) for database 'testns' to mapi:monetdb:///monetdb/dbfarm/testns/.mapi.sock?database=testns
2012-08-01 11:01:31 MSG merovingian[11107]: target connection is on local UNIX domain socket, passing on filedescriptor instead of proxying

SEGMENTATION FAULT OCCURRED

a fatal error has occurred which prevents monetdbd from operating.
This is likely a bug in monetdbd, please report it on http://bugs.monetdb.org/
and include the tail of this log in your bugreport with your explanation of
what you were doing, if possible.

ABORTING NOW, YOU HAVE TO MANUALLY KILL ALL REMAINING mserver5 PROCESSES
2012-08-01 11:01:31 MSG discovery[11107]: removed neighbour database mapi:monetdb://PP-001A:50000/S001A_20120801/S001/1/status1

Comment 17593

Date: 2012-08-01 15:43:53 +0200
From: @grobian

not good, hope I can reproduce this

Comment 17597

Date: 2012-08-02 10:09:24 +0200
From: @grobian

Changeset 06126c783aaf made by Fabian Groffen fabian@cwi.nl in the MonetDB repo, refers to this bug.

For complete details, see http//devmonetdborg/hg/MonetDB?cmd=changeset;node=06126c783aaf

Changeset description:

removeRemoteDB: fix crash when removing the only db in the list

linked lists can be hard sometimes :(

Fix crash observed in bug #3135.  The first (and only) database in the
remote list was removed and lead to a segfault due to a logic error.

Comment 17598

Date: 2012-08-02 10:12:23 +0200
From: @grobian

I believe this is fixed now, but I'd love when you could try this patch (or current Jul2012 branch head) to see if this fixes the issue completely for you.

Comment 17599

Date: 2012-08-02 11:27:36 +0200
From: info

(In reply to comment 3)

I believe this is fixed now, but I'd love when you could try this patch (or
current Jul2012 branch head) to see if this fixes the issue completely for you.

I applied the patch in the juli2012 release, the crash doesn't occur anymore. Thnx!

Comment 17640

Date: 2012-08-23 10:14:39 +0200
From: @sjoerdmullender

Jul2012-SP1 has been released.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working high priority major Server Tools
Projects
None yet
Milestone
Ancient Release
Development

No branches or pull requests
2 participants
@sjoerdmullender @monetdb-team