Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MonetDB produces malformed LZ4 files #6877

Closed
monetdb-team opened this issue Nov 30, 2020 · 0 comments
Closed

MonetDB produces malformed LZ4 files #6877

monetdb-team opened this issue Nov 30, 2020 · 0 comments
Labels
bug Something isn't working normal SQL

Comments

@monetdb-team
Copy link

Date: 2020-06-04 11:36:30 +0200
From: @joerivanruth
To: SQL devs <>
Version: 11.37.7 (Jun2020)

Last updated: 2020-07-27 09:30:12 +0200

Comment 27792

Date: 2020-06-04 11:36:30 +0200
From: @joerivanruth

User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:77.0) Gecko/20100101 Firefox/77.0
Build Identifier:

The files are not properly terminated with an end marker.

Reproducible: Always

Steps to Reproduce:

$ mclient -d foo -s "call sys.hot_snapshot(r'/tmp/demo1.tar.lz4')"
$ lz4 -d </tmp/demo1.tar.lz4 | wc -c
Error 68 : Unfinished stream
3961856

$ mclient -d foo
Welcome to mclient, the MonetDB/SQL interactive terminal (Jun2020)
Database: MonetDB v11.37.7 (Jun2020), 'mapi:monetdb://hank:50000/foo'
FOLLOW US on https://twitter.com/MonetDB or https://github.com/MonetDB/MonetDB
Type \q to quit, ? for a list of available commands
auto commit mode: on
sql>CREATE TABLE foo(i INTEGER);
operation successful
sql>INSERT INTO foo SELECT * FROM sys.generate_series(0,1000);
1000 affected rows
sql>COPY SELECT * FROM foo INTO '/tmp/demo2.tar.lz4' ON CLIENT;
1000 affected rows
sql>
$ lz4 -d </tmp/demo2.tar.lz4 | wc -c
Error 68 : Unfinished stream
3890

Actual Results:

Error 68 : Unfinished stream

Expected Results:

No errors

@monetdb-team monetdb-team added bug Something isn't working normal SQL labels Nov 30, 2020
@sjoerdmullender sjoerdmullender added this to the Ancient Release milestone Feb 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working normal SQL
Projects
None yet
Development

No branches or pull requests

2 participants