Melodeon.net Forums

Please login or register.

Login with username, password and session length
Advanced search  

News:

Welcome to the new melodeon.net forum

Pages: [1] 2   Go Down

Author Topic: mscz/abc hybrid  (Read 5008 times)

0 Members and 1 Guest are viewing this topic.

Mike Hirst

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 1433
  • Black Dot B/C, Bastardo C#/D, Corona II GCF
mscz/abc hybrid
« on: June 18, 2015, 11:45:01 AM »

I wasn't sure where to put this. It's not strictly speaking an ABC thread, but it does continue recent discussion concerning file formats.

Further to my posting concerning musical representation:

http://forum.melodeon.net/index.php/topic,17056.msg209128.html#msg209128

I have been experimenting with the newly adopted mscz format.

I little poking around revealed both mscz and mxl to be container files, something like a zip folder. I did try making my own using 7zip, but it didn't quite work. However I did have success opening the containers and adding extra files.

The attached mscz file contains the expected MuseScore data, to which I have added an ABC file and an OGG audio file.

MuseScore is able to open the file without error. The additional files can be extracted using 7zip, or whatever archive manager you have available on your chosen platform.

Testing the archive integrity using 7zip gives this output:

Code: [Select]
7-Zip [64] 9.20  Copyright (c) 1999-2010 Igor Pavlov  2010-11-18
p7zip Version 9.20 (locale=en_GB.UTF-8,Utf16=on,HugeFiles=on,2 CPUs)

Processing archive: /home/mikehirst/Desktop/C_Scale.mscz

Testing     C_Scale.abc
Testing     C_Scale.mscx
Testing     C_Scale.ogg
Testing     META-INF/container.xml

Everything is Ok

Files: 4
Size:       80608
Compressed: 63139

I will be the first to admit that this is dangerously close to falling over the edge of allowable forum topics, but I'm putting it out there as an idea others may find useful.
« Last Edit: June 18, 2015, 12:27:03 PM by Mike Hirst »
Logged
Semper idem, sed non eodem modo

Chris Brimley

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 2038
File Size Comparisons for attachments and communal data
« Reply #1 on: June 18, 2015, 12:05:07 PM »

I was just about to add something to Mike Hurst's post under the 'adding ABC format' thread, comparing file sizes in different formats, but Theo beat me to it by adding the .abc format, and closing the thread.  I wanted to add something to the file size comparisons discussion, which is probably more general anyway, so I've started this new thread, to continue the opportunity to discuss.

By coincidence, I was doing the same exercise as Mike, using 'Le Coucou' as an example - Creating a score from the ABC text in MuseScore, saving as MusicXML, and then converting back using Howard's EasyABC link. My results have I think replicated yours, Mike, but also brought in a few new brain-scratchers.   For this transcription, as far as I could tell visually none of the formats lost detail, but that doesn't appear to be the end of the story.

These were my results:

Original abc file:   ?KB (can't find that figure, but believed small)
pdf file:  27.2KB
.mscz:   46.1KB
.xml:    309KB
.abc:    309KB
.mxl:     11.3KB
.mscz resaved file:  46.8KB

A few new interesting things emerged from this, for me:

1.   .mxl, the compressed version of .xml, is considerably more efficient, and beats most of the other formats.  This supports Anahata's explanation - my thought that it might be additional detail that's not being transferred is not borne out.
2.   EasyABC seems to save in an uncompressed format, like .xml, and the saved form of the data is quite big.  Is this perhaps because both contain information about bar lines and clefs, etc, which the compressed forms are taking as read, as they are relying on the platform's definitions for these things?
3.   I think that we do have a way forward that should take most of the past disagreements away:  It looks to me as if MuseScore users such as myself can now save our output to .abc, (although it might be larger), as well as .mscz, which will allow the majority of ABC users on this forum to read it.  The only proviso with this is that it may still prove to be the case that there are features that won't transfer easily - maybe some of the presentational text management stuff - but it's a very good start.

I'm not quite clear whether there are other implications of this, as far as melnet is concerned.  I suppose one question that emerges is this - would .mxl have the same security issues as .xml?  If not, it might still have a lot of benefits here after all as a standard platform notwithstanding that it is apparently rather less widely adopted by 'scorewriting' applications than .xml.


« Last Edit: June 18, 2015, 12:08:07 PM by Chris Brimley »
Logged

Chris Brimley

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 2038
Re: mscz/abc hybrid
« Reply #2 on: June 18, 2015, 12:13:58 PM »

Mike, it looks as if we need to merge these two threads somehow?
Logged

Mike Hirst

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 1433
  • Black Dot B/C, Bastardo C#/D, Corona II GCF
Re: File Size Comparisons for attachments and communal data
« Reply #3 on: June 18, 2015, 12:16:58 PM »

1.   .mxl, the compressed version of .xml, is considerably more efficient, and beats most of the other formats.  This supports Anahata's explanation - my thought that it might be additional detail that's not being transferred is not borne out.

mxl is in effect a zip folder containing the musicXML source, the same is true of mscz, with the exception that this contains the mscx source.

We seem to be crossing posts here. I've been playing around with the compressed files and have managed to include abc alongside mscx and musicXML content. The results of these experiments are posted here:

http://forum.melodeon.net/index.php/topic,17060.msg209134.html#msg209134

As I have said in that post, I'm probably in danger of going of topic here, but if your interested PM me and we can continue the conversation.
Logged
Semper idem, sed non eodem modo

Jack Campin

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 764
    • Jack Campin's Home Page
Re: mscz/abc hybrid
« Reply #4 on: June 18, 2015, 12:35:03 PM »

That makes .mscz rather dangerous - if you can put anything in such a file that you can get in a zip file, you can do the same malware packaging (which is why most forums don't let you upload zip files).
Logged
http://www.campin.me.uk/

I can't figure out how to quit but I will no longer check this group and have deleted all shortcuts to it.

Mike Hirst

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 1433
  • Black Dot B/C, Bastardo C#/D, Corona II GCF
Re: mscz/abc hybrid
« Reply #5 on: June 18, 2015, 12:47:15 PM »

That makes .mscz rather dangerous - if you can put anything in such a file that you can get in a zip file, you can do the same malware packaging (which is why most forums don't let you upload zip files).
agreed - the same is true of pdf
« Last Edit: June 18, 2015, 12:50:12 PM by Mike Hirst »
Logged
Semper idem, sed non eodem modo

Theo

  • Administrator
  • Hero Member
  • *****
  • Offline Offline
  • Posts: 14475
  • Hohner Club Too
    • The Box Place
Re: mscz/abc hybrid
« Reply #6 on: June 18, 2015, 12:53:51 PM »

In that case mscz is off limits.  mscx is now allowed.
Logged
Theo Gibb - Gateshead UK

Proprietor of The Box Place for melodeon and concertina sales and service.
See my YouTube channel  for videos on repair and tuning

Chris Brimley

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 2038
Re: mscz/abc hybrid
« Reply #7 on: June 18, 2015, 01:03:26 PM »

Just as a general point, obviously I've no inside experience of internet security issues, but it must be a bit like herding invisible cats? 

Is anything completely safe?  If one looks at the risk assessments, presumably one of the crucial factors will be the extent to which a given format is used by the public, and another will be the importance of the use.  This might suggest that well-used things such as Windows and Adobe are going to get targeted much more frequently by hackers than small-scale specialist applications?
Logged

Theo

  • Administrator
  • Hero Member
  • *****
  • Offline Offline
  • Posts: 14475
  • Hohner Club Too
    • The Box Place
Re: mscz/abc hybrid
« Reply #8 on: June 18, 2015, 01:06:57 PM »

Unfortunately Chris there is a constant stream of attackers who direct their efforts towards all discussion forums.  One of our security packages consistently detects thousands of suspicious access attempts per week. 
Logged
Theo Gibb - Gateshead UK

Proprietor of The Box Place for melodeon and concertina sales and service.
See my YouTube channel  for videos on repair and tuning

Mike Hirst

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 1433
  • Black Dot B/C, Bastardo C#/D, Corona II GCF
Re: mscz/abc hybrid
« Reply #9 on: June 18, 2015, 01:39:29 PM »

I'm in agreement with Theo here. Whilst I acknowledge that mscx attachments may be of use for some forum members, it is my opinion that the current list of allowable attachments is sufficient.

I have on my shelf a copy of The Virtual Score. Although first published almost 15 years ago, this discussion of the relative merits of musical representation, remains relevant. I would recommend this as a useful starting point for further investigation.

As I have said before, I have a personal preference for the simplicity of ABC natation, but I do not disregard other methods. What is important here is the ability to move between formats.

With regard to the melnet forum, I would suggest best practice to be the inclusion of ABC in a bb code block, with attached jpg or png. The image providing a quick reference and the code allowing for transfer into other formats, including musicXML and the more restricted, but widely used, MuseScore format.

As I have shown in forum postings, it is possible to include musicXML in a bb code block, from where it can be cut and pasted, similarly ABC can be attached to a forum post by changing the file extension from .abc to .txt
« Last Edit: June 18, 2015, 01:49:44 PM by Mike Hirst »
Logged
Semper idem, sed non eodem modo

Chris Brimley

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 2038
Re: mscz/abc hybrid
« Reply #10 on: June 18, 2015, 02:30:25 PM »

Mike, that all seems entirely sensible to me, and I defer to your clear great knowledge.  It would seem to allow now the ability to move between formats, which I agree is the main issue.  Moreover it doesn't seem to require any (significant?) changes to melnet, which no doubt would be of relief to Clive and Theo!

No doubt you could advise us the details of how to do the code upload in due course, if this becomes the norm?  I have noticed that with the larger files, copying them is a little fiddly, but the additional 'vector-based' small pdfs would seem to be straightforward and already practice.
Logged

Chris Ryall

  • "doc 3-row"
  • French Interpreter
  • Hero Member
  • *****
  • Offline Offline
  • Posts: 11154
  • Wirral UK
    • Chris Ryall
Re: mscz/abc hybrid
« Reply #11 on: June 18, 2015, 09:02:19 PM »

please see my other post wrt adjusting the font size on the rarely used bb [.code ] tag display, with maybe a magnify button as per other forums.

It won't affect cut and paste as "text is text" :|glug

[ed]
Code: [Select]
gosh … already built in - even has a "select" button for easy copy/paste
« Last Edit: June 18, 2015, 09:06:40 PM by Chris Ryall »
Logged
  _       _    _      _ 

Mike Hirst

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 1433
  • Black Dot B/C, Bastardo C#/D, Corona II GCF
Re: mscz/abc hybrid
« Reply #12 on: January 23, 2020, 02:25:00 PM »

I am drawing attention to this 2015 thread in relation to this recent (Jan 2020) repeat request:

http://forum.melodeon.net/index.php/topic,24971.msg296934.html#msg296934

The above thread makes it clear that there is a potential vulnerability in allowing the .mscz container format which would enable the proliferation of hidden malware.
Logged
Semper idem, sed non eodem modo

Steve_freereeder

  • Content Manager
  • Hero Member
  • ***
  • Offline Offline
  • Posts: 7511
  • MAD is inevitable. Keep Calm and Carry On
    • Lizzie Dripping
Re: mscz/abc hybrid
« Reply #13 on: January 23, 2020, 06:18:03 PM »

I am drawing attention to this 2015 thread in relation to this recent (Jan 2020) repeat request:

http://forum.melodeon.net/index.php/topic,24971.msg296934.html#msg296934

The above thread makes it clear that there is a potential vulnerability in allowing the .mscz container format which would enable the proliferation of hidden malware.
Really? PDF files seem to be OK and allowed, so perhaps the argument for banning mscz files is rather weak.

That makes .mscz rather dangerous - if you can put anything in such a file that you can get in a zip file, you can do the same malware packaging (which is why most forums don't let you upload zip files).
agreed - the same is true of pdf

Oh dear  ::)
PDF files have been allowed on this forum for a long time and as far as I know, to no detriment.

I'm in agreement with Theo here. Whilst I acknowledge that mscx attachments may be of use for some forum members, it is my opinion that the current list of allowable attachments is sufficient..
.
.
.
As I have said before, I have a personal preference for the simplicity of ABC natation, but I do not disregard other methods. What is important here is the ability to move between formats.

Your post dates from 2015. As the use of Musescore becomes more widespread, I think there are more of us using its superb functionality. It can go hand-in-hand with ABC for those who only want to use that, but don't discount Musescore just because, in your opinion, you think it is inappropriate for the sort of music discussed on this forum.
Logged
Steve
Sheffield, UK.
www.lizziedripping.org.uk

Theo

  • Administrator
  • Hero Member
  • *****
  • Offline Offline
  • Posts: 14475
  • Hohner Club Too
    • The Box Place
Re: mscz/abc hybrid
« Reply #14 on: January 23, 2020, 06:53:31 PM »

Thank you Mike for reminding me about that.

I am very conscious of the risks of potential vulnerabilities, have got into a serious mess over one in the past and this is the reason for mscz files not being allowed last time it was discussed. So Steve, I'm sorry but I will now remove the permission for mscz files.  I don't think this should hinder the ability to share tunes, either as abc or image files.
Logged
Theo Gibb - Gateshead UK

Proprietor of The Box Place for melodeon and concertina sales and service.
See my YouTube channel  for videos on repair and tuning

Eshed

  • Respected Sage
  • ****
  • Offline Offline
  • Posts: 447
Re: mscz/abc hybrid
« Reply #15 on: January 23, 2020, 07:11:00 PM »

Since we're not connected to the forum via HTTPS, any file downloaded from this forum can be replaced with a malicious one by any person with access to any place in the line between your computer/phone and melnet.
They can also change the content of thread you're seeing and add malicious attachments to each and every post.
So mscz or not is really the least of our concerns.
Logged
Do you have a Hohner from 1934-1945 with a serial number on?
Send me a private message or comment on the German Accordion Problem spreadsheet to improve the statistics of the project and get an estimate of the production date of the box if it is not known.

Mike Hirst

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 1433
  • Black Dot B/C, Bastardo C#/D, Corona II GCF
Re: mscz/abc hybrid
« Reply #16 on: January 23, 2020, 07:12:39 PM »

Steve.

I think you are missing the point here. This is not about Musecore. For what it is worth I have been using Musescore since it's initial release in 2011.

The point that I am making is that .mscz is a container format. It is very easy to hide malware inside the innocent container, introducing a vulnerability to the forum and opening the possibility for the proliferation of corrupt files which could introduce unwanted and dangerous elements to forum users personal computers.

I am not criticising either Musescore or the .mscz format, I am highlighting the potential vulnerabilities in allowing container formats as forum attachments.
Logged
Semper idem, sed non eodem modo

Steve_freereeder

  • Content Manager
  • Hero Member
  • ***
  • Offline Offline
  • Posts: 7511
  • MAD is inevitable. Keep Calm and Carry On
    • Lizzie Dripping
Re: mscz/abc hybrid
« Reply #17 on: January 23, 2020, 08:54:49 PM »

The point that I am making is that .mscz is a container format. It is very easy to hide malware inside the innocent container, introducing a vulnerability to the forum and opening the possibility for the proliferation of corrupt files which could introduce unwanted and dangerous elements to forum users personal computers.

I am not criticising either Musescore or the .mscz format, I am highlighting the potential vulnerabilities in allowing container formats as forum attachments.
OK - I accept what you are saying, also Theo's reintroduction on the ban on .mscz files.

But if that is the case, where is the logic in allowing PDF files? Since, according to your earlier post...
That makes .mscz rather dangerous - if you can put anything in such a file that you can get in a zip file, you can do the same malware packaging (which is why most forums don't let you upload zip files).
agreed - the same is true of pdf
... PDF files could also be a potential container for malware or other undesirable stuff.

Confused of South Yorkshire.
Logged
Steve
Sheffield, UK.
www.lizziedripping.org.uk

Anahata

  • This mind intentionally left blank
  • Hero Member
  • *****
  • Offline Offline
  • Posts: 6767
  • Oakwood D/G, C/F Club, 1-rows in C,D,G
    • Treewind Music
Re: mscz/abc hybrid
« Reply #18 on: January 23, 2020, 10:01:00 PM »

PDF isn't a generic container format in the sense that a .ZIP file is, and a .mscz file seems to be simply a .ZIP file containing an mscx file and meta-data.

I'm not sure that Musescore would take any notice of any contents that it did not understand. But before I installed MuseScore, my system thought a .mscz file it was a zip file and opened it up as a folder containing two files. On a Windows system, if one of them was executable and I double-clicked it... well, I'd deserve the consequences, but people do that kind of thing. So it's potentially dangerous because you can easily hide any file in it.

A PDF contains executable code, in a language that is supposed to be fairly safe and restricted, but there used to be bugs in the Adobe PDF reader that could be exploited by carefully crafted PDF contents to make it do things it shouldn't, such as extract and run an executable payload. I think most PDF readers are fairly safe now, because I haven't heard of such exploits for years. So there's less of an argument for PDFs to be considered dangerous.
Logged
Слава Україні !
Music recording and web hosting: www.treewind.co.uk
Mary Humphreys and Anahata: www.maryanahata.co.uk
Ceilidh band: www.barleycoteband.co.uk

Fred

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 719
  • G/C Pariselle, D/G Loffet & maybe too many Hohners
Re: mscz/abc hybrid
« Reply #19 on: January 23, 2020, 11:35:23 PM »

Since we're not connected to the forum via HTTPS, any file downloaded from this forum can be replaced with a malicious one by any person with access to any place in the line between your computer/phone and melnet.
They can also change the content of thread you're seeing and add malicious attachments to each and every post.
So mscz or not is really the least of our concerns.

Not much to add here.
Logged
Pages: [1] 2   Go Up
 


Melodeon.net - (c) Theo Gibb; Clive Williams 2010. The access and use of this website and forum featuring these terms and conditions constitutes your acceptance of these terms and conditions.
SimplePortal 2.3.5 © 2008-2012, SimplePortal